Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-9242

Documentation for PFS setUseExisting(true) is not clear enough

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.1.0
    • Fix Version/s: 4.1.1
    • Component/s: Datasets, Docs
    • Labels:
    • Release Notes:
      Improved the documentation for PartitionedFileSet properties.
    • Rank:
      1|hzzz1b:

      Description

      Documentation should explain that if a PFS is created with setUseExisting(true), then delete/truncate will not touch the partitions in Hive.

      We do explain that no files in HDFS will be deleted; but it is not obvious that this also applies to Hive partitions. http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/datasets/fileset.html#creating-a-fileset. We should add a paragraph in the PFS section: http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/datasets/partitioned-fileset.html#creating-a-partitionedfileset

        Attachments

          Activity

            People

            • Assignee:
              andreas Andreas Neumann
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: