Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-7596

Add a way to let a PFS use an existing file system location and Hive table

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.1.0
    • Component/s: Datasets, Explore
    • Labels:
    • Release Notes:
      Added the ability to reuse an existing file system location and Hive table when creating a partitioned file set.
    • Rank:
      1|hzzo8v:

      Description

      This would help in migrating a Hive table that is currently under control of a different ingest procedure, to be managed by a CDAP PFS.

      The schema and partitioning of the existing table must match the PFS,

      It is not clear what this means for the existing partitions of the Hive table. They will exist in Explore, but not in the PFS partition table. Similarly, it is not clear what this means for files that were present before the PFS started managing that location.

        Attachments

          Activity

            People

            • Assignee:
              andreas Andreas Neumann
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: