Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12961

PartitionedFileSetArguments.addInputPartition should also specifying a PartitionKey

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: API, Datasets
    • Labels:
    • Rank:
      1|i009zb:

      Description

      PartitionedFileSetArguments.addInputPartition should also specifying a PartitionKey.
      Currently, it requires that the user pass in a Partition object.

      If a user knows which PartitionKey(s) they want to process, the current API requires that the user instantiate the PartitionedFileSet, and fetch the Partition objects for each of the keys. This step can be bypassed if the API allows the user to just specify the PartitionKey(s).

      This will also resolve the following TODO:
      https://github.com/caskdata/cdap/blob/v4.3.2/cdap-api/src/main/java/co/cask/cdap/api/dataset/lib/PartitionedFileSetArguments.java#L168

        Attachments

          Activity

            People

            • Assignee:
              bhooshan Bhooshan Mogal
              Reporter:
              ali.anwar Ali Anwar
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: