Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-6276

Proper dataset update APIs

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.4.2
    • Fix Version/s: 3.5.0
    • Component/s: Datasets
    • Labels:
    • Release Notes:
      Introduced new experimental dataset APIs for updating a dataset's properties.
    • Rank:
      1|hzzeuf:

      Description

      In the current dataset framework (pre-3.5.0), there is a bit of confusion about dataset update and upgrade. Update is the change required after dataset properties were updated. Upgrade is change required after the code for a dataset type has changed. Currently, both is implemented by the same DatasetAdmin.upgrade(). This method, however, has no information about the previous state of the dataset. Also, there is no way to validate whether an update is compatible before starting the actual update in storage media.

      We need to introduce new APIs to implement dataset update properly.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                andreas Andreas Neumann
                Reporter:
                andreas Andreas Neumann
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: