Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-3345

InMemoryDatasetFramework does not convert TTL from seconds to milli-seconds.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.1.0, 3.0.0, 2.8.0
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
      None
    • Release Notes:
      Fixed a bug where TTL for datasets were incorrect, reduced by (/1000) after upgrade. After running upgradeTool, please make sure the TTL values of tables are as expected.
    • Rank:
      1|hzyxrb:

      Description

      RemoteDatasetFramework which is used by Standalone and in Distributed mode, calls the DatasetInstanceHandler, for (create, upgrade, get) instances of dataset.

      In DatasetInstanceHandler, we convert the dataset.table.ttl from seconds to milli-seconds and update the spec before performing dataset admin operation (create, upgrade).

      similarly we convert from milli-seconds to seconds while serializing the response of DatasetSpecification while getting dataset Instances.

      However we are not doing similar conversion for InMemoryDatasetFramework, since InMemoryDatasetFramework is used by UpgradeTool, this has the dataset-spec in seconds (not converted to milli-seconds) and dataset upgrade changes the TTL. causing the tables which have property dataset.table.ttl to reduce by order of 1000.

      This is not specific to just metrics tables, but any table (system, user) which has the property dataset.table.ttl

      Fix should be perform conversion in InMemoryDatasetFramework similar to RemoteDatasetFramework.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                shankar Shankar Selvam
                Reporter:
                shankar Shankar Selvam
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: