Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-5685 Improve Dataset Service Performance and Stability
  3. CDAP-5691

Server-side caching of getDataset() in DatasetService

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.4.0
    • Fix Version/s: 3.5.0
    • Component/s: Datasets
    • Labels:
      None
    • Release Notes:
      Improved the performance of Dataset Service
    • Rank:
      1|hzzbcn:

      Description

      If many instances of a program (say a Flowlet, a MapReduce, ...) start at the same time, they will all request the same datasets concurrently. Having a server-side cache would allow answering most of these requests faster, also would not have to record the usage each time it's cache hit. (The cache key would have to include the owners).

        Attachments

          Activity

            People

            • Assignee:
              andreas Andreas Neumann
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: