Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-11954

Datasets should have a generic way to extract configuration from properties, arguments, or operations

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 4.2.0
    • Fix Version/s: 6.0.0
    • Component/s: Datasets
    • Labels:
      None
    • Rank:
      1|i0043j:

      Description

      Today, most dataset configuration is either through runtime arguments, or through dataset properties. A few operations (such as Scan, Increment) support additional configuration.

      Ideally, runtime arguments can override dataset properties, and operations can override runtime arguments. Datasets should have a common utility method to extract that configuration. For example:

      hScan.setCacheBlocks  (
        getBooleanConfig("hbase.client.cache.blocks", // property name
                         false, // default value
                         scan.getProperties(), // first to look up, highest precedence
                         this.runtimeArguments, // next highest precedence
                         this.spec.getProperties() // next highest precedence
        ));
      

      These utilities should be used across the board.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                andreas Andreas Neumann
                Reporter:
                andreas Andreas Neumann
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: