Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-3351

Directory structure for predefined applications in CDAP

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.2.0
    • Component/s: UI
    • Labels:
      None
    • Sprint:
      FE Sprint ending 08/17
    • Release Notes:
      Defined a directory structure to be used for predefined applications.
    • Rank:
      1|hzyxpj:

      Description

      Following is the directory structure that should be defined for predefined applications. FE should read the config.json to load the predefined templates. It should also have the ability to periodically poll this file to load the changes in – IFF the FE caches the configuration in the server.

      -rw-r--r--  1 nmotgi  staff  4817 Aug 11 10:25 ETLContactsInToElasticSearch-ETLBatch.json
      -rw-r--r--  1 nmotgi  staff  8319 Aug 11 10:25 AppendStreamToTableWithProjections-ETLBatch.json
      -rw-r--r--  1 nmotgi  staff  2152 Aug 11 10:25 KafkaToHBaseTableETL-ETLRealtime.json
      -rw-r--r--  1 nmotgi  staff   570 Aug 11 10:29 config.json
      ~/Work/Devel/cdap/cdap-standalone/target/cdap-sdk-3.2.0-SNAPSHOT/ui/templates/apps/predefined $ cat config.json 
      {
        'ETLRealtime' : [
           {
             'name' : 'Kafka2HBase',
             'file' : 'KafkaToHBaseTableETL-ETLRealtime',
             'description' : 'Ingests data from Kafka into HBase'
           },
        ],
        
        'ETLBatch' : [
           {
             'name' : 'Stream2Table'
             'description' : 'Ingests data from stream into a hbase table'
             'file' : 'AppendStreamToTableWithProjections-ETLBatch'
           },
          
           {
             'name' : 'Contact ETL'
             'description' : 'ETL Contacts from stream into Time partitioned AVRO'
             'file' : 'ETLContactsInToElasticSearch-ETLBatch'
           }
        ]
      }
      ~/Work/Devel/cdap/cdap-standalone/target/cdap-sdk-3.2.0-SNAPSHOT/ui/templates/apps/predefined $ 
      

        Attachments

          Activity

            People

            • Assignee:
              ajai Ajai Narayan
              Reporter:
              nitin Nitin Motgi
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: