Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-14028

Date Time support in pipeline / dataprep UI

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.1.0
    • Component/s: Data Prep, Pipelines, UI
    • Labels:
      None
    • Sprint:
      5.1 09/02, 5.1 09/09
    • Release Notes:
      Add support for date, time, and timestamp in UI
    • Rank:
      1|hzy0rc:0irr007x4000129u4061k

      Description

      We plan on adding date and time field types. The UI will need to be enhanced to allow these new types.

      Note that schemas will be represented just like they are in avro, where date and time are simply the 'logical type' of an existing 'physical type'. (https://avro.apache.org/docs/1.8.1/spec.html#Logical+Types). For example, a 'Timestamp' field is not represented as:

      {
        "type": "record",
        "name": "recordName",
        "fields": [
          { "name": "ts", "type": "Timestamp" }
        ]
      }
      

      But is represented as:

      {
        "type": "record",
        "name": "recordName",
        "fields": [
          { "name": "ts", "type": "long", "logicalType": "Timestamp" }
        ]
      }
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                edwin Edwin Elia
                Reporter:
                ashau Albert Shau
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: