Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-14021

DateTime logical type support in CDAP schema

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.1.0
    • Component/s: Datasets
    • Labels:
      None
    • Release Notes:
      Added Date, Time and Timestamp support in CDAP Schema.
    • Rank:
      1|i00fzz:

      Description

      The CDAP schema is mean to be a superset of Avro's schema, where arbitrary types are supported as map keys instead of just string types. In Avro 1.8, support for logical types were added, with the most common use case being dates and times.

      Similarly, we want to support logical types in CDAP schemas, especially for dates and times. When schema is set on datasets and we create explore tables for them, we should create the table with the relevant data type including date and time.

      Similarly, when pipeline plugins read from relational databases or other data sources that have date and time as primitive types, plugin developers should have easy ways to set these dates as fields in a StructuredRecord.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vinisha Vinisha Shah
                Reporter:
                ashau Albert Shau
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: