Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-3077

Add the ability in TableSink to find schema.row.field case-insensitively

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.0, 3.0.3, 3.0.2, 3.0.1, 3.0.0
    • Fix Version/s: 3.1.0
    • Component/s: Applications
    • Labels:
      None
    • Rank:
      1|hzywfj:

      Description

      Currently, field names in StructuredRecord are case-sensitive. Due to this, we are sometimes at the mercy of external systems. For instance, Some JDBC drivers (e.g. org.netezza.Driver for Netezza) return all columns in upper case no matter how users created them. When we create StructuredRecord out of the ResultSetMetadata returned by these drivers, the fields are all upper cased, which can cause a mismatch with the declared schema of a StructuredRecord (e.g. in an ETL config json).

      This causes validation errors with messages that are hard to debug (e.g. [field] not found in [StructuredRecord] even though the [field] is clearly present in the configuration that users supply, albeit with a mismatched case).

        Attachments

          Activity

            People

            • Assignee:
              bhooshan Bhooshan Mogal
              Reporter:
              bhooshan Bhooshan Mogal
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: