Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-14356

Pipeline UI somehow sets illegal schema

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.1.0
    • Component/s: Pipelines, UI
    • Labels:
      None
    • Sprint:
      5.1 09/25
    • Rank:
      1|i00hsr:

      Description

      Attached is an invalid pipeline the UI somehow generated. Rough steps I followed:

      1. Created a GCS -> parser -> GCS(json) pipeline and saved it as a draft

      2. Deployed an updated version of google cloud plugins

      3. Returned to the draft and added rest of the sinks

      4. Attached csv parser to other sinks

      5. propagated schema from parser.

      6. tried to deploy

      The problem is that one of the sinks has schema as:

      "properties": {
        "schema": [
          {
            "name": "etlSchemaBody",
            "schema": "... what the property should be"
          }
        ]
      }
      

      The is some weird extra array and object wrapping the actual schema.

        Attachments

          Activity

            People

            • Assignee:
              ajai Ajai Narayan
              Reporter:
              ashau Albert Shau
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: