Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-13971

Kafka Connection generates a wrangler plugin that expects a different input field

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 5.0.0
    • Fix Version/s: 5.1.0
    • Component/s: Data Prep, Kafka, UI
    • Labels:
      None
    • Sprint:
      5.1 08/13
    • Rank:
      1|hzy0rc:0irr007x4000126

      Description

      After creating a pipeline from a Kafka connection, the output schema of the Kafka source is set to a single field named "message". Whereas the Wrangler plugin expects a field named "body".  The consequence is that all data reaches the sink as null (or the pipeline fails if any plugin expects non-nullable input).

      Either the Kafka source should emit the "body" field, or the Dataprep should start with a field named "message" after opening the connection. 

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ajai Ajai Narayan
                Reporter:
                andreas Andreas Neumann
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: