Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-4979

Parameters Kafka source and sink are inconsistent

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Won't Fix
    • Affects Version/s: 3.3.1
    • Fix Version/s: 4.0.0
    • Component/s: ETL
    • Labels:
      None
    • Rank:
      1|hzz6y7:

      Description

      • for the source I have to specify either "Zookeeper Quorum" or "Kafka Brokers". For the sink I have to specify "Kafka Brokers" (which is documented as connection string where the leader for a topic can be discovered - that sounds like it really wants a ZK quorum...)
      • for the source, I can specify "Format" as avro, clf, csv, grok, syslog, text, or tsv, whereas for the sink, I can specify "Message Format" as JSON, CSV, EXCEL, MYSQL, TDF or RFC4180. Not only is the parameter named differently, values are in upper case here and lower case there, and the same format even has a different name (tsv vs TDF).
      • for the source, specify "Topic", but for the sink, you specify "Kafka Topics"

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: