Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-7682

Add a property for kafka zookeeper quorum to be used between all kafka clients

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.5.2
    • Component/s: Kafka
    • Labels:
    • Release Notes:
      Added a property kafka.zookeeper.quorum to used across all internal clients using Kafka
    • Rank:
      1|hzzp27:

      Description

      Use-case:

      • Share a single kafka server across multiple CDAP instance.

      This can be achieved by using the same zookeeper quorum to be used for all clients that consumes kafka. Currently the zookeeper quorum property that is used by kafka clients is also being used by system services for service registration and discovery.

      The change that would be needed is to add a separate property that can be used only for kafka consumers ( kafka.zookeeper.quorum). Update the client code to use this property instead of the generic zookeeper.quorum property. With this change and the kafka topic prefixes a single kafka server can be re-used across multiple instances of CDAP.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mao Chengfeng Mao
                Reporter:
                sree Sreevatsan Raman
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: