Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-5898

Kafka, ZK Process left running if there is an exception during startup/shutdown of CDAP process in SDK

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.4.0
    • Fix Version/s: 3.4.1
    • Component/s: Standalone
    • Labels:
      None
    • Release Notes:
      Shutdown external processes started by CDAP (Zookeeper and Kafka) when there is an error during either startup or shutdown of CDAP.
    • Rank:
      1|hzzckv:

      Description

      Found this issue while working on CDAP-5889. When one of the Services that are started during the startup sequence of the CDAP StandaloneMain process throws an exception, we call the halt on runtime to stop the JVM. Unfortunately, this won't invoke the shutdown hooks and this was fine so far since all the services ran within the single JVM but now since 3.4, we also start Kafka and ZK processes separate from CDAP. And hence these processes aren't shutdown. Note that the same problem holds true when services are being shutdown and if one of them is in a FAILED state, then the stopAndWait on the service throws UncheckedExecutionException and we leave the Kafka/ZK processes running. One potential fix is to do stopping of ZK/Kafka processes in a finally block.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gokul Gokul Gunasekaran
                Reporter:
                gokul Gokul Gunasekaran
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: