Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-7090

DefaultNamespaceEnsurer doesn't let CDAP Master shutdown

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0.0, 3.6.0, 3.5.1, 3.5.0
    • Fix Version/s: 4.1.0, 3.5.4, 4.0.2
    • Component/s: Master
    • Labels:
    • Release Notes:
      Fixed an issue where DefaultNamespaceEnsurer sometimes prevented CDAP Master shutdown.
    • Rank:
      1|hzzkg7:

      Description

      DefaultNamespaceEnsurer makes sure that default namespace exists. If it fails, it silently retries. We do this because maybe dataset service isn't ready yet, and will be in another few minutes. This can lead to infinite retries in the following cases -

      1. CDAP does not have permissions to create default namespace
      2. CDAP is stopped soon after startup (before all services have started successfully)

      The infinite retries do not let CDAP Master shutdown completely. This can lead to CDAP Master hanging when shutting down, or CDAP Master hanging when it becomes a follower on losing Zookeeper session.

        Attachments

        1. jstack-1.out.txt
          139 kB
        2. master.log
          1.35 MB

          Issue Links

            Activity

              People

              • Assignee:
                ali.anwar Ali Anwar
                Reporter:
                ali.anwar Ali Anwar
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: