Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-4975

YARN Resource Manager Switchover fails when Kerberos is enabled

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.3.0
    • Fix Version/s: 3.3.1
    • Component/s: None
    • Labels:
      None
    • Release Notes:
      Pass ResourceManager delegation tokens in the proper format in secure Hadoop HA clusters.
    • Rank:
      1|hzz6xr:

      Description

      Context:
      ClouderaManager, CDH 5.5.1.
      CDAP 3.3.1-SNAPSHOT
      Kerberos-enabled, HA Hadoop and CDAP

      When HA is enabled, transitioning YARN Resource Manager (RM) fails:

      yarn rmadmin -transitionToActive  <RM_id> 

      When an RM which was previously on standby tries to start up, it tries to renew a delegation token (RM_DELEGATION_TOKEN) for the existing YARN applications (CDAP master in this case). This fails if the other RM has already gone to standby, because the RM that is currently starting up attempts to use the other RM or itself as a renewer. Using itself does not work as the service on port 8032 will start up only after recovering existing apps.

      It looks to be like a YARN issue and not a CDAP issue.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ali.anwar Ali Anwar
                Reporter:
                ali.anwar Ali Anwar
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: