Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-5794

CDAP should update delegation tokens for Spark jobs

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.5.0
    • Component/s: Master, Security
    • Labels:
    • Release Notes:
      Support running long-running Spark jobs in a Kerberos-enabled cluster.
    • Rank:
      1|hzzbxz:

      Description

      Spark jobs, especially Spark streaming jobs can be long running. Jobs started on a secure cluster do not get their credentials updated after they are launched. This can lead to the job failing midway if the credentials expire during run.

      We'll need to figure out ways by which we can update credentials for each kind of job. This will likely lead to additional tickets for each job type.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                terence Terence Yim
                Reporter:
                poorna Poorna Chandra
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: