Spark jobs, especially Spark streaming jobs can be long running. Jobs started on a secure cluster do not get their credentials updated after they are launched. This can lead to the job failing midway if the credentials expire during run.
We'll need to figure out ways by which we can update credentials for each kind of job. This will likely lead to additional tickets for each job type.