Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-17194

Pre-Upgrade job stage fails due to race condition in workflow state

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.2.1, 6.3.0, 6.1.4
    • Component/s: None
    • Labels:
      None
    • Rank:
      1|i00zuv:

      Description

      Pre-Upgrade job stage can fail when trying to stop a workflow due to combination of retry and race condition between Checking if RUNNING and transitioning workflow to terminal state.

       

      The solution is to try to stop all workflows before failing the whole pre-upgrade job so on the next retry workflows should have transitioned to terminal state. Current behavior is to try and stop pipelines one by one and fail on the first failure which is not ideal if there many pipelines running.

        Attachments

          Activity

            People

            • Assignee:
              pandyajay10 Jay Pandya
              Reporter:
              pandyajay10 Jay Pandya
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: