Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-15800

Pipeline phase stuck in starting state

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Rank:
      1|i00qlz:

      Description

      When a pipeline fails in a particular way (potentially due to unavailable YARN resources?), the mapreduce program state gets stuck in the STARTING state. This is on the k8s CDAP runtime.

      Steps to reproduce:

      1. Create a low-resource dataproc cluster (n1-standard-1)
      2. Run two jobs at the same time
      3. This should fail the job, often without error. You may need to run in a few times for this to happen; it seems to happen randomly.
      4. Attempt to delete the pipeline. CDAP will not allow you to do this since it still believes the job to be running even after failure.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ashau Albert Shau
                Reporter:
                lidennis Dennis Li
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: