Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-2997

SparkProgramRunnerTest fails randomly

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1.0
    • Component/s: None
    • Labels:
      None
    • Rank:
      1|hzyvzr:

      Description

      One of the tests starts a Spark program with output to an existing location. This is a new test that validates that the dataset's inFailure() is called. This test also validates that the Spark program throws an exception. Apparently there is a race condition that sometimes the exception is not captured by the program runner. In that case the test case fails. because it expects that exception.

      It always succeeds on my laptop, but sometime fails, or sometimes succeeds in Bamboo.

      A quick fix is to remove the assertion of the exception from the test case, and only to assert that the onFailure was called.

        Attachments

          Activity

            People

            • Assignee:
              andreas Andreas Neumann
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: