Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-10409

Spark pipelines never stop on Windows

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 4.1.0
    • Fix Version/s: 4.1.1
    • Component/s: Pipelines
    • Labels:
      None
    • Rank:
      1|hzzwtz:

      Description

      Tried to preview the attached pipeline in Hydrator. Looks like the preview succeeds and the data is there, but the pipeline never seems to stop running. The same pipeline as a MR job runs in 10 seconds.

      When publishing the pipeline as a Spark job, the same thing happens. The pipeline runs, metrics come through like it has finished processing, but the job never stops.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Nishith Nishith Nand
                Reporter:
                russellsavage Russ Savage
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: