Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12193

Pipeline planner may not always merge phases

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.3.0
    • Component/s: Pipelines
    • Labels:
    • Release Notes:
      Fixed a bug in some mapreduce pipelines that could cause duplicate reads if sources are not properly merged into the same mapreduce.
    • Rank:
      1|i005gv:

      Description

      There are situations where the pipeline planner will not merge phases that can be merged together. The attached config is one example. Here, the planner creates four phases instead of three. This results in one of the sources being read twice.

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              ashau Albert Shau
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: