Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-16367

Emit field lineage for source and sink one by one instead of emitting all of them together

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.2.1, 6.3.0, 6.1.3
    • Component/s: None
    • Release Notes:
      Fixed a bug where field lineage is incorrect when a source is directly connected to a sink.
    • Rank:
      1|i00u9z:

      Description

      Currently we emit field lineage for source and sink using one operation containing all the fields, this basically means these fields are corelated, and if there are no transforms between source and sink, a lineage graph from all input to all output fields are generated. For pipelines with transform, this just happens to work since the transform is emitting the correct lineage for the output fields.

        Attachments

          Activity

            People

            • Assignee:
              yaojie Yaojie Feng
              Reporter:
              yaojie Yaojie Feng
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: