Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-13414

Action plugins should be able to access the stage statistics.

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 4.3.4
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Rank:
      1|i00cmn:

      Description

      We added stage statistics (input, output, and error) for the condition plugins. These statistics are emitted from tasks in the form of counters in case of MapReduce or accumulators in case of Spark. For performance reasons we only emit these counters for each stage if the pipeline contains any Condition node. However these statistics can also be useful for the Action plugins.

        Attachments

          Activity

            People

            • Assignee:
              bhooshan Bhooshan Mogal
              Reporter:
              sagar Sagar Kapare
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: