Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12645

Move MR Task Metrics emission from driver to mapper/reducer task

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.3.1
    • Component/s: None
    • Labels:
      None
    • Release Notes:
      MapReduce Task-related metrics will be emitted from individual tasks instead of MapReduce driver.
    • Rank:
      1|i0085z:

      Description

      In order to reduce the metrics payload size, the task related metrics should be emitted from the individual tasks instead of emitting from the MR driver. This becomes more important during large, long running jobs. Please check CDAP-12560 for the original issue that motivated this change.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gokul Gokul Gunasekaran
                Reporter:
                gokul Gokul Gunasekaran
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: