Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-6913

Use YarnClient instead of making an http request to Yarn webapp, for cluster metrics

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.4.3
    • Fix Version/s: 3.5.0
    • Component/s: App Fabric
    • Labels:
    • Release Notes:
      Use YarnClient instead of the YARN Http API to fetch node reports
    • Rank:
      1|hzzj3b:

      Description

      In DistributedProgramRuntimeService, we make an http request to YARN web app to fetch the cluster metrics, such as "resources.total.memory" and "resources.available.memory".
      We may be able to do this using YarnClient, by getting the NodeReports, and summing up their metrics.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                terence Terence Yim
                Reporter:
                ali.anwar Ali Anwar
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: