Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-10911

Increase default pipeline resources

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: Pipelines, UI
    • Labels:
    • Sprint:
      App Eng Sprint 3
    • Rank:
      1|hzy41r:

      Description

      Pipeline resources default to 512 mb and 1 vcore. For many pipelines, especially Spark pipelines, this is too little. Spark pipelines almost always will have their containers killed by yarn due to memory usage going past the threshold, which manifests itself in very strange and confusing behavior.

        Attachments

          Activity

            People

            • Assignee:
              sushil@cask Sushil Adokar
              Reporter:
              ashau Albert Shau
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: