Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-3945

Intelligent workflow scheduling

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
    • Sprint:
      ETL MVP CDAP 3.3
    • Release Notes:
      Added a way to limit the number of concurrent schedule runs.
    • Rank:
      1|hzz1gv:

      Description

      Intelligent workflow scheduling:
      Implement limits on the number of active workflows, yarn containers, etc, to avoid resource starvation. For near term, a limit on number of active workflows will suffice.

      The use case here is that a developer wants to ensure that workflows don't pile up and destroy a cluster.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ashau Albert Shau
                Reporter:
                priyanka Priyanka Nambiar
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: