Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-16712

Improve scalability of preview system when running on Kubernetes environment.

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 6.1.2
    • Fix Version/s: 6.3.0, 6.1.4, 6.2.2
    • Component/s: CDAP
    • Labels:
    • Release Notes:
      Improved the scalability of the preview system when running in Kubernetes environment by separating out preview runs in their own individual pods. Preview manager pod now only responsible for handling preview REST api.
    • Rank:
      1|i00wof:

      Description

      This bug is to track the design and implementation of the scalable preview system.

      On high level - 

      1. Preview runner pods will be responsible for running actual preview job.
      2. These pods will be exposed as Kubernetes service object.
      3. Preview Manager will talk to the service to start/stop the preview runs.
      4. Tracing data along with logs will be shipped back to the preview manager by using TMS.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sagar Sagar Kapare
                Reporter:
                sagar Sagar Kapare
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: