Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-5811

Explore should reuse Spark container for queries

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Explore
    • Labels:
    • Rank:
      1|hzzc1r:

      Description

      Explore launches a new Spark job for every query. Starting a new Spark job for every query brings in a lot of overhead. We should figure out a way to reuse Spark jobs across queries. Hive already reuses a Spark job for all queries in a session.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                poorna Poorna Chandra
                Reporter:
                poorna Poorna Chandra
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: