Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12838

Update docs on configuring Spark2

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.3.1
    • Fix Version/s: 4.3.2
    • Component/s: CDAP
    • Labels:
      None
    • Rank:
      1|i009br:

      Description

      When configuring CDAP to use Spark2 there are a couple extra steps that aren't documented.

      1. In addition to setting the SPARK_MAJOR_VERSION, you also have to set SPARK_HOME to the spark2 dir.

      2. If CDAP has already run with Spark 1, you need to delete the cdap-data-pipeline and cdap-data-streams and restart CDAP.

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              mattwuenschel Matt Wuenschel
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: