Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: CDAP
    • Labels:
      None
    • Rank:
      1|i00aev:

      Description

      We have seen a case where spark autodetection fails, and master is started with SPARK_COMPAT=spark_2.10 instead of SPARK_COMPAT=spark1_2.10. This causes spark support to not work.

      In one instance it appears to have worked ok on initial cluster spinup, suggesting it might be intermittent. Thus far attempts to reproduce have failed.

      A workaround is to manually set SPARK_COMPAT=spark1_2.10 in /etc/cdap/conf/cdap-env.sh.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                terence Terence Yim
                Reporter:
                derek Derek Wood
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: