Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-16647

spark program on sandbox with ssh launch and monitor fails

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.2.0, 6.3.0
    • Component/s: None
    • Labels:
      None
    • Rank:
      1|i00w5j:

      Description

       

      2020-04-22 10:06:25,206 - ERROR [SparkRunnerphase-1:i.c.c.i.a.r.ProgramControllerServiceAdapter@92] - Spark Program 'phase-1' failed.
      java.util.concurrent.ExecutionException: java.lang.SecurityException: Exit not allowed from Spark class: [class io.cdap.cdap.internal.app.runtime.distributed.ProgramContainerSecurityManager, class java.lang.Runtime, class java.lang.System, class org.apache.spark.deploy.SparkSubmit$$anonfun$1, class org.apache.spark.deploy.SparkSubmit$, class org.apache.spark.deploy.SparkSubmit$, class org.apache.spark.deploy.SparkSubmit$, class org.apache.spark.deploy.SparkSubmit$, class org.apache.spark.deploy.SparkSubmit, class io.cdap.cdap.app.runtime.spark.submit.AbstractSparkSubmitter, class io.cdap.cdap.app.runtime.spark.submit.AbstractSparkSubmitter, class io.cdap.cdap.app.runtime.spark.submit.AbstractSparkSubmitter$5, class java.util.concurrent.Executors$RunnableAdapter, class java.util.concurrent.FutureTask, class java.util.concurrent.ThreadPoolExecutor, class java.util.concurrent.ThreadPoolExecutor$Worker, class java.lang.Thread]
      	at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:294) ~[com.google.guava.guava-13.0.1.jar:na]
      	at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:281) ~[com.google.guava.guava-13.0.1.jar:na]
      	at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116) ~[com.google.guava.guava-13.0.1.jar:na]
      	at io.cdap.cdap.app.runtime.spark.SparkRuntimeService.run(SparkRuntimeService.java:346) ~[io.cdap.cdap.cdap-spark-core2_2.11-6.2.0-SNAPSHOT.jar:na]
      	at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:52) ~[com.google.guava.guava-13.0.1.jar:na]
      	at io.cdap.cdap.app.runtime.spark.SparkRuntimeService$5$1.run(SparkRuntimeService.java:404) [io.cdap.cdap.cdap-spark-core2_2.11-6.2.0-SNAPSHOT.jar:na]
      	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_242]
      Caused by: java.lang.SecurityException: Exit not allowed from Spark class: [class io.cdap.cdap.internal.app.runtime.distributed.ProgramContainerSecurityManager, class java.lang.Runtime, class java.lang.System, class org.apache.spark.deploy.SparkSubmit$$anonfun$1, class org.apache.spark.deploy.SparkSubmit$, class org.apache.spark.deploy.SparkSubmit$, class org.apache.spark.deploy.SparkSubmit$, class org.apache.spark.deploy.SparkSubmit$, class org.apache.spark.deploy.SparkSubmit, class io.cdap.cdap.app.runtime.spark.submit.AbstractSparkSubmitter, class io.cdap.cdap.app.runtime.spark.submit.AbstractSparkSubmitter, class io.cdap.cdap.app.runtime.spark.submit.AbstractSparkSubmitter$5, class java.util.concurrent.Executors$RunnableAdapter, class java.util.concurrent.FutureTask, class java.util.concurrent.ThreadPoolExecutor, class java.util.concurrent.ThreadPoolExecutor$Worker, class java.lang.Thread]
      	at io.cdap.cdap.internal.app.runtime.distributed.ProgramContainerSecurityManager.checkExit(ProgramContainerSecurityManager.java:64) ~[na:na]
      	at java.lang.Runtime.exit(Runtime.java:108) ~[na:1.8.0_242]
      	at java.lang.System.exit(System.java:973) ~[na:1.8.0_242]
      	at org.apache.spark.deploy.SparkSubmit$$anonfun$1.apply$mcVI$sp(SparkSubmit.scala:91) ~[na:na]
      	at org.apache.spark.deploy.SparkSubmit$.printErrorAndExit(SparkSubmit.scala:97) ~[na:na]
      	at org.apache.spark.deploy.SparkSubmit$.prepareSubmitEnvironment(SparkSubmit.scala:273) ~[na:na]
      	at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:160) ~[na:na]
      	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:126) ~[na:na]
      	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) ~[na:na]
      	at io.cdap.cdap.app.runtime.spark.submit.AbstractSparkSubmitter.submit(AbstractSparkSubmitter.java:172) ~[na:na]
      	at io.cdap.cdap.app.runtime.spark.submit.AbstractSparkSubmitter.access$000(AbstractSparkSubmitter.java:54) ~[na:na]
      	at io.cdap.cdap.app.runtime.spark.submit.AbstractSparkSubmitter$5.run(AbstractSparkSubmitter.java:111) ~[na:na]
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_242]
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_242]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_242]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_242]
      	... 1 common frames omitted 

        Attachments

          Activity

            People

            • Assignee:
              vinisha Vinisha Shah
              Reporter:
              vinisha Vinisha Shah
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: