Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 4.0.1, 4.0.0
    • Fix Version/s: 4.1.0, 4.0.2
    • Component/s: CDAP, Explore, Spark
    • Labels:
      None
    • Release Notes:
      Fixed an issue with "Hive-on-Spark" on newer versions of CDH.
    • Rank:
      1|hzzu6v:

      Description

      When Hive on Spark is enabled on a cluster managed by Cloudera, queries that trigger a spark job fail to start an application in Yarn.
      CDAP master has the following error:

      2017-02-07 00:28:49,635 - ERROR [HiveServer2-Background-Pool: Thread-97:o.a.h.s.c.SparkClientImpl@113] - Error while waiting for client to connect.
      java.util.concurrent.ExecutionException: java.lang.RuntimeException: Cancel client 'ecb6be99-ea53-4121-b9fa-4be5d0ffc1c4'. Error: Child process exited before connecting back with error log Error: Cannot load main class from JAR file:/yarn/nm/usercache/cdap/appcache/application_1486425431946_0002/container_1486425431946_0002_01_000003/4
      Run with --help for usage help or --verbose for debug output
      
      	at io.netty.util.concurrent.AbstractFuture.get(AbstractFuture.java:37) ~[netty-all-4.0.23.Final.jar:4.0.23.Final]
      	at org.apache.hive.spark.client.SparkClientImpl.<init>(SparkClientImpl.java:106) ~[hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hive.spark.client.SparkClientFactory.createClient(SparkClientFactory.java:80) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient.createRemoteClient(RemoteHiveSparkClient.java:99) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient.<init>(RemoteHiveSparkClient.java:95) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.exec.spark.HiveSparkClientFactory.createHiveSparkClient(HiveSparkClientFactory.java:67) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionImpl.open(SparkSessionImpl.java:62) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.exec.spark.session.SparkSessionManagerImpl.getSession(SparkSessionManagerImpl.java:114) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.exec.spark.SparkUtilities.getSparkSession(SparkUtilities.java:111) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.exec.spark.SparkTask.execute(SparkTask.java:97) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1969) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1682) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1419) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1203) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1198) [hive-exec-1.1.0-cdh5.9.1.jar:1.1.0-cdh5.9.1]
      	at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:187) [1486427023191-hive-jdbc-1.1.0-cdh5.9.1-standalone.jar:1.1.0-cdh5.9.1]
      	at org.apache.hive.service.cli.operation.SQLOperation.access$100(SQLOperation.java:76) [1486427023191-hive-jdbc-1.1.0-cdh5.9.1-standalone.jar:1.1.0-cdh5.9.1]
      	at org.apache.hive.service.cli.operation.SQLOperation$2$1.run(SQLOperation.java:241) [1486427023191-hive-jdbc-1.1.0-cdh5.9.1-standalone.jar:1.1.0-cdh5.9.1]
      	at java.security.AccessController.doPrivileged(Native Method) [na:1.7.0_67]
      	at javax.security.auth.Subject.doAs(Subject.java:415) [na:1.7.0_67]
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1714) [hadoop-common-2.6.0-cdh5.9.1.jar:na]
      	at org.apache.hive.service.cli.operation.SQLOperation$2.run(SQLOperation.java:254) [1486427023191-hive-jdbc-1.1.0-cdh5.9.1-standalone.jar:1.1.0-cdh5.9.1]
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [na:1.7.0_67]
      	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_67]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_67]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_67]
      	at java.lang.Thread.run(Thread.java:745) [na:1.7.0_67]
      

        Attachments

          Activity

            People

            • Assignee:
              ali.anwar Ali Anwar
              Reporter:
              mattwuenschel Matt Wuenschel
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: