Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-7887

Cannot get Yarn and HDFS WebUrl and LogsUrl on secure HA cluster

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0.0
    • Fix Version/s: 5.0.0
    • Component/s: CDAP, CDAP Services
    • Labels:
      None
    • Rank:
      1|hzzqpr:

      Description

      Getting WARN co.cask.cdap.operations.OperationalStatsService: Error while collecting stats for service on kerberos cluster. Another symptom is, I am dont get yarn url when I click on Yarn in Overview section. Full stacktrace is:

      2016-12-16 02:19:02,659 WARN co.cask.cdap.operations.OperationalStatsService: Error while collecting stats for service: YARN; type: info
      java.io.IOException: Failed on local exception: java.io.IOException: java.lang.IllegalArgumentException: Failed to specify server's Kerberos principal name; Host Details : local host is: "hostname/ip"; destination host is: "hostname":8033; 
      	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client.call(Client.java:1476) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client.call(Client.java:1409) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:230) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at com.sun.proxy.$Proxy47.getServiceStatus(Unknown Source) ~[na:na]
      	at org.apache.hadoop.ha.protocolPB.HAServiceProtocolClientSideTranslatorPB.getServiceStatus(HAServiceProtocolClientSideTranslatorPB.java:122) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at co.cask.cdap.operations.yarn.YarnInfo.getHAWebURL(YarnInfo.java:116) ~[na:na]
      	at co.cask.cdap.operations.yarn.YarnInfo.getResourceManager(YarnInfo.java:81) ~[na:na]
      	at co.cask.cdap.operations.yarn.YarnInfo.collect(YarnInfo.java:75) ~[na:na]
      	at co.cask.cdap.operations.OperationalStatsService.runOneIteration(OperationalStatsService.java:99) ~[na:na]
      	at com.google.common.util.concurrent.AbstractScheduledService$1$1.run(AbstractScheduledService.java:170) [com.google.guava.guava-13.0.1.jar:na]
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [na:1.7.0_75]
      	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) [na:1.7.0_75]
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) [na:1.7.0_75]
      	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.7.0_75]
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_75]
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_75]
      	at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
      Caused by: java.io.IOException: java.lang.IllegalArgumentException: Failed to specify server's Kerberos principal name
      	at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:688) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_75]
      	at javax.security.auth.Subject.doAs(Subject.java:415) ~[na:1.7.0_75]
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:651) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:739) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client$Connection.access$2900(Client.java:376) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client.getConnection(Client.java:1525) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client.call(Client.java:1448) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	... 16 common frames omitted
      Caused by: java.lang.IllegalArgumentException: Failed to specify server's Kerberos principal name
      	at org.apache.hadoop.security.SaslRpcClient.getServerPrincipal(SaslRpcClient.java:322) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.security.SaslRpcClient.createSaslClient(SaslRpcClient.java:231) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.security.SaslRpcClient.selectSaslClient(SaslRpcClient.java:159) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:396) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:561) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client$Connection.access$1900(Client.java:376) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:731) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:727) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_75]
      	at javax.security.auth.Subject.doAs(Subject.java:415) ~[na:1.7.0_75]
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:726) ~[hadoop-common-2.6.0-cdh5.8.3.jar:na]
      	... 19 common frames omitted
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                nitin Nitin Motgi
                Reporter:
                vinisha Vinisha Shah
              • Votes:
                1 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: