Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12701

Failure to deploy pipelines with condition on Ambari clusters

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.3.2
    • Component/s: Pipelines
    • Labels:
      None
    • Release Notes:
      Packaging the SLF4J Log with the plugins rather than depending on the system settings.
    • Rank:
      1|i008in:

      Description

      Hadoop configs commons.logging property uses
      apache commons log4j

      File: /usr/hdp/2.6.2.0-205/hadoop/conf/commons-logging.properties
      Config: #org.apache.commons.logging.Log=org.apache.commons.logging.impl.Log4JLogger

      This causes the deployment to fail

      2017-10-05 09:34:45,564 - ERROR [appfabric-executor-2:c.c.c.g.h.AppLifecycleHttpHandler$1@413] - Deploy failure
      java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
              at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:294) ~[com.google.guava.guava-13.0.1.jar:na]
              at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:267) ~[com.google.guava.guava-13.0.1.jar:na]
              at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:96) ~[com.google.guava.guava-13.0.1.jar:na]
              at co.cask.cdap.internal.app.deploy.pipeline.LocalArtifactLoaderStage.process(LocalArtifactLoaderStage.java:109) ~[na:na]
              at co.cask.cdap.internal.app.deploy.pipeline.LocalArtifactLoaderStage.process(LocalArtifactLoaderStage.java:55) ~[na:na]
              at co.cask.cdap.pipeline.AbstractStage.process(AbstractStage.java:52) ~[na:na]
              at co.cask.cdap.internal.pipeline.SynchronousPipeline.execute(SynchronousPipeline.java:55) ~[na:na]
              at co.cask.cdap.internal.app.deploy.LocalApplicationManager.deploy(LocalApplicationManager.java:137) ~[na:na]
              at co.cask.cdap.internal.app.services.ApplicationLifecycleService.deployApp(ApplicationLifecycleService.java:686) ~[na:na]
              at co.cask.cdap.internal.app.services.ApplicationLifecycleService.deployApp(ApplicationLifecycleService.java:488) ~[na:na]
              at co.cask.cdap.gateway.handlers.AppLifecycleHttpHandler$1.onFinish(AppLifecycleHttpHandler.java:389) ~[na:na]
              at co.cask.cdap.common.http.AbstractBodyConsumer.finished(AbstractBodyConsumer.java:65) [na:na]
              at co.cask.http.HttpMethodInfo.bodyConsumerFinish(HttpMethodInfo.java:149) [co.cask.http.netty-http-0.16.0.jar:na]
              at co.cask.http.HttpMethodInfo.chunk(HttpMethodInfo.java:108) [co.cask.http.netty-http-0.16.0.jar:na]
              at co.cask.http.HttpDispatcher.messageReceived(HttpDispatcher.java:40) [co.cask.http.netty-http-0.16.0.jar:na]
              at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [io.netty.netty-3.6.6.Final.jar:na]
              at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [io.netty.netty-3.6.6.Final.jar:na]
              at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) [io.netty.netty-3.6.6.Final.jar:na]
              at org.jboss.netty.handler.execution.ChannelUpstreamEventRunnable.doRun(ChannelUpstreamEventRunnable.java:43) [io.netty.netty-3.6.6.Final.jar:na]
              at org.jboss.netty.handler.execution.ChannelEventRunnable.run(ChannelEventRunnable.java:67) [io.netty.netty-3.6.6.Final.jar:na]
              at org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor$ChildExecutor.run(OrderedMemoryAwareThreadPoolExecutor.java:314) [io.netty.netty-3.6.6.Final.jar:na]
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_144]
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_144]
              at java.lang.Thread.run(Thread.java:748) [na:1.8.0_144]
      Caused by: java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
              at com.google.common.base.Throwables.propagate(Throwables.java:160) ~[com.google.guava.guava-13.0.1.jar:na]
              at co.cask.cdap.common.lang.InstantiatorFactory$2.create(InstantiatorFactory.java:104) ~[na:na]
              at co.cask.cdap.internal.app.runtime.plugin.PluginInstantiator.newInstance(PluginInstantiator.java:355) ~[na:na]
              at co.cask.cdap.internal.app.runtime.plugin.PluginInstantiator.newInstance(PluginInstantiator.java:244) ~[na:na]
              at co.cask.cdap.internal.app.runtime.plugin.PluginInstantiator.newInstance(PluginInstantiator.java:204) ~[na:na]
              at co.cask.cdap.internal.app.DefaultPluginConfigurer.usePlugin(DefaultPluginConfigurer.java:107) ~[na:na]
              at co.cask.cdap.etl.spec.PipelineSpecGenerator.configurePlugin(PipelineSpecGenerator.java:324) ~[na:na]
              at co.cask.cdap.etl.spec.PipelineSpecGenerator.configureStage(PipelineSpecGenerator.java:257) ~[na:na]
              at co.cask.cdap.etl.spec.PipelineSpecGenerator.configureStages(PipelineSpecGenerator.java:147) ~[na:na]
              at co.cask.cdap.etl.batch.BatchPipelineSpecGenerator.generateSpec(BatchPipelineSpecGenerator.java:56) ~[na:na]
              at co.cask.cdap.etl.batch.BatchPipelineSpecGenerator.generateSpec(BatchPipelineSpecGenerator.java:34) ~[na:na]
              at co.cask.cdap.datapipeline.DataPipelineApp.configure(DataPipelineApp.java:80) ~[na:na]
              at co.cask.cdap.api.app.AbstractApplication.configure(AbstractApplication.java:65) ~[na:na]
              at co.cask.cdap.internal.app.deploy.InMemoryConfigurator.getSpecJson(InMemoryConfigurator.java:161) ~[na:na]
              at co.cask.cdap.internal.app.deploy.InMemoryConfigurator.createResponse(InMemoryConfigurator.java:127) ~[na:na]
              at co.cask.cdap.internal.app.deploy.InMemoryConfigurator.config(InMemoryConfigurator.java:117) ~[na:na]
              at co.cask.cdap.internal.app.deploy.pipeline.LocalArtifactLoaderStage.process(LocalArtifactLoaderStage.java:108) ~[na:na]
              ... 20 common frames omitted
      Caused by: java.lang.reflect.InvocationTargetException: null
              at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[na:1.8.0_144]
              at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[na:1.8.0_144]
              at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[na:1.8.0_144]
              at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[na:1.8.0_144]
              at co.cask.cdap.common.lang.InstantiatorFactory$2.create(InstantiatorFactory.java:102) ~[na:na]
              ... 35 common frames omitted
      Caused by: org.apache.commons.logging.LogConfigurationException: User-specified log class 'org.apache.commons.logging.impl.Log4JLogger' cannot be found or is not useable.
              at org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:804) ~[commons-logging-1.2.jar:1.7.5]
              at org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:541) ~[commons-logging-1.2.jar:1.7.5]
              at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:292) ~[commons-logging-1.2.jar:1.7.5]
              at org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:269) ~[commons-logging-1.2.jar:1.7.5]
              at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:655) ~[org.slf4j.jcl-over-slf4j-1.7.5.jar:1.7.5]
              at org.apache.commons.jexl3.internal.Engine.getUberspect(Engine.java:178) ~[na:na]
              at org.apache.commons.jexl3.internal.Engine.<init>(Engine.java:143) ~[na:na]
              at org.apache.commons.jexl3.JexlBuilder.create(JexlBuilder.java:351) ~[na:na]
              at co.cask.plugins.EL.<init>(EL.java:48) ~[na:na]
              at co.cask.plugins.Conditional.<init>(Conditional.java:71) ~[na:na]
              ... 40 common frames omitted
      

        Attachments

          Activity

            People

            • Assignee:
              sagar Sagar Kapare
              Reporter:
              sree Sreevatsan Raman
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: