Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-15393

Cannot create streaming pipelines without setting checkpoint directory

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 6.0.0
    • Component/s: Standalone
    • Labels:
    • Rank:
      1|i00o3r:

      Description

      Streaming pipeline with file source ansdf_v2-cdap-data-pipeline.jsond file sink fails with following error.

      2019-05-15 18:23:27,151 - ERROR [appfabric-executor-0:i.c.c.g.h.AppLifecycleHttpHandler$1@414] - Deploy failure
      java.lang.IllegalArgumentException: Checkpoint directory '' is not a valid Path: Can not create a Path from an empty string
              at io.cdap.cdap.datastreams.DataStreamsPipelineSpecGenerator.generateSpec(DataStreamsPipelineSpecGenerator.java:62) ~[na:na]
              at io.cdap.cdap.datastreams.DataStreamsApp.configure(DataStreamsApp.java:44) ~[na:na]
              at io.cdap.cdap.api.app.AbstractApplication.configure(AbstractApplication.java:59) ~[na:na]
              at io.cdap.cdap.internal.app.deploy.InMemoryConfigurator.createResponse(InMemoryConfigurator.java:155) ~[na:na]
              at io.cdap.cdap.internal.app.deploy.InMemoryConfigurator.config(InMemoryConfigurator.java:116) ~[na:na]
              at io.cdap.cdap.internal.app.deploy.pipeline.LocalArtifactLoaderStage.process(LocalArtifactLoaderStage.java:110) ~[na:na]
              at io.cdap.cdap.internal.app.deploy.pipeline.LocalArtifactLoaderStage.process(LocalArtifactLoaderStage.java:57) ~[na:na]
              at io.cdap.cdap.pipeline.AbstractStage.process(AbstractStage.java:53) ~[na:na]
              at io.cdap.cdap.internal.pipeline.SynchronousPipeline.execute(SynchronousPipeline.java:57) ~[na:na]
              at io.cdap.cdap.internal.app.deploy.LocalApplicationManager.deploy(LocalApplicationManager.java:132) ~[na:na]
              at io.cdap.cdap.internal.app.services.ApplicationLifecycleService.deployApp(ApplicationLifecycleService.java:668) ~[na:na]
              at io.cdap.cdap.internal.app.services.ApplicationLifecycleService.deployApp(ApplicationLifecycleService.java:471) ~[na:na]
              at io.cdap.cdap.gateway.handlers.AppLifecycleHttpHandler$1.onFinish(AppLifecycleHttpHandler.java:390) ~[na:na]
              at io.cdap.cdap.common.http.AbstractBodyConsumer.finished(AbstractBodyConsumer.java:65) [na:na]
              at io.cdap.http.internal.HttpMethodInfo.bodyConsumerFinish(HttpMethodInfo.java:151) [io.cdap.http.netty-http-1.2.0.jar:na]
              at io.cdap.http.internal.HttpMethodInfo.chunk(HttpMethodInfo.java:112) [io.cdap.http.netty-http-1.2.0.jar:na]
              at io.cdap.http.internal.HttpDispatcher.channelRead(HttpDispatcher.java:47) [io.cdap.http.netty-http-1.2.0.jar:na]
              at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) [io.netty.netty-all-4.1.16.Final.jar:4.1.16.Final]
              at io.netty.channel.AbstractChannelHandlerContext.access$600(AbstractChannelHandlerContext.java:38) [io.netty.netty-all-4.1.16.Final.jar:4.1.16.Final]
              at io.netty.channel.AbstractChannelHandlerContext$7.run(AbstractChannelHandlerContext.java:353) [io.netty.netty-all-4.1.16.Final.jar:4.1.16.Final]
              at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) [io.netty.netty-all-4.1.16.Final.jar:4.1.16.Final]
              at io.cdap.http.internal.NonStickyEventExecutorGroup$NonStickyOrderedEventExecutor.run(NonStickyEventExecutorGroup.java:254) [io.cdap.http.netty-http-1.2.0.jar:na]
              at io.netty.util.concurrent.UnorderedThreadPoolEventExecutor$NonNotifyRunnable.run(UnorderedThreadPoolEventExecutor.java:277) [io.netty.netty-all-4.1.16.Final.jar:4.1.16.Final]
              at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_202]
              at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_202]
              at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_202]
              at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_202]
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_202]
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_202]
              at java.lang.Thread.run(Thread.java:748) [na:1.8.0_202]
      Caused by: java.lang.IllegalArgumentException: Can not create a Path from an empty string
              at org.apache.hadoop.fs.Path.checkPathArg(Path.java:163) ~[org.apache.hadoop.hadoop-common-2.8.0.jar:na]
              at org.apache.hadoop.fs.Path.<init>(Path.java:175) ~[org.apache.hadoop.hadoop-common-2.8.0.jar:na]
              at io.cdap.cdap.datastreams.DataStreamsPipelineSpecGenerator.generateSpec(DataStreamsPipelineSpecGenerator.java:59) ~[na:na]
              ... 29 common frames omitted 

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              vinisha Vinisha Shah
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: