Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-10688

Hydrator error not clear - java.lang.IllegalStateException

    XMLWordPrintableJSON

    Details

    • Rank:
      1|hzzm67:

      Description

      Using a Stream source with a misconfigured format (text instead of csv), with parsed output schema, the pipeline fails with an error of:

      java.lang.IllegalStateException: MapReduce execution failure: job-id : job_local2048395063_0003uber-mode : falsemap-progress : 0.0reduce-progress : 0.0cleanup-progress : 1.0setup-progress : 1.0runstate : FAILEDstart-time : 0user-name : sepidehayanipriority : NORMALscheduling-info : NAnum-used-slots0num-reserved-slots0used-mem0reserved-mem0needed-mem0
      at com.google.common.base.Preconditions.checkState(Preconditions.java:176) ~[com.google.guava.guava-13.0.1.jar:na]
      at co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService.run(MapReduceRuntimeService.java:363) ~[co.cask.cdap.cdap-app-fabric-3.5.1.jar:na]
      at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:52) ~[com.google.guava.guava-13.0.1.jar:na]
      at co.cask.cdap.internal.app.runtime.batch.MapReduceRuntimeService$1$1.run(MapReduceRuntimeService.java:422) [co.cask.cdap.cdap-app-fabric-3.5.1.jar:na]
      at java.lang.Thread.run(Thread.java:745) [na:1.8.0_60]

      This was a simple case of failing to specify csv to parse the input from the stream and ending up with a message that was difficult to diagnose.

      If possible, it would be better if the error would indicate that the output schema did not match the input and format spec some how.

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              dave Dave Finnegan (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: