Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-13362

If a schema mismatch occurs, the error message is not informative enough

    XMLWordPrintableJSON

    Details

    • Rank:
      1|i00cbr:

      Description

      My pipeline had a schema mismatch (due to a different plugin bug). The error message i get is this:

       04/25/2018 0:41:16ERRORco.cask.cdap.etl.batch.mapreduce.ETLMapReduce#481Failed to execute pipeline stage 'CDAP Table Dataset' with the error: java.lang.Short cannot be cast to java.lang.Integer. Please review your pipeline configuration and check the system logs for more details.java.lang.ClassCastException: java.lang.Short cannot be cast to java.lang.Integer
      	at co.cask.cdap.format.RecordPutTransformer.setField(RecordPutTransformer.java:104) ~[na:na]
      	at co.cask.cdap.format.RecordPutTransformer.toPut(RecordPutTransformer.java:83) ~[na:na]
      	at co.cask.hydrator.plugin.batch.sink.TableSink.transform(TableSink.java:108) ~[1524613270677-0/:na]
      	at co.cask.hydrator.plugin.batch.sink.TableSink.transform(TableSink.java:43) ~[1524613270677-0/:na]
      	at 
      ...

      This message is quite useless because it does not have the field name whose schema did not match. I was lucky to only a single field of type int so I could spot it. But in general, this does not help the user spot and fix the problem. 

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: