Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-3819

Cassandra source does not handles spaces nicely in columns field which requires comma separated list

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.2.0
    • Fix Version/s: 3.3.0
    • Component/s: ETL
    • Labels:
      None
    • Rank:
      1|hzz0nz:

      Description

      Cassandra Batch Source has a column field which requires a user to give comma separated list of all columns in the table.
      col1,col2, col3 is considered as valid but it fails for col1, col2, col3 as it does not trim after splitting on comma.
      Here is the stack trace:

      java.lang.NullPointerException: null
      	at co.cask.plugin.etl.batch.sink.BatchCassandraSink.getColumns(BatchCassandraSink.java:89) ~[na:na]
      	at co.cask.plugin.etl.batch.sink.BatchCassandraSink.transform(BatchCassandraSink.java:78) ~[na:na]
      	at co.cask.plugin.etl.batch.sink.BatchCassandraSink.transform(BatchCassandraSink.java:50) ~[na:na]
      	at co.cask.cdap.etl.batch.ETLMapReduce$SingleOutputSink.write(ETLMapReduce.java:443) ~[classes/:na]
      	at co.cask.cdap.etl.batch.ETLMapReduce$ETLMapper.map(ETLMapReduce.java:361) ~[classes/:na]
      	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145) [hadoop-mapreduce-client-core-2.4.0.2.1.15.0-946.jar:na]
      	at co.cask.cdap.internal.app.runtime.batch.MapperWrapper.run(MapperWrapper.java:102) [co.cask.cdap.cdap-app-fabric-3.2.0-SNAPSHOT.jar:na]
      	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764) [hadoop-mapreduce-client-core-2.4.0.2.1.15.0-946.jar:na]
      	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340) [hadoop-mapreduce-client-core-2.4.0.2.1.15.0-946.jar:na]
      	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) [hadoop-mapreduce-client-app-2.4.0.2.1.15.0-946.jar:na]
      	at java.security.AccessController.doPrivileged(Native Method) [na:1.7.0_75]
      	at javax.security.auth.Subject.doAs(Subject.java:415) [na:1.7.0_75]
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594) [hadoop-common-2.4.0.2.1.15.0-946.jar:na]
      	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163) [hadoop-mapreduce-client-app-2.4.0.2.1.15.0-946.jar:na]
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.7.0_75]
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~[na:1.7.0_75]
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.7.0_75]
      	at java.lang.reflect.Method.invoke(Method.java:606) ~[na:1.7.0_75]
      	at co.cask.cdap.internal.app.runtime.batch.distributed.MapReduceContainerLauncher.launch(MapReduceContainerLauncher.java:91) [launcher.jar:na]
      	at org.apache.hadoop.mapred.YarnChild.main(Unknown Source) [hadoop-mapreduce-client-app-2.4.0.2.1.15.0-946.jar:na]
      

        Attachments

          Activity

            People

            • Assignee:
              rsinha Rohit Sinha
              Reporter:
              rsinha Rohit Sinha
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: