Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-10088

Pipeline execution fails when writing to the Table sink having single field in schema.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.4.2
    • Fix Version/s: None
    • Component/s: Pipelines
    • Labels:
    • Sprint:
      App Eng Sprint 3, App Eng Sprint 4
    • Release Notes:
      Table sink fails when the schema contains only the row key field.
    • Rank:
      1|hzy3yn:

      Description

      Attached pipeline execution fails with the exception

       at org.apache.hadoop.mapred.LocalJobRunnerWithFix$Job.run(LocalJobRunnerWithFix.java:524) ~[classes/:na]
      java.lang.IllegalArgumentException: Put must have at least one value
              at com.google.common.base.Preconditions.checkArgument(Preconditions.java:92) ~[guava-13.0.1.jar:na]
              at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.put(AbstractTable.java:107) ~[classes/:na]
              at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.write(AbstractTable.java:176) ~[classes/:na]
              at co.cask.cdap.data2.dataset2.lib.table.AbstractTable.write(AbstractTable.java:55) ~[classes/:na]
      

      The reason for this failure is that in the pipeline, we are using 'testTable' sink which has only one field named 'body', which is used as table row key. Put operation on this table fails because there is no column value to be inserted.

      Pipeline validation should fail in this case.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                shashank Shashank
                Reporter:
                sagar Sagar Kapare
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: