Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12130

Send-to-error does not work on derived columns

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.3.0
    • Component/s: Data Prep
    • Labels:
      None
    • Release Notes:
      Fixed an issue that will enable send-to-directive working on derived columns in data prep.
    • Rank:
      1|i00533:

      Description

      Send to error does not work if the column that is being referenced in the condition is a derived column.

      Set of directives that caused the issue.

      parse-as-csv body , true
      drop body
      table-lookup SpendCategory category_lookup
      send-to-error SpendCategory_Category == ""
      

      The following error is thrown by the last directive -

      co.cask.wrangler.api.StepException: [Step 4] - <send-to-error SpendCategory_Category == ""> : co.cask.wrangler.steps.row.SendToError.<init>@1:1 undefined variable SpendCategory_Category
      

        Attachments

          Activity

            People

            • Assignee:
              nitin Nitin Motgi
              Reporter:
              sree Sreevatsan Raman
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: