Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-11132

Make Hydrator batch actions formal plugins

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.4.0
    • Component/s: Pipelines
    • Labels:
      None
    • Release Notes:
      Added a 'postaction' Hydrator plugin type that runs at the end of a pipeline run, whether the run succeeded or failed.
    • Rank:
      1|hzz6t3:

      Description

      Batch Hydrator pipelines support adding an email custom action that runs at the end of the workflow. Actions should be implemented as plugins.

      In addition, they should probably not be implemented as custom actions, but should run in the onFinish() method of the mapreduce/spark job. The reason is that many of these actions should occur when the mapreduce fails. A very common use case is to send an email when the pipeline errors for some reason. If they are workflow custom actions, they will only be run if the mapreduce finishes successfully.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ashau Albert Shau
                Reporter:
                ashau Albert Shau
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: