Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-7477

MapReduce should run the DatasetOutputCommitters in a separate transaction

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.5.0
    • Fix Version/s: 4.0.0
    • Component/s: Datasets, MapReduce
    • Labels:
      None
    • Release Notes:
      Fixes an issue in MapReduce that caused skipping the destroy() method if committing any of the dataset outputs failed.
    • Rank:
      1|hzznbz:

      Description

      If they are run in the same tx as the program's destroy() method, then any failure of destroy() will rollback that tx. That is not the intention.

        Attachments

          Activity

            People

            • Assignee:
              andreas Andreas Neumann
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: