Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-5279

Deprecate the beforeSubmit and onFinish methods of the MapReduce and Spark

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.3.0
    • Fix Version/s: 3.5.0
    • Component/s: MapReduce
    • Labels:
      None
    • Release Notes:
      Hide
      Some changes to the API:
      1. AbstractMapReduce or AbstractSpark now implements ProgramLifeCycle
      2. AbstractMapReduce or AbstractSpark will have final initialize(context) method.
      3. AbstractMapReduce or AbstractSpark will have protected initialize() method default implementation of which will call beforeSubmit
      4. User program will override the no arg initialize method.
      5. Driver will call both versions of the initialize method.
      Show
      Some changes to the API: 1. AbstractMapReduce or AbstractSpark now implements ProgramLifeCycle 2. AbstractMapReduce or AbstractSpark will have final initialize(context) method. 3. AbstractMapReduce or AbstractSpark will have protected initialize() method default implementation of which will call beforeSubmit 4. User program will override the no arg initialize method. 5. Driver will call both versions of the initialize method.
    • Rank:
      1|hzz8tj:

      Description

      MapReduce and Spark API have specialized beforeSubmit and onFinish methods. To make it consistent with other programs, they should ideally extend from ProgramLifeCycle interface in order to have standard initialize() and destroy() methods.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                yaojie Yaojie Feng
                Reporter:
                sagar Sagar Kapare
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: