Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-4573

Documentation needed on how to use MapReduce in an app

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 3.3.0, 3.2.2
    • Fix Version/s: 3.3.0
    • Component/s: Docs, MapReduce
    • Labels:
    • Rank:
      1|hzz4yv:

      Description

      We have docs on how to implement a MapReduce, but we do not document any of the following:

      • avoid using org.apache.hadoop.mapred (old APIs)
      • what needs to be included and excluded in the pom.xml to use MapReduce
      • what versions of what dependencies are needed

      The pom.xml from the MapReduce examples also does not make it clear, it inherits from the parent pom, which few people will read. The pom.xml in the MapReduce guide has it, but it explains nowhere what needs to be in the pom, and why it is important to exclude some transitive dependencies.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                andreas Andreas Neumann
                Reporter:
                andreas Andreas Neumann
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: