Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-1250

Use Hadoop configuration files bundled with Explore Service

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.6.0
    • Fix Version/s: 2.6.1
    • Component/s: Explore
    • Labels:
      None
    • Rank:
      1|hzylrz:

      Description

      YARN containers run through Cloudera SCM Agent do not have complete mapred-site.xml in the classpath. Hence Explore container will not be able to launch mapreduce tasks for Hive queries. This can be overcome by serializing Hadoop config files on Master and transferring it to Explore container during its launch. Even though Hadoop config files are bundled with Explore Service, they were not being used as /etc/hadoop/conf appeared first in classpath.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                poorna Poorna Chandra
                Reporter:
                poorna Poorna Chandra
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: