Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-7473

program.log file missing from container log directory

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.6.0, 3.5.1
    • Fix Version/s: 4.0.0, 3.6.1, 3.5.2
    • Component/s: Log
    • Labels:
    • Release Notes:
      Fix logback-container.xml to work on clusters with multiple log directories configured for YARN.
    • Rank:
      1|hzznb3:

      Description

      The yarn-site.xml parameter 'yarn.nodemanager.log-dirs' can be a comma-separated list of paths (not according to the description in yarn-default.xml, but according to https://www.cloudera.com/documentation/enterprise/5-6-x/topics/cdh_sg_yarn_security.html).
      On a cluster with such a configuration, I am not seeing the program.log file in the container log directory shown from the YARN UI. I do see stdout/stderr files there. I recall a gc.log file also.

      In the container's data directory, the launch_container.sh file has an export of LOG_DIRS, which is also a comma-separated list of files, which seems to be the same as the value of 'yarn.nodemanager.local-dirs', but each element appended with the application and container ID of the container.

      I believe this is causing some issue with the logback-container.xml configured.
      https://github.com/caskdata/cdap/blob/c287db0e9694dae8a5841808862ac815900d50a8/cdap-distributions/src/etc/cdap/conf.dist/logback-container.xml#L48

      No program.log file was found under any of the directories specified as LOG_DIRS.
      The program.log file was found in a directory that was literally the value of 'yarn.nodemanager.log-dirs' (directories can have commas in them).

        Attachments

          Activity

            People

            • Assignee:
              ali.anwar Ali Anwar
              Reporter:
              ali.anwar Ali Anwar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: