Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-14040

Program logs endpoint is inconsistent with program run logs endpoint

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.1.0
    • Component/s: Log, MMDS
    • Labels:
      None
    • Release Notes:
      Added format and suppress query params to the program logs endpoint to match the program run logs endpoint
    • Rank:
      1|i00g47:

      Description

      Today we have a fixed format for getting run logs from backend in JSON format. A sample,

       

      {
        "log": {
          "timestamp": 1533665000244,
          "logLevel": "INFO",
          "threadName": "Thread-643",
          "className": "co.cask.mmds.modeler.train.ModelTrainer",
          "simpleClassName": "ModelTrainer",
          "lineNumber": 100,
          "message": "Generating features for training and test data.",
          "stackTrace": "",
          "loggerName": "co.cask.mmds.modeler.train.ModelTrainer",
          "mdc": {
            ".runId": "f61b4502-99b6-11e8-a426-acde48001122",
            ".origin": "program",
            ".namespaceId": "default",
            ".sparkId": "ModelManagerService",
            "MDC:experiment": "Experiment1",
            "MDC:model": "45dfc9effb874eebb5569434d1165060",
            ".applicationId": "ModelManagementApp"
          },
          "isNativeMethod": false
        },
        "offset": "-10000.1533665000244"
      }
      

       

      Howwever for model training logs we seem to be getting a different format for the logs in json format. A sample response:

      {
        "log": "2018-08-07 11:03:20,244 - INFO  [Thread-643:c.c.m.m.t.ModelTrainer@100] - Generating features for training and test data.\n",
        "offset": "-10000.1533665000244"
      }

      we should have similar format so that we can use the log viewer in UI to show the logs.

       

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              ajai Ajai Narayan
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: