Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-2490

Check if invalid Run Records for Spark and MapReduce are part of run from Workflow child programs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.1.0, 3.0.1
    • Component/s: App Fabric
    • Labels:
      None
    • Rank:
      1|hzyt9r:

      Description

      Since 3.0 we have scheduled thread to update Run Record store for thos with RUNNING state but does not have real program running via check to RuntimeService.

      Howerver, for Run Records for Spark and MapReduce that are part of run from Workflow child programs, the runtime service never return runtime info since those runs are run from Workflow driver.

      Which means that there is no Twill application for the internal MapReduce and Spark child programs run records.

      Need to update the RunRecord checker to account for this situation.

        Attachments

          Activity

            People

            • Assignee:
              hsaputra Henry Saputra
              Reporter:
              hsaputra Henry Saputra
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: