Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12648

Killing a yarn application should mark the CDAP run record as failed

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.3.0
    • Fix Version/s: 4.3.1
    • Component/s: None
    • Labels:
    • Rank:
      1|i0086n:

      Description

      If we kill a yarn application via YARN commandline, then the CDAP run record should be marked as failed, without needing the run record corrector to come into play.
      This was the behavior in CDAP 4.1, but it is no longer the case in CDAP 4.3. In CDAP 4.3, it will get fixed by the run record corrector.

      Here are logs in CDAP master, ~40 seconds after the yarn application is killed.

      2017-09-20 22:10:02,030 - INFO [zk-client-EventThread:o.a.t.y.YarnTwillController@237] - Failed to access application service.default.HelloWorld.Greeting application_1505943589434_0002 live node in ZK, resort to polling. Failure reason: KeeperErrorCode = NoNode for /instances/00de9ca3-59b4-458f-9878-cec6bd60e534
      2017-09-20 22:10:02,061 - INFO [service.default.HelloWorld.Greeting-application_1505943589434_0002-yarn-poller:o.a.t.y.YarnTwillController$2@302] - Yarn application service.default.HelloWorld.Greeting application_1505943589434_0002 completed. Shutting down controller.
      2017-09-20 22:10:02,093 - INFO [ZKKafkaClientService STOPPING:o.a.t.i.k.c.ZKKafkaClientService@106] - Stopping KafkaClientService
      2017-09-20 22:10:02,096 - INFO [ZKKafkaClientService STOPPING:o.a.t.i.k.c.ZKKafkaClientService@114] - KafkaClientService stopped
      2017-09-20 22:10:02,099 - INFO [ STOPPING:c.c.c.i.a.r.d.AbstractTwillProgramController$2@79] - Twill program terminated: program_run:default.HelloWorld.-SNAPSHOT.service.Greeting.124518e1-9e50-11e7-8dae-42010afa002b, twill runId: 00de9ca3-59b4-458f-9878-cec6bd60e534

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mao Chengfeng Mao
                Reporter:
                ali.anwar Ali Anwar
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: