Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.0.0
    • Component/s: CDAP
    • Labels:
      None
    • Release Notes:
      Hide
      Implemented feature to support Reports and Dashboard.
      Dashboard provides operational view for pipeline and CDAP application programs, provides realtime status of program runs and future schedules.

      Reports is a tool for administrators to take a historical look at their applications
      program runs, and performance, optionally filtered by criteria such as program type or final run status.
      Show
      Implemented feature to support Reports and Dashboard. Dashboard provides operational view for pipeline and CDAP application programs, provides realtime status of program runs and future schedules. Reports is a tool for administrators to take a historical look at their applications program runs, and performance, optionally filtered by criteria such as program type or final run status.
    • Rank:
      1|i00b27:

      Description

      Provide API and data required to generate interactive Dashboard view within a shorter time range and comprehensive reports within a longer time range.

      Wiki - https://wiki.cask.co/display/CE/Operations+Dashboard+Backend+Design

        Attachments

          Issue Links

          1.
          Allow applications(system extensions) in system namespace Sub-task Resolved Shankar Selvam
          2.
          Report Generation App Sub-task Resolved Chengfeng Mao
          3.
          Persist program status TMS messages in files Sub-task Resolved Shankar Selvam
          4.
          Add Artifact and Princpal information to Runrecord Sub-task Resolved Shankar Selvam
          5.
          Output report files as avro instead of json text Sub-task Resolved Shankar Selvam
          6.
          Configure the number of partitions before writing the report files Sub-task Open Shankar Selvam
          7.
          Cache for reports reading Sub-task Open Shankar Selvam
          8.
          Support authentication header in report HTTP handler and allow sharing reports Sub-task Resolved Shankar Selvam
          9.
          Add missing fields in report record Sub-task Resolved Chengfeng Mao
          10.
          Make report generation app compatible with Spark1 Sub-task In Progress Shankar Selvam
          11.
          Operations dashboard HTTP handler Sub-task Resolved Chengfeng Mao
          12.
          Sort reports by creation time when listing Sub-task Resolved Chengfeng Mao
          13.
          Convert report details to JSON object Sub-task Resolved Chengfeng Mao
          14.
          Support getting scheduled program runs at future time in dashboard handler Sub-task Resolved Shankar Selvam
          15.
          Improve ops dashboard lookup performance Sub-task Resolved Shankar Selvam
          16.
          Move ops dashboard handler into report generation app Sub-task Resolved Shankar Selvam
          17.
          Add number of errors, number of warnings metrics in report Sub-task Open Shankar Selvam
          18.
          Use sync points in avro to efficiently read the last record in avro file Sub-task In Progress Shankar Selvam
          19.
          Package reporting app as part of system artifacts Sub-task Resolved Shankar Selvam
          20.
          Add Suspend and resume time when program is suspended/resumed Sub-task Resolved Shankar Selvam
          21.
          Add endpoints for saving and deleting reports Sub-task Resolved Chengfeng Mao
          22.
          Add report summary in the report status response Sub-task Resolved Chengfeng Mao
          23.
          Expired report should get cleaned up and not returned in the listing report endpoint Sub-task Open Shankar Selvam
          24.
          Add fields in ReportGenerationRequest and ReportGenerationInfo Sub-task Resolved Chengfeng Mao
          25.
          Skip pre-5.0 run records from processing Sub-task Resolved Shankar Selvam
          26.
          Translate program status in the backend to the status displayed at the frontend Sub-task Resolved Edwin Elia
          27.
          Integration test for report generation app Sub-task Resolved Shankar Selvam
          28.
          Upgrade test for report generation app Sub-task Resolved Shankar Selvam
          29.
          Configure CDAP user to run Reporting System App and owner of all files written by Reporting app Sub-task Open Albert Shau
          30.
          Documentation for reporting and operations dashboard Sub-task Resolved Shankar Selvam

            Activity

              People

              • Assignee:
                shankar Shankar Selvam
                Reporter:
                shankar Shankar Selvam
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: