Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-9720

Cask Tracker v1

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.4.0
    • Component/s: Metadata, UI
    • Labels:
      None
    • Release Notes:
      Release Tracker version 1. Data Discovery with metadata, audit and lineage
    • Rank:
      1|hzz75j:

      Description

      Cask Tracker is a CDAP Extension that provides the ability to track data ingested either through Cask Hydrator or Custom CDAP Application and provide input to data governance process on cluster. It includes following data about "the data" :

      • Metadata
        • Includes Tags, Properties, Schema for CDAP Datasets and Programs
        • System and User
      • Data Quality
        • Metadata that include Feed-level and Field-level quality metrics of datasets
      • Data Usage Statistics
        • Usage statistics of dataset and programs.

      Implementation has been broken down into sub-tasks as shown below:

        Attachments

        1. 01_CDAP_global01-2.jpg
          01_CDAP_global01-2.jpg
          138 kB
        2. 01 CDAP Global02.jpg
          01 CDAP Global02.jpg
          79 kB
        3. Integrations_05.jpg
          Integrations_05.jpg
          118 kB
        4. Integrations_06.jpg
          Integrations_06.jpg
          128 kB
        5. Integrations_07.jpg
          Integrations_07.jpg
          119 kB
        6. Integrations_08.jpg
          Integrations_08.jpg
          124 kB
        7. Integrations_09.jpg
          Integrations_09.jpg
          233 kB
        8. Integrations_10.jpg
          Integrations_10.jpg
          118 kB
        9. Integrations_11.jpg
          Integrations_11.jpg
          125 kB
        10. Integrations_12.jpg
          Integrations_12.jpg
          97 kB
        11. Integrations_13.jpg
          Integrations_13.jpg
          83 kB
        12. Integrations_14.jpg
          Integrations_14.jpg
          107 kB
        13. Tracker00.jpg
          Tracker00.jpg
          41 kB
        14. Tracker02.jpg
          Tracker02.jpg
          35 kB
        15. Tracker03.jpg
          Tracker03.jpg
          151 kB
        16. Tracker04.jpg
          Tracker04.jpg
          151 kB
        17. Tracker05.jpg
          Tracker05.jpg
          100 kB
        18. Tracker06.jpg
          Tracker06.jpg
          137 kB
        19. Tracker07.jpg
          Tracker07.jpg
          136 kB
        20. Tracker08.jpg
          Tracker08.jpg
          102 kB
        21. Tracker09.jpg
          Tracker09.jpg
          110 kB
        22. Tracker10-1.jpg
          Tracker10-1.jpg
          57 kB
        23. Tracker11-1.jpg
          Tracker11-1.jpg
          69 kB
        24. Tracker12-2.jpg
          Tracker12-2.jpg
          69 kB
        25. Tracker13-2.jpg
          Tracker13-2.jpg
          80 kB
        26. Tracker14-2.jpg
          Tracker14-2.jpg
          59 kB
        27. Tracker15-1.jpg
          Tracker15-1.jpg
          106 kB
        28. Tracker16.jpg
          Tracker16.jpg
          99 kB

          Issue Links

          1.
          Tracker User Story 1: Navigation Sub-task Resolved Edwin Elia
          2.
          Tracker User Story 2: Metadata Search Sub-task Resolved Edwin Elia
          3.
          Tracker User Story 3: Entity Detail Sub-task Resolved Edwin Elia
          4.
          Tracker User Story 4: Data Lineage Sub-task Resolved Edwin Elia
          5.
          Tracker User Story 5: Audit Logs Sub-task Resolved Edwin Elia
          6.
          Tracker User Story 6a: Dataset Actions Sub-task Resolved Edwin Elia
          7.
          Implement Metadata Filter on Search page Sub-task Resolved Edwin Elia
          8.
          Implement Jump Button Sub-task Resolved Edwin Elia
          9.
          Connect to Backend data for Description, Create Date, Query Found in Search Results Sub-task Resolved Edwin Elia
          10.
          Back to Result Button Revisited Sub-task Resolved Edwin Elia
          11.
          Complex Schema Type design Sub-task Resolved Edwin Elia
          12.
          Remove schema from System Properties List Sub-task Resolved Edwin Elia
          13.
          Publish dataset/stream admin operations and access to Kafka Sub-task Resolved Poorna Chandra
          14.
          Tracker application for surfacing audit logs Sub-task Resolved Russ Savage
          15.
          Define NUX for tracker Sub-task Resolved Sreevatsan Raman
          16.
          Package tracker application in SDK and Distributed packages Sub-task Resolved Chris Gianelloni
          17.
          Start embedded Kafka server to get metadata and lineage update for tracker app Sub-task Resolved Gokul Gunasekaran
          18.
          Tracker UI: Add Query Params to the URLs to make it copy-able Sub-task Resolved Edwin Elia
          19.
          Tracker UI Lineage Diagram: ability to click and open elements in a new tab Sub-task Resolved Edwin Elia
          20.
          Tracker User Story 7: Integrations Sub-task Resolved Edwin Elia
          21.
          Tracker User Story 6b: Dataset Actions, II Sub-task Resolved Edwin Elia
          22.
          Custom Date Picker Sub-task Resolved Edwin Elia
          23.
          Need to expose Optional Configuration settings during Cloudera Navigator setup Sub-task Resolved Edwin Elia
          24.
          Cloudera Navigator: Should be able to edit configurations Sub-task Resolved Edwin Elia
          25.
          Tracker Audit Log: Make Access more user friendly Sub-task Resolved Edwin Elia

            Activity

              People

              • Assignee:
                brady Brady Ajay
                Reporter:
                priyanka Priyanka Nambiar
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: