Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-14584

Service provider interface for metadata store, index and search

    Details

    • Type: New Feature
    • Status: IN PROGRESS
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 6.0.0
    • Fix Version/s: None
    • Component/s: Datasets, Metadata
    • Labels:
      None
    • Rank:
      1|i00j5r:

      Attachments

        Issue Links

        1.
        Remove support for Metadata for Streams, Views and Flows Sub-task Resolved Andreas Neumann
        2.
        All metadata change should be published via TMS or RPC call to Metadata service Sub-task Resolved Andreas Neumann
        3.
        Remove Metadata upgrade Sub-task Resolved Andreas Neumann
        4.
        Remove V1 metadata APIs Sub-task Resolved Andreas Neumann
        5.
        UI should use the Metadata API introduced in 5.0 Sub-task Resolved Edwin Elia
        6.
        MetadataStore should have methods that combine properties and tags Sub-task Resolved Andreas Neumann
        7.
        Remove MetadataAdmin class Sub-task Resolved Andreas Neumann
        8.
        Reintroduce convenience searchMetadata() methods that were deprecated and removed Sub-task Resolved Andreas Neumann
        9.
        Define the Metadata SPI Sub-task Resolved Andreas Neumann
        10.
        Implement SPI with current MetadataDataset Sub-task Resolved Andreas Neumann
        11.
        Implement an Elasticsearch storage provider Sub-task Resolved Andreas Neumann
        12.
        Revisit existing Metadata APIs and classes Sub-task Open Sagar Kapare
        13.
        Migrate Metadata REST APIs to new classes Sub-task Resolved Andreas Neumann
        14.
        Find a way to unit-test Elasticsearch storage provider Sub-task Resolved Andreas Neumann
        15.
        Define sound semantics for cursors, offset, and total Sub-task Resolved Andreas Neumann
        16.
        Revisit cursors, offset and totalResults Sub-task Resolved Andreas Neumann
        17.
        Create Metadata SPI tests Sub-task Resolved Andreas Neumann
        18.
        Rebase existing MetadataStore on SPI Sub-task Resolved Andreas Neumann
        19.
        Move SPI definition to separate SPI module Sub-task Resolved Andreas Neumann
        20.
        Add tests for non-CDAP entities Sub-task Resolved Andreas Neumann
        21.
        Implement and test search by TTL Sub-task Resolved Andreas Neumann
        22.
        Implement and test search by schema Sub-task Resolved Andreas Neumann
        23.
        Implement and test search and sort by creation time Sub-task Resolved Andreas Neumann
        24.
        Implement and test search by description Sub-task Resolved Andreas Neumann
        25.
        Evaluate Elasticsearch search_after for more efficient pagination Sub-task Open Sagar Kapare
        26.
        Ensure correctness of Elasticsearch page size calculation Sub-task Resolved Andreas Neumann
        27.
        Define the semantics of a batch of mutations with duplicate entity ids Sub-task Resolved Andreas Neumann
        28.
        Refactor to share DatasetMetadataStorage search code with DefaultMetadataStorage Sub-task Resolved Andreas Neumann
        29.
        Introduce a way to search metadata by property names Sub-task Resolved Andreas Neumann
        30.
        Dataset-based MetadataStorage should not depend on dataset framework Sub-task Resolved Andreas Neumann
        31.
        Make preview work with Elasticsearch metadata Sub-task Resolved Andreas Neumann
        32.
        Mark all metadata APIs as @Beta Sub-task Resolved Andreas Neumann
        33.
        Remove old DefaultMetadataStore Sub-task Resolved Andreas Neumann
        34.
        Test handling of whitespace and tokenization Sub-task Open Sagar Kapare
        35.
        Make Metadata storage provider configurable through cdap-site.xml Sub-task Resolved Andreas Neumann
        36.
        Find a better way to determine allowed combinations of search parameters Sub-task Open Andreas Neumann
        37.
        Necessary changes to MetadataClient Sub-task Open Sagar Kapare
        38.
        Add test for ElasticSearch scroll timeout Sub-task Resolved Andreas Neumann
        39.
        MetadataStorage needs to be closed wherever it is used Sub-task Resolved Andreas Neumann
        40.
        Cursors should encapsulate all the information required to replay a query Sub-task Resolved Andreas Neumann
        41.
        Handle concurrency in MetadataStorage Sub-task Resolved Andreas Neumann
        42.
        Tag the Elasticsearch index with the CDAP version Sub-task Resolved Andreas Neumann
        43.
        Emit metrics from metadata storage Sub-task Resolved Yaojie Feng

          Activity

            People

            • Assignee:
              andreas Andreas Neumann
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: