Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-3944

Multiple PartitionConsumer consumers

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
    • Sprint:
      ETL MVP CDAP 3.3
    • Release Notes:
      PartitionConsumer has support for concurrency, as well as a limit and filter on read.
    • Rank:
      1|hzz1gf:

      Description

      Multiple partition consumers:
      CDAP should support concurrency for multiple partition consumers operating on the same Dataset. Each Consumer would be able to mark the partitions the workflow operates on as 'in progress' and have the ability to roll back to 'unprocessed' should the workflow fail or timeout.

      More details to follow

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ali.anwar Ali Anwar
                Reporter:
                priyanka Priyanka Nambiar
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: