Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-5534

There is no test case, example, or documentation for a custom PartitionAcceptor

    Details

    • Rank:
      1|hzzadz:

      Description

      I can't find anything in the documentation. The Javadocs are also very sparse:

        /**
         * Return value, determining what to do with a Partition.
         */
        enum Return {
          ACCEPT, SKIP, STOP
        }
      

      We should explain here what exactly the individual values mean. For example:

      • does SKIP mean that it's dropped from the working set (skipped forever) or does it mean is skipped this time but remains in the working set so it is attempted again next time?
      • Is there a way to drop a partition from the working set without processing it?
      • what does STOP mean?

      Also, I think we need at least an example of a custom PartitionAcceptor, if not an example of a custom PartitionConsumer that overrides some of the non-final methods.

      Definitely we need a test case that tests all different scenarios. A search for usages of SKIP did not yield any results in test.

        Attachments

          Activity

            People

            • Assignee:
              ali.anwar Ali Anwar
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: