Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-16762

Set default microbatch interval for streaming pipelines = 1 minute

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 6.3.0
    • Fix Version/s: 6.3.0
    • Component/s: CDAP
    • Labels:
      None
    • Rank:
      1|i00wzj:

      Description

      The default batch interval, 10 seconds, is too short for streaming pipelines that write to GCS, BigQuery as writing to these sinks can be slow. We should bump up the default batch interval to 1 minute.

        Attachments

          Activity

            People

            • Assignee:
              rmstar Prashant Jaikumar
              Reporter:
              rmstar Prashant Jaikumar
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: