Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-11808

Master logs is spammed when there are a lot of streams

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Streams
    • Labels:
      None
    • Rank:
      1|i00387:

      Description

      If you have 300 streams in your CDAP instance, then there is a HUGE log message each time you create an additional stream (probably also when deleted). The following is a trimmed example:

      Stream leader requirement has changed to [PartitionReplica{partition=stream:perf2_0.stream_0, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_1, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_10, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_11, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_12, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_13, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_14, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_15, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_16, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_17, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_18, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_19, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_2, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_20, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_21, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_22, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_23, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_24, replica=0}, PartitionReplica{partition=stream:perf2_0.stream_25, replica=0}, 
      ...
      

        Attachments

          Activity

            People

            • Assignee:
              terence Terence Yim
              Reporter:
              ali.anwar Ali Anwar
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: