Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-7984

Two log retention properties in default.xml appear to mean the same thing

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.5.1
    • Fix Version/s: 4.1.0
    • Component/s: Docs
    • Labels:
    • Rank:
      1|hzzrhj:

      Description

      There appear to be two properties that control how long a log file is retained:

       <property>
          <name>kafka.server.log.retention.hours</name>
          <value>24</value>
          <description>
            The number of hours to keep a log file before deleting it
          </description>
        </property>
      
        ...
      
        <property>
          <name>log.retention.duration.days</name>
          <value>7</value>
          <description>
            Duration in days of log file HDFS retention
          </description>
        </property>
      

      Perhaps the first one is the time until a log message expires in Kafka, and the other one is when is expires in HDFS?

      Also, in the code, we don't rely on cdap-default.xml for default value for the second one, but on constants in the code, which we do not practice.

        Attachments

          Activity

            People

            • Assignee:
              John John Jackson
              Reporter:
              andreas Andreas Neumann
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: