Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-8000

Log file cleanup should not delete all expired records in a single short transaction

    XMLWordPrintableJSON

    Details

    • Release Notes:
      To avoid transaction timeouts, log cleanup is now done in configurable batches (controlled by the property log.cleanup.max.num.files) instead of a single short transaction.
    • Rank:
      1|hzzrnb:

      Description

      Especially if log cleanup has not run (sucessfully) for a while, there can be many entries, and the transaction can time out and fail. Not only that but next time cleanup is run it will fail again because there will be even more records to delete, so the system can never recover from this.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vinisha Vinisha Shah
                Reporter:
                andreas Andreas Neumann
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: