Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-11216

TPFS sinks should have an option to delete partitions older than some amount of time after they are done

    Details

    • Release Notes:
      Added a configuration property to Hydrator TPFS sinks that will clean data that is older than a threshold amount of time.
    • Rank:
      1|hzz7br:

      Description

      One common use case is somebody is dumping snapshots of a database into a tpfs. But they don't want the tpfs to grow infintely, but only want to keep x days of data in the dataset. This setting would allow them to cap how many days of data are in it by deleting older partitions after the pipeline run.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ashau Albert Shau
                Reporter:
                ashau Albert Shau
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: