Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-7243

Under certain conditions, local datasets generated by a Workflow are not cleaned up

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.4.0
    • Fix Version/s: 4.3.1
    • Component/s: CDAP, Datasets, Workflow
    • Labels:
    • Release Notes:
      Added mechanism to clean up local dataset if the workflows creating them are killed
    • Rank:
      1|hzzlof:

      Description

      The local datasets created during the Workflow run are cleaned up in the shutDown method of the WorkflowDriver. However if shutdown method itself did not get call sometime, for example the container is killed, then the local datasets are not deleted. One possible way to address this is a service that will periodically cleanup the local datasets.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ali.anwar Ali Anwar
                Reporter:
                sagar Sagar Kapare
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: