Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-6032

minimize master's local storage usage

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.0.0, 4.1.4, 4.3.2
    • Component/s: Master
    • Labels:
    • Release Notes:
      Reduced CDAP Master's local storage usage by deleting temporary directories created for programs as soon as programs are launched on the cluster.
    • Rank:
      1|hzy5vz:

      Description

      Currently when the master process starts a program in Yarn, it temporarily stores the program files into the local user.dir (/var/tmp/cdap) by default. They remain there until the program is stopped, which is not optimal. Since they are no longer needed after the initial start, we should delete them right away. This will reduce the amount of local storage required, especially since /var/tmp is conventionally not a good place for storage.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sagar Sagar Kapare
                Reporter:
                derek Derek Wood
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: