Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-2750

Too many open files

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.1
    • Component/s: CDAP
    • Labels:
      None
    • Rank:
      1|hzyujr:

      Description

      Using DBTableToHBaseTable adapter example from cdap-guides caused 'java.lang.OutOfMemoryError: PermGen space'. This is a known issue.

      Increasing MxPermSize from 128m to 512m and running the same example adapter caused a 'too many files open' error. This came about after running a few simple tests, then leaving the system alone for a while (hours).

      lsof on the cdap standalone process showed over 7700 open files (list attached).

      Over 6000 files are named: /opt/cdap/cdap-sdk-3.0.0/data/tmp/<13-digit-number><number>/<13-digit-number><number>/lib/*

      Of those there are 134 duplicates of 46 jar files split between the file, and a '(deleted)' version of that same file.

        Attachments

        1. cdap.log
          256 kB
        2. jars
          1 kB
        3. lsof-cdap.lst
          1.18 MB

          Issue Links

            Activity

              People

              • Assignee:
                bhooshan Bhooshan Mogal
                Reporter:
                dave Dave Finnegan (Inactive)
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: