Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-13033

Number of open files for JobQueue datasets increases over time on standalone

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 4.3.2, 4.3.1, 4.3.0
    • Fix Version/s: 5.0.0, 4.3.3
    • Component/s: CDAP
    • Labels:
      None
    • Release Notes:
      Fixed a bug in TMS that prevented from correctly consuming multiple events emitted in the same transaction.
    • Rank:
      1|i00aef:

      Description

      In 4.3.3 a large number of file handles are being used for job queue dataset in level db and it increases over time. To reproduce this issue, just start standalone and list all open file handles for Standalone main program.

      lsof | grep <pid>
      

      Here is the snapshot of file handles over time (taken every 5 mins) with 4.3.3

      for file in `ls lsof_no_pipelines*`; do echo $file; grep sst $file | wc -l; done
      lsof_no_pipelines_1515096663
           916
      lsof_no_pipelines_1515096964
          1958
      lsof_no_pipelines_1515097265
          2040
      lsof_no_pipelines_1515097566
          1996
      lsof_no_pipelines_1515097867
          1988
      lsof_no_pipelines_1515098168
          2022
      lsof_no_pipelines_1515098469
          2052
      lsof_no_pipelines_1515098770
          2078
      lsof_no_pipelines_1515099071
          2146
      lsof_no_pipelines_1515099372
          2140
      lsof_no_pipelines_1515099673
          2290
      lsof_no_pipelines_1515099974
          1998
      lsof_no_pipelines_1515100275
          2062
      lsof_no_pipelines_1515100576
          2040
      lsof_no_pipelines_1515100878
          2064
      

      Attaching some open files

        Attachments

          Activity

            People

            • Assignee:
              terence Terence Yim
              Reporter:
              sree Sreevatsan Raman
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: