Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12146

Fix BatchXMLFileFilter to read all files when a path and regex is given

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 4.2.0
    • Fix Version/s: None
    • Component/s: Pipeline Plugins
    • Labels:
    • Rank:
      1|i0056n:

      Description

      Right now, the BatchXMLFileFilter accept function does not properly handle the following case:

      path: /tmp/
      regex: .*\.txt

      this will return no files even if there are .txt files in the directory. Right now, we have worked around this by requiring glob syntax when a regex is specified: https://github.com/caskdata/hydrator-plugins/pull/651 but that isn't the root problem.

      1. create unit tests for this class if they do not exist
      2. verify that the class returns no files when given the input
      3. fix the issue by referencing BatchFileFilter.java
      4. verify it now passes unit tests
      5. remove the verification step from https://github.com/caskdata/hydrator-plugins/pull/651

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                russellsavage Russ Savage
                Reporter:
                russellsavage Russ Savage
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: