Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-10897

Improve FileBatch Source hydrator plugin to accept HDFS file path without explicit host

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Pipelines
    • Labels:
    • Rank:
      1|hzzolj:

      Description

      Currently in File batch source, for the path config, user has to explicitly specify the hostname for hdfs

      hdfs://node/{path}

      we should allow making the hostname optional and deduce that automatically. so the following would work

      hdfs:///{path}

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              shankar Shankar Selvam
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: