Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-11063

Unify Database source and Teradata source

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.3.0
    • Fix Version/s: 3.4.0
    • Component/s: Pipeline Plugins, Pipelines
    • Labels:
      None
    • Rank:
      1|hzz67z:

      Description

      Currently, we have a dedicated TeradataSource that is used because some databases don't support the LIMIT clause (which is not SQL Standard anyway) that the default DBInputFormat uses. The TeradataSource is not restricted to Teradata and can be used for all DBs including both - those that support the LIMIT clause that those that don't.

      We should either:

      1. Keep both DatabaseSource and TeradataSource, but rename TeradataSource to DataDrivenDatabaseSource; or
      2. Do away completely with DatabaseSource, and just use the current TeradataSource as the DatabaseSource.

      We may prefer 1. either for backward compatibility or because the existing DatabaseSource may be simpler to configure. But in either case, we should make sure that there's no code duplication.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                nitin Nitin Motgi
                Reporter:
                bhooshan Bhooshan Mogal
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: