Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-10021

Make DB plugins work with more jdbc drivers

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.1
    • Component/s: Pipeline Plugins, Pipelines
    • Labels:
      None
    • Release Notes:
      Added a 'enableAutoCommit' property to Hydrator database plugins that will enable use of jdbc drivers, like the Hive jdbc driver, that do not allow commits.
    • Rank:
      1|hzz6rz:

      Description

      The Hive jdbc driver throws an exception on calls to commit(). The DB input formats call commit() because it sets autocommit to false. I'm guessing it does that because not all databases support autocommit.

      In any case, we need to make some changes to the input format if we want to support the hive jdbc driver. One option is to add a config setting for whether to turn on autocommit. Then if its on, we don't explicitly call commit.

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              ashau Albert Shau
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: