Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12639

Data Prep breaks on Oracle ROWID columns

    XMLWordPrintableJSON

    Details

    • Rank:
      1|i0084n:

      Description

      When you try to import data from an Oracle table with a ROWID column, you get the following exception:

      co.cask.wrangler.dataset.workspace.WorkspaceException: oracle.sql.ROWID
                      at co.cask.wrangler.dataset.workspace.WorkspaceDataset.getData(WorkspaceDataset.java:294) ~[na:na]
                      at co.cask.wrangler.service.directive.DirectivesService.fromWorkspace(DirectivesService.java:929) ~[expanded.2.0.0.38f6b5b4-98c1-450d-badc-e62e010c7f5a.jar/:na]
                      at co.cask.wrangler.service.directive.DirectivesService.executeDirectives(DirectivesService.java:953) ~[expanded.2.0.0.38f6b5b4-98c1-450d-badc-e62e010c7f5a.jar/:na]
                      at co.cask.wrangler.service.directive.DirectivesService.execute(DirectivesService.java:487) ~[expanded.2.0.0.38f6b5b4-98c1-450d-badc-e62e010c7f5a.jar/:na]
                      at co.cask.wrangler.service.directive.DirectivesService00b1e4d131d4dd7369b61b38c6576c5c.execute(Unknown Source) [na:na]
                      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_73]
                      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_73]
                      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_73]
                      at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_73]
                      at co.cask.http.HttpMethodInfo.invoke(HttpMethodInfo.java:80) [co.cask.http.netty-http-0.16.0.jar:na]
                      at co.cask.http.HttpDispatcher.messageReceived(HttpDispatcher.java:38) [co.cask.http.netty-http-0.16.0.jar:na]
                      at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [io.netty.netty-3.6.6.Final.jar:na]
                      at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [io.netty.netty-3.6.6.Final.jar:na]
                      at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) [io.netty.netty-3.6.6.Final.jar:na]
                      at org.jboss.netty.handler.execution.ChannelUpstreamEventRunnable.doRun(ChannelUpstreamEventRunnable.java:43) [io.netty.netty-3.6.6.Final.jar:na]
                      at org.jboss.netty.handler.execution.ChannelEventRunnable.run(ChannelEventRunnable.java:67) [io.netty.netty-3.6.6.Final.jar:na]
                      at org.jboss.netty.handler.execution.OrderedMemoryAwareThreadPoolExecutor$ChildExecutor.run(OrderedMemoryAwareThreadPoolExecutor.java:314) [io.netty.netty-3.6.6.Final.jar:na]
                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_73]
                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_73]
                      at java.lang.Thread.run(Thread.java:745) [na:1.8.0_73]
      

      The exception is with CDAP 4.2, but we have fixed have not made any fixes around this recently, so it should fail with 4.3 as well.

      Related link: https://community.oracle.com/thread/503918?start=0

      This should work both in data prep itself, as well as when you ingest data or create pipeline (so in database source).

      To reproduce, create a table in oracle with a column of type ROWID, and try to import it into Data Prep.

        Attachments

          Activity

            People

            • Assignee:
              vinisha Vinisha Shah
              Reporter:
              bhooshan Bhooshan Mogal
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: