Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-2972

Can't instantiate dataset in etlworker initialize

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 3.1.0
    • Component/s: CDAP
    • Labels:
      None
    • Rank:
      1|hzyvtz:

      Description

      Realtime sources attempt to instantiate a dataset 'etlrealtimesourcestate' in ETLWorker. This fails because 'hbase-default.xml" cannot be found.

      Stack trace below:
      ERROR c.c.c.i.a.r.ProgramControllerServiceAdapter [puppies91921-1000.dev.continuuity.net] [worker-ETLWorker-0] ProgramControllerServiceAdapter$1:failed(ProgramControllerServiceAdapter.java:73) - Program terminated with exception
      co.cask.cdap.api.data.DatasetInstantiationException: Could not instantiate dataset 'etlrealtimesourcestate'
      at co.cask.cdap.data2.dataset2.DynamicDatasetContext.getDataset(DynamicDatasetContext.java:200)
      at co.cask.cdap.data2.dataset2.DynamicDatasetContext.getDataset(DynamicDatasetContext.java:128)
      at co.cask.cdap.template.etl.realtime.ETLWorker$2.run(ETLWorker.java:103)
      at co.cask.cdap.internal.app.runtime.worker.BasicWorkerContext.execute(BasicWorkerContext.java:191)
      at co.cask.cdap.template.etl.realtime.ETLWorker.initialize(ETLWorker.java:100)
      at co.cask.cdap.template.etl.realtime.ETLWorker.initialize(ETLWorker.java:56)
      at co.cask.cdap.internal.app.runtime.worker.WorkerDriver.initialize(WorkerDriver.java:130)
      at co.cask.cdap.internal.app.runtime.worker.WorkerDriver.startUp(WorkerDriver.java:68)
      at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:47)
      at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.ExceptionInInitializerError: null
      at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:197)
      at co.cask.cdap.data2.util.hbase.HBase98TableUtil.createHTable(HBase98TableUtil.java:57)
      at co.cask.cdap.data2.dataset2.lib.table.hbase.HBaseTable.<init>(HBaseTable.java:97)
      at co.cask.cdap.data2.dataset2.lib.table.hbase.HBaseTableDefinition.getDataset(HBaseTableDefinition.java:62)
      at co.cask.cdap.data2.dataset2.lib.table.hbase.HBaseTableDefinition.getDataset(HBaseTableDefinition.java:36)
      at co.cask.cdap.api.dataset.lib.KeyValueTableDefinition.getDataset(KeyValueTableDefinition.java:63)
      at co.cask.cdap.api.dataset.lib.KeyValueTableDefinition.getDataset(KeyValueTableDefinition.java:34)
      at co.cask.cdap.data2.datafabric.dataset.DatasetType.getDataset(DatasetType.java:54)
      at co.cask.cdap.data2.datafabric.dataset.RemoteDatasetFramework.getDataset(RemoteDatasetFramework.java:223)
      at co.cask.cdap.data2.datafabric.dataset.RemoteDatasetFramework.getDataset(RemoteDatasetFramework.java:197)
      at co.cask.cdap.data2.dataset2.DynamicDatasetContext.getDataset(DynamicDatasetContext.java:174)
      at co.cask.cdap.data2.dataset2.DynamicDatasetContext.getDataset(DynamicDatasetContext.java:128)
      at co.cask.cdap.template.etl.realtime.ETLWorker$2.run(ETLWorker.java:103)
      at co.cask.cdap.internal.app.runtime.worker.BasicWorkerContext.execute(BasicWorkerContext.java:191)
      at co.cask.cdap.template.etl.realtime.ETLWorker.initialize(ETLWorker.java:100)
      at co.cask.cdap.template.etl.realtime.ETLWorker.initialize(ETLWorker.java:56)

      Another error in the logs:
      ERROR o.a.t.i.ServiceMain [puppies111934-1000.dev.continuuity.net] [main] ServiceMain:doMain(ServiceMain.java:103) - Exception thrown from service TwillContainerService [FAILED].
      java.util.concurrent.ExecutionException: java.lang.RuntimeException: hbase-default.xml file seems to be for and old version of HBase (null), this version is 0.98.0.2.1.7.0-784-hadoop2
      at com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:294)
      at com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:281)
      at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
      at org.apache.twill.internal.ServiceMain.doMain(ServiceMain.java:99)
      at org.apache.twill.internal.container.TwillContainerMain.main(TwillContainerMain.java:107)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.apache.twill.launcher.TwillLauncher.main(TwillLauncher.java:88)
      Caused by: java.lang.RuntimeException: hbase-default.xml file seems to be for and old version of HBase (null), this version is 0.98.0.2.1.7.0-784-hadoop2
      at org.apache.hadoop.hbase.HBaseConfiguration.checkDefaultsVersion(HBaseConfiguration.java:70)
      at org.apache.hadoop.hbase.HBaseConfiguration.addHbaseResources(HBaseConfiguration.java:102)
      at org.apache.hadoop.hbase.HBaseConfiguration.create(HBaseConfiguration.java:113)
      at org.apache.hadoop.hbase.client.ConnectionManager.<clinit>(ConnectionManager.java:209)
      at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:197)
      at co.cask.cdap.data2.util.hbase.HBase98TableUtil.createHTable(HBase98TableUtil.java:57)
      at co.cask.cdap.data2.dataset2.lib.table.hbase.HBaseTable.<init>(HBaseTable.java:97)
      at co.cask.cdap.data2.dataset2.lib.table.hbase.HBaseTableDefinition.getDataset(HBaseTableDefinition.java:62)
      at co.cask.cdap.data2.dataset2.lib.table.hbase.HBaseTableDefinition.getDataset(HBaseTableDefinition.java:36)
      at co.cask.cdap.api.dataset.lib.KeyValueTableDefinition.getDataset(KeyValueTableDefinition.java:63)

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              jay Jay Jin
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: