Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-3173

Upgrading to 3.1.0 crashes HBase co-processor

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.1.0
    • Component/s: CDAP
    • Labels:
      None
    • Rank:
      1|hzywyv:

      Description

      After running upgrade tool to upgrade from 3.0.3 to 3.1.0, HBase co-processor crashes with the following exceptions -

      15/07/30 22:50:38 INFO regionserver.RegionCoprocessorHost: Loaded coprocessor co.cask.cdap.data2.transaction.queue.coprocessor.hbase98.HBaseQueueRegionObserver from HTD of cdap.system.sharded.queue.PurchaseHistory.PurchaseFlow successfully.
      Exception in thread "DefaultTransactionStateCache STARTING" java.lang.NoClassDefFoundError: it/unimi/dsi/fastutil/longs/LongArrayList
              at co.cask.tephra.snapshot.SnapshotCodecV2.decodeInProgress(SnapshotCodecV2.java:72)
              at co.cask.tephra.snapshot.DefaultSnapshotCodec.decode(DefaultSnapshotCodec.java:82)
              at co.cask.tephra.snapshot.SnapshotCodecProvider.decode(SnapshotCodecProvider.java:129)
              at co.cask.tephra.persist.HDFSTransactionStateStorage.readSnapshotInputStream(HDFSTransactionStateStorage.java:166)
              at co.cask.tephra.persist.HDFSTransactionStateStorage.getLatestSnapshot(HDFSTransactionStateStorage.java:146)
              at co.cask.tephra.coprocessor.TransactionStateCache.refreshState(TransactionStateCache.java:152)
              at co.cask.tephra.coprocessor.TransactionStateCache.startUp(TransactionStateCache.java:71)
              at com.google.common.util.concurrent.AbstractIdleService$1$1.run(AbstractIdleService.java:43)
              at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.ClassNotFoundException: it.unimi.dsi.fastutil.longs.LongArrayList
              at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
              at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
              at java.security.AccessController.doPrivileged(Native Method)
              at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
              at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
              at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
              at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
              at org.apache.hadoop.hbase.util.CoprocessorClassLoader.loadClass(CoprocessorClassLoader.java:299)
              ... 9 more
      
      15/07/30 22:50:40 INFO regionserver.HRegionServer: Finished post open deploy task for cdap.system.queue.config,,1438293843097.db7b6a63ce3ac4f59d3c77d762eab2ba.
      15/07/30 22:50:42 ERROR coprocessor.CoprocessorHost: The coprocessor co.cask.cdap.data2.transaction.coprocessor.hbase98.DefaultTransactionProcessor threw an unexpected exception
      java.lang.NullPointerException
              at com.google.common.primitives.Longs.toArray(Longs.java:427)
              at co.cask.tephra.distributed.TransactionConverterUtils.unwrap(TransactionConverterUtils.java:40)
              at co.cask.tephra.TransactionCodec.decode(TransactionCodec.java:50)
              at co.cask.tephra.hbase98.coprocessor.TransactionProcessor.getFromOperation(TransactionProcessor.java:294)
              at co.cask.tephra.hbase98.coprocessor.TransactionProcessor.preScannerOpen(TransactionProcessor.java:202)
              at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preScannerOpen(RegionCoprocessorHost.java:1602)
              at org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3087)
              at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28861)
              at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008)
              at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92)
              at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160)
              at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38)
              at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110)
              at java.lang.Thread.run(Thread.java:745)
      15/07/30 22:50:42 FATAL regionserver.HRegionServer: ABORTING region server upgrade3032343-1000.dev.continuuity.net,60020,1438293486924: The coprocessor co.cask.cdap.data2.transaction.coprocessor.hbase98.DefaultTransactionProcessor threw an unexpected exception
      java.lang.NullPointerException
              at com.google.common.primitives.Longs.toArray(Longs.java:427)
              at co.cask.tephra.distributed.TransactionConverterUtils.unwrap(TransactionConverterUtils.java:40)
              at co.cask.tephra.TransactionCodec.decode(TransactionCodec.java:50)
              at co.cask.tephra.hbase98.coprocessor.TransactionProcessor.getFromOperation(TransactionProcessor.java:294)
              at co.cask.tephra.hbase98.coprocessor.TransactionProcessor.preScannerOpen(TransactionProcessor.java:202)
              at org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.preScannerOpen(RegionCoprocessorHost.java:1602)
              at org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3087)
              at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:28861)
              at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2008)
              at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:92)
              at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:160)
              at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:38)
              at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:110)
              at java.lang.Thread.run(Thread.java:745)
      15/07/30 22:50:42 FATAL regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: [co.cask.cdap.data2.increment.hbase98.IncrementHandler, co.cask.cdap.data2.transaction.queue.coprocessor.hbase98.HBaseQueueRegionObserver, org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint, co.cask.cdap.data2.transaction.queue.coprocessor.hbase98.DequeueScanObserver, co.cask.cdap.data2.transaction.coprocessor.hbase98.DefaultTransactionProcessor]
      15/07/30 22:50:42 INFO regionserver.HRegionServer: STOPPED: The coprocessor co.cask.cdap.data2.transaction.coprocessor.hbase98.DefaultTransactionProcessor threw an unexpected exception
      

        Attachments

          Activity

            People

            • Assignee:
              gary Gary Helmling
              Reporter:
              poorna Poorna Chandra
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: