Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-13830

gradient boosted and random tree regression fails

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: None
    • Fix Version/s: 5.0.0
    • Component/s: None
    • Labels:
      None
    • Rank:
      1|i00ex3:

      Description

      Both of these models fail to train with:

      2018-07-20 09:37:24,281 - ERROR [Thread-1172:c.c.m.m.ModelManagerServiceHandler@426] - Error training model 1c87621f359f4c099d36eca2d399b6d8 in experiment re2.
      java.lang.NoClassDefFoundError: Ljavax/servlet/ReadListener;
      	at java.lang.Class.getDeclaredFields0(Native Method) ~[na:1.8.0_151-google-v7]
      	at java.lang.Class.privateGetDeclaredFields(Class.java:2585) ~[na:1.8.0_151-google-v7]
      	at java.lang.Class.getDeclaredFields(Class.java:1918) ~[na:1.8.0_151-google-v7]
      	at org.apache.spark.util.SizeEstimator$.getClassInfo(SizeEstimator.scala:330) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.util.SizeEstimator$.getClassInfo(SizeEstimator.scala:324) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.util.SizeEstimator$.visitSingleObject(SizeEstimator.scala:222) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.util.SizeEstimator$.org$apache$spark$util$SizeEstimator$$estimate(SizeEstimator.scala:201) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.util.SizeEstimator$.estimate(SizeEstimator.scala:69) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.util.collection.SizeTracker$class.takeSample(SizeTracker.scala:78) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.util.collection.SizeTracker$class.afterUpdate(SizeTracker.scala:70) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.util.collection.SizeTrackingVector.$plus$eq(SizeTrackingVector.scala:31) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.storage.memory.MemoryStore.putIteratorAsValues(MemoryStore.scala:216) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.storage.BlockManager$$anonfun$doPutIterator$1.apply(BlockManager.scala:957) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.storage.BlockManager$$anonfun$doPutIterator$1.apply(BlockManager.scala:948) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.storage.BlockManager.doPut(BlockManager.scala:888) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.storage.BlockManager.doPutIterator(BlockManager.scala:948) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.storage.BlockManager.putIterator(BlockManager.scala:726) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.storage.BlockManager.putSingle(BlockManager.scala:1233) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.broadcast.TorrentBroadcast.writeBlocks(TorrentBroadcast.scala:122) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.broadcast.TorrentBroadcast.<init>(TorrentBroadcast.scala:88) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.broadcast.TorrentBroadcastFactory.newBroadcast(TorrentBroadcastFactory.scala:34) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.broadcast.BroadcastManager.newBroadcast(BroadcastManager.scala:56) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.SparkContext.broadcast(SparkContext.scala:1411) ~[na:na]
      	at org.apache.spark.ml.regression.GBTRegressionModel.transformImpl(GBTRegressor.scala:219) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at org.apache.spark.ml.PredictionModel.transform(Predictor.scala:183) ~[co.cask.cdap.spark-assembly-2.1.0.jar:na]
      	at co.cask.mmds.modeler.train.ModelTrainer.train(ModelTrainer.java:143) ~[mmds-model-1.0.0-SNAPSHOT.jar:na]
      	at co.cask.mmds.manager.ModelManagerServiceHandler.lambda$trainModel$16(ModelManagerServiceHandler.java:417) ~[unpacked/:na]
      	at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_151-google-v7]
      Caused by: java.lang.ClassNotFoundException: javax.servlet.ReadListener
      	at java.net.URLClassLoader.findClass(URLClassLoader.java:381) ~[na:1.8.0_151-google-v7]
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[na:1.8.0_151-google-v7]
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[na:1.8.0_151-google-v7]
      	... 28 common frames omitted
      

      This used to work at some point during this release cycle.

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              ashau Albert Shau
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: