Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-10216

Spark plugins are not available in the latest build

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Won't Fix
    • Affects Version/s: 3.4.0
    • Fix Version/s: 3.4.0
    • Labels:
      None
    • Rank:
      1|hzzbsn:

      Description

      Spark plugins are packaged with insufficient dependencies in the latest build

      2016-04-25 14:03:17,173 - WARN  [Endure-Service-:c.c.c.i.a.r.a.ArtifactRepository@718] - Could not add system artifact 'spark-plugins-1.3.0-SNAPSHOT.jar' because it is invalid.
      co.cask.cdap.common.InvalidArtifactException: Class could not be found while inspecting artifact for plugins. Please check dependencies are available, and that the correct parent artifact was specified. Error class: class java.lang.NoClassDefFoundError, message: org/apache/spark/api/java/function/Function.
              at co.cask.cdap.internal.app.runtime.artifact.ArtifactInspector.inspectPlugins(ArtifactInspector.java:230) ~[co.cask.cdap.cdap-app-fabric-3.4.0-SNAPSHOT.jar:na]
              at co.cask.cdap.internal.app.runtime.artifact.ArtifactInspector.inspectArtifact(ArtifactInspector.java:121) ~[co.cask.cdap.cdap-app-fabric-3.4.0-SNAPSHOT.jar:na]
              at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.inspectArtifact(ArtifactRepository.java:590) [co.cask.cdap.cdap-app-fabric-3.4.0-SNAPSHOT.jar:na]
              at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.addArtifact(ArtifactRepository.java:478) [co.cask.cdap.cdap-app-fabric-3.4.0-SNAPSHOT.jar:na]
              at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.addSystemArtifact(ArtifactRepository.java:707) [co.cask.cdap.cdap-app-fabric-3.4.0-SNAPSHOT.jar:na]
              at co.cask.cdap.internal.app.runtime.artifact.ArtifactRepository.addSystemArtifacts(ArtifactRepository.java:686) [co.cask.cdap.cdap-app-fabric-3.4.0-SNAPSHOT.jar:na]
              at co.cask.cdap.internal.app.runtime.artifact.SystemArtifactLoader$1$1.doStart(SystemArtifactLoader.java:48) [co.cask.cdap.cdap-app-fabric-3.4.0-SNAPSHOT.jar:na]
              at com.google.common.util.concurrent.AbstractService.start(AbstractService.java:170) [com.google.guava.guava-13.0.1.jar:na]
              at com.google.common.util.concurrent.AbstractService.startAndWait(AbstractService.java:220) [com.google.guava.guava-13.0.1.jar:na]
              at co.cask.cdap.common.service.RetryOnStartFailureService$1.run(RetryOnStartFailureService.java:62) [co.cask.cdap.cdap-common-3.4.0-SNAPSHOT.jar:na]
      Caused by: java.lang.NoClassDefFoundError: org/apache/spark/api/java/function/Function
              at java.lang.Class.getDeclaredFields0(Native Method) ~[na:1.7.0_75]
              at java.lang.Class.privateGetDeclaredFields(Class.java:2499) ~[na:1.7.0_75]
              at java.lang.Class.getDeclaredFields(Class.java:1811) ~[na:1.7.0_75]
              at co.cask.cdap.internal.app.runtime.artifact.ArtifactInspector.getProperties(ArtifactInspector.java:393) ~[co.cask.cdap.cdap-app-fabric-3.4.0-SNAPSHOT.jar:na]
              at co.cask.cdap.internal.app.runtime.artifact.ArtifactInspector.inspectPlugins(ArtifactInspector.java:219) ~[co.cask.cdap.cdap-app-fabric-3.4.0-SNAPSHOT.jar:na]
              ... 9 common frames omitted
      Caused by: java.lang.ClassNotFoundException: org.apache.spark.api.java.function.Function
              at java.net.URLClassLoader$1.run(URLClassLoader.java:366) ~[na:1.7.0_75]
              at java.net.URLClassLoader$1.run(URLClassLoader.java:355) ~[na:1.7.0_75]
              at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_75]
              at java.net.URLClassLoader.findClass(URLClassLoader.java:354) ~[na:1.7.0_75]
              at java.lang.ClassLoader.loadClass(ClassLoader.java:425) ~[na:1.7.0_75]
              at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ~[na:1.7.0_75]
              ... 14 common frames omitted
      

        Attachments

          Activity

            People

            • Assignee:
              terence Terence Yim
              Reporter:
              sree Sreevatsan Raman
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: