Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-12284

spark artifacts incorrect in debian distribution

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.3.0, 4.2.1
    • Component/s: CDAP
    • Labels:
      None
    • Release Notes:
      Fixed a packaging bug that caused debian packages to include the wrong cdap-data-pipeline and cdap-data-streams artifacts for spark2.
    • Rank:
      1|i0060v:

      Description

      The spark2 artifacts distributed in the .deb packages are named incorrectly (from the current latest develop build):

      ./opt/cdap/master/artifacts/spark2_2.11/
      ./opt/cdap/master/artifacts/spark2_2.11/cdap-data-pipeline2_2.11-4.3.0-SNAPSHOT.jar
      ./opt/cdap/master/artifacts/spark2_2.11/cdap-data-streams2_2.11-4.3.0-SNAPSHOT.jar
      

      compared with the latest rpms:

      /opt/cdap/master/artifacts/spark2_2.11
      /opt/cdap/master/artifacts/spark2_2.11/cdap-data-pipeline-4.3.0-SNAPSHOT.jar
      /opt/cdap/master/artifacts/spark2_2.11/cdap-data-streams-4.3.0-SNAPSHOT.jar
      

      The cdap-master pom performs a rename: https://github.com/caskdata/cdap/blob/develop/cdap-master/pom.xml#L549. We suspect maybe an ordering issue where the rename happens after the jars have been copied to the debian directory.

        Attachments

          Activity

            People

            • Assignee:
              ashau Albert Shau
              Reporter:
              derek Derek Wood
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: