Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-16062

Dynamic spark plugin ScalaSparkProgram validation does not work because spark classes are absent in the service

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 6.3.0
    • Component/s: Pipelines
    • Rank:
      1|i00s93:

      Description

      Dynamic spark plugin ScalaSparkProgram validation does not work because spark classes are absent in the service. This should be fixed by not loading "sparkprogram" plugin types in pipeline spec generator. 

       https://github.com/cdapio/cdap/blob/release/6.1/cdap-app-templates/cdap-etl/cdap-etl-core/src/main/java/io/cdap/cdap/etl/spec/PipelineSpecGenerator.java#L278

        Attachments

          Activity

            People

            • Assignee:
              vinisha Vinisha Shah
              Reporter:
              vinisha Vinisha Shah
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: