Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-13876

GCP Plugins need a way to store the Service Account details as a blob of text

    XMLWordPrintableJSON

    Details

    • Rank:
      1|i00f67:

      Description

      Using the GCP plugins as they exist today presents a chicken-and-egg problem for pipelines designed to use the Dataproc profile. The GCP plugins take a path as an input string and require that you have the Service Account JSON file on each node of the cluster, but the nodes don't exist before the job starts therefore the pipeline fails.

      Need a way to store the service account as a macro so that it can be provided at runtime or added as part of the profile definition.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                bhooshan Bhooshan Mogal
                Reporter:
                thajdari Tony Hajdari
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: