Uploaded image for project: 'CDAP'
  1. CDAP
  2. CDAP-14303

Dataproc provisioner should be able to provision a single-node cluster on dataproc

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 5.0.0
    • Fix Version/s: 5.1.0
    • Component/s: Cloud Provisioner
    • Labels:
      None
    • Release Notes:
      Fixed a bug that Dataproc provisioner is not able to provision a singlenode cluster.
    • Rank:
      1|i00hjb:

      Description

      Currently, we are not able to create a single-node dataproc cluster on even we specify the number of worker node as 0. This is because dataproc will use the default number of worker nodes if no worker nodes are specified. To create a single node cluster, one additional property needs to be passed through softwareConfig: "dataproc:dataproc.allow.zero.workers": "true" 

        Attachments

          Activity

            People

            • Assignee:
              yaojie Yaojie Feng
              Reporter:
              yaojie Yaojie Feng
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: