Charmed Spark K8s

Learn about configurations >

• enable-dynamic-allocation | boolean

  Enable dynamic allocation of pods for Spark jobs.

• expose-external | string

  Default: false

  The mode in which the service should be exposed externally. Valid values are false, nodeport and loadbalancer.

• iceberg-catalog-name | string

  Default: iceberg

  The name of the catalog that has Iceberg capabilities.

• k8s-node-selectors | string

  Comma separated label:value selectors for K8s pods Ex.: "<label1>:<value1>,<label2>:<value2>". Is equivalent to the following Spark configuration: spark.kubernetes.node.selector.<label1>=<value1> spark.kubernetes.node.selector.<label2>=<value2> The desired configuration will be applied for both driver and executor pods.

• loadbalancer-extra-annotations | string

  Default: {}

  Optional extra annotations to be supplied to the load balancer service.

• namespace | string

  The namespace to be used by driver to create executor pods. If not configured, the model namespace will be used.

• pause-after-unit-refresh | string

  Default: first

  Wait for manual confirmation to resume refresh after these units refresh Allowed values: "all", "first", "none"

• profile | string

  Default: production

  Profile representing the scope of the deployment, and used to enable high-level customization of system configurations, resource checks/allocation, warning levels, etc. Allowed values are: "production", "staging" and "testing"

• service-account | string

  Default: kyuubi-spark-engine

  The service account to be used by driver to create executor pods.

• system-users | secret

  Configure the system user 'admin' and it's password. This needs to be a Juju secret URI pointing to a secret that contains the following content: `admin: <password>`. If this config option is not provided, the charm will generate a random password for the admin user.

• tls-client-private-key | secret

  A Juju secret URI of a secret containing the private key for client-to-server TLS certificates. This needs to be a Juju secret URI pointing to a secret that has the content { private-key: <key> }, where <key> is the key to be used by the charm to generate Certificate Signing Request (CSR). If this config option is not provided, the charm will generate a new private key and use it instead.