Charmed Spark K8s
- Canonical | bundle
| Channel | Revision | Published |
|---|---|---|
| latest/edge | 4 | 06 Aug 2024 |
| 3.4/edge | 4 | 06 Aug 2024 |
juju deploy spark-k8s-bundle --channel edge
Deploy Kubernetes operators easily with Juju, the Universal Operator Lifecycle Manager. Need a Kubernetes cluster? Install MicroK8s to create a full CNCF-certified Kubernetes system in under 60 seconds.
Platform:
-
driver-pod-template | string
Define K8s driver pod from a file accessible to the `spark-submit` process. Ex.: "s3a://bucket/template.yml". Is equivalent to the following Spark configuration: spark.kubernetes.driver.podTemplateFile=<driver-pod-template>
-
enable-dynamic-allocation | boolean
Enable dynamic allocation of pods for autoscaling Spark jobs. Is equivalent to the following Spark configurations: spark.dynamicAllocation.enabled=true spark.dynamicAllocation.shuffleTracking.enabled=true spark.dynamicAllocation.minExecutors=1
-
executor-pod-template | string
Define K8s executor pods from a file accessible to the `spark-submit` process. Ex.: "s3a://bucket/template.yml". Is equivalent to the following Spark configuration: spark.kubernetes.executor.podTemplateFile=<executor-pod-template>