Charmed Spark K8s
- Canonical Data Platform | bundle
| Channel | Revision | Published |
|---|---|---|
| latest/edge | 4 | 06 Aug 2024 |
| 3.4/edge | 4 | 06 Aug 2024 |
juju deploy spark-k8s-bundle --channel edge
Deploy Kubernetes operators easily with Juju, the Universal Operator Lifecycle Manager. Need a Kubernetes cluster? Install MicroK8s to create a full CNCF-certified Kubernetes system in under 60 seconds.
Platform:
Support self-signed certificates in Spark Client snap
The Spark Client snap offers the possibility to submit jobs to a Kubernetes cluster with the spark-submit command.
In some use cases, there is the need to use self-signed certificates to trust self-hosted services such as Ceph or many others. For this reason we had a feature in the Spark Client snap to add certificates in the Java truststore inside the snap and so being able to validate the desired service.
Add certificate
In order to add a new certificate you can use the following command:
spark-client.import-certificate <CERTIFICATE_ALIAS> <CERTIFICATE_PATH>
where <CERTIFICATE_ALIAS> is the alias associated to the certificate and the <CERTIFICATE_PATH> is the path of the desired certificate. Please be sure that the path of the certificate is accessible by the Spark Client snap.
For more information, see the blog post on how to deploy Charmed Spark, with MAAS, Kubernetes and Ceph with self-signed certificates.