Charmed Spark K8s
- Canonical | bundle
| Channel | Revision | Published |
|---|---|---|
| latest/edge | 4 | 06 Aug 2024 |
| 3.4/edge | 4 | 06 Aug 2024 |
juju deploy spark-k8s-bundle --channel edge
Deploy Kubernetes operators easily with Juju, the Universal Operator Lifecycle Manager. Need a Kubernetes cluster? Install MicroK8s to create a full CNCF-certified Kubernetes system in under 60 seconds.
Platform:
External metastore
By default, Apache Kyuubi uses an embedded database to manage the metadata of persistent relational entities. However, this database is limited to a single unit and is not persisted should the pod be rescheduled.
In a production environment, we recommend deploying an external metastore shared by all Charmed Apache Kyuubi K8s units, that can be backed up and restored as well.
Enable external metastore
The Charmed Apache Kyuubi K8s charm provides a metastore-db integration through the postgresql_client interface.
To use it, deploy a Charmed PostgreSQL K8s charm:
juju deploy postgresql-k8s metastore --channel 14/stable --trust
Then, integrate it with the Charmed Apache Kyuubi K8s charm on the metastore-db relation:
juju integrate kyuubi-k8s:metastore-db metastore
Once the two charms are settled in active/idle status, the metastore is configured and operational.
Disable external metastore
To stop using the external metastore, remove the integration:
juju remove-relation kyuubi-k8s:metastore-db postgresql-k8s