|latest/stable||3||3||18 Mar 2021|
juju deploy tengu-team-automate-spark-jobs
You will need Juju 2.9 to be able to run this command. Learn how to upgrade to Juju 2.9.
Discuss this bundle
Share your thoughts on this charm with the community on discourse.
Automate Spark Jobs
The bundle contains the following services:
- Spark is running with 2 spark jobs
- => SparkUI can be accessed on
- Hadoop is running and has a relationship with Zeppelin. In this way Zeppelin can use HDFS to store data.
- The hadoop service consists of:
- Hadoop namenode
- Hadoop resourcemanager
- 1 hadoop slave
- Zeppelin Notebook has a relation with spark and Hadoop. There is 1 Notebook available that will retrieve data from your hdfs and makes it possible to query the data. The notebook is called
- => Zeppelin can be accessed on
- this bundle can be deployed in your juju environment by cloning this repo and clone the required charms that are not avilable on the juju charm store. to deploy this bundle use:
juju deploy cs:~tengu-team/bundle/automate-spark-jobs-3