Bigdata Dev Sqoop2

juju deploy bigdata-dev-sqoop2
Show information
You will need Juju 2.9 to be able to run this command. Learn how to upgrade to Juju 2.9.
Channel Version Revision Published Runs on
latest/stable 1 1 18 Mar 2021
Ubuntu 14.04

Platform:

Ubuntu
14.04

About

Transfer bulk data between Apache Hadoop and structured datastores. Read more


Relevant links


Discuss this charm

Share your thoughts on this charm with the community on discourse.

Join the discussion

Overview

Apache Sqoop is a tool designed for efficiently transferring data betweeen structured,semi-structured and unstructured data sources. Relational databases are examples of structured data sources with well defined schema for the data they store. Cassandra, Hbase are examples of semi-structured data sources and HDFS is an example of unstructured data source that Sqoop can support.

Usage

This charm is intended to be deployed in addition to one of the big data bundles. For example:

juju deploy hadoop-processing

Note: The above assumes Juju 2.0 or greater. If using an earlier version +of Juju, the syntax is juju-quickstart hadoop-processing.

Once this step is complete, deploy and relate sqoop:

juju deploy sqoop2
juju add-relation sqoop2 jdk
juju add-relation sqoop2 plugin
juju expose sqoop2

You can now ssh into the instance using: juju ssh sqoop2/0 and execute sqoop commands.

Verify the deployment

Status and Smoke Test

The services provide extended status reporting to indicate when they are ready:

juju status

This is particularly useful when combined with watch to track the on-going progress of the deployment:

watch -n 0.5 juju status

The message for each unit will provide information about that unit's state. Once they all indicate that they are ready, you can perform a "smoke test" to verify that Sqoop is working as expected using the built-in smoke-test action:

juju run-action sqoop2/0 smoke-test

Note: The above assumes Juju 2.0 or greater. If using an earlier version of Juju, the syntax is juju action do hbase/0 smoke-test.

After a few seconds or so, you can check the results of the smoke test:

juju show-action-status

Note: The above assumes Juju 2.0 or greater. If using an earlier version +of Juju, the syntax is juju action status.

You will see status: completed if the smoke test was successful, or status: failed if it was not. You can get more information on why it failed via:

juju show-action-output <action-id>

Note: The above assumes Juju 2.0 or greater. If using an earlier version +of Juju, the syntax is juju action fetch <action-id>.

Contact Information

Help