Apache Flume Twitter
- By Big Data Charmers
- Big Data
Channel | Revision | Published | Runs on |
---|---|---|---|
latest/stable | 3 | 11 Nov 2020 | |
latest/edge | 3 | 11 Nov 2020 |
juju deploy apache-flume-twitter
Deploy universal operators easily with Juju, the Universal Operator Lifecycle Manager.
Platform:
-
channel_capacity | string
Default: 1000
The maximum number of events stored in the channel.
-
channel_transaction_capacity | string
Default: 100
The maximum number of events the channel will take from a source or give to a sink per transaction.
-
event_dir | string
Default: flume-twitter
The HDFS subdirectory under /user/flume where events will be stored.
-
resources_mirror | string
URL from which to fetch resources (e.g., Hadoop binaries) instead of Launchpad.
-
twitter_access_token | string
OAuth Access token from your Twitter developer account
-
twitter_access_token_secret | string
OAuth Access token secret from your Twitter developer account
-
twitter_consumer_key | string
OAuth Consumer key from your Twitter developer account
-
twitter_consumer_secret | string
OAth Consumer secret from your Twitter developer account
-
twitter_max_batch_duration | int
Default: 1000
Maximum number of milliseconds to wait before closing a batch
-
twitter_max_batch_size | int
Default: 1000
Maximum number of twitter messages to put in a single batch
-
twitter_source | string
Default: org.apache.flume.source.twitter.TwitterSource
The application to use for this Flume source. Deafult to TwitterSource bundled with Flume.