Apache Flume Twitter

Learn about configurations >

• channel_capacity | string

  Default: 1000

  The maximum number of events stored in the channel.

• channel_transaction_capacity | string

  Default: 100

  The maximum number of events the channel will take from a source or give to a sink per transaction.

• event_dir | string

  Default: flume-twitter

  The HDFS subdirectory under /user/flume where events will be stored.

• resources_mirror | string

  URL from which to fetch resources (e.g., Hadoop binaries) instead of Launchpad.

• twitter_access_token | string

  OAuth Access token from your Twitter developer account

• twitter_access_token_secret | string

  OAuth Access token secret from your Twitter developer account

• twitter_consumer_key | string

  OAuth Consumer key from your Twitter developer account

• twitter_consumer_secret | string

  OAth Consumer secret from your Twitter developer account

• twitter_max_batch_duration | int

  Default: 1000

  Maximum number of milliseconds to wait before closing a batch

• twitter_max_batch_size | int

  Default: 1000

  Maximum number of twitter messages to put in a single batch

• twitter_source | string

  Default: org.apache.flume.source.twitter.TwitterSource

  The application to use for this Flume source. Deafult to TwitterSource bundled with Flume.