How to install and configure apache flume?

flume
venkat picture venkat · Jan 5, 2013 · Viewed 21.8k times · Source

Am new in the Apache Flume. I need to install the flume on top of the HDFS cluster environment. I did Google it, all are saying using the cloudera distribution but I need to install and configure from the source.

So can anyone please suggest me, where to start and how to customize the flume agent and sink services?

Answer

Kaliyug Antagonist picture Kaliyug Antagonist · Jan 22, 2013

I have just installed Apache Flume 1.3 on Ubuntu.

You need to download the binary zip for your OS, extract it and create a config file which is similar to properties file in Java.

The installation and running of agents is a dumb/easy process, just read this

Related questions

Rebalancing issue while reading messages in Kafka

I am trying to read messages on Kafka topic, but I am unable to read it. The process gets killed after sometime, without reading any messages. Here is the rebalancing error which I get: [2014-03-21 10:10:53,215] ERROR Error processing message, …

Read More
What's the difference between Flume and Sqoop?

Both Flume and Sqoop are meant for data movement, then what is the difference between them? Under what condition should I use Flume or Sqoop?

Read More
flume vs kafka vs others

May be this question has been asked before but I think it is good to consider it again today given that these technologies have matured. We're looking to use one of flume, kafka, scribe, or others to store streaming facebook …

Read More