Top "Flume" questions

data.

Rebalancing issue while reading messages in Kafka

I am trying to read messages on Kafka topic, but I am unable to read it. The process gets killed …

message-queue apache-zookeeper flume apache-kafka
What's the difference between Flume and Sqoop?

Both Flume and Sqoop are meant for data movement, then what is the difference between them? Under what condition should …

hadoop sqoop flume
flume vs kafka vs others

May be this question has been asked before but I think it is good to consider it again today given …

scribe flume
How to install and configure apache flume?

Am new in the Apache Flume. I need to install the flume on top of the HDFS cluster environment. I …

flume
Zookeeper keeps getting the WARN: "caught end of stream exception"

I am now using a CDH-5.3.1 cluster with three zookeeper instances located in three ips: 133.0.127.40 n1 133.0.127.42 n2 133.0.127.44 n3 Everything works …

apache-zookeeper flume
How to setup a HTTP Source for testing Flume setup?

I am a newbie to Flume and Hadoop. We are developing a BI module where we can store all the …

java hadoop flume
Using an HDFS Sink and rollInterval in Flume-ng to batch up 90 seconds of log information

I am trying to use Flume-ng to grab 90 seconds of log information and put it into a file in HDFS. …

hdfs flume
Retrieving timestamp from hbase row

Using Hbase API (Get/Put) or HBQL API, is it possible to retrieve timestamp of a particular column?

java hbase flume
loading large files into hdfs using Flume (spool directory)

We copied a 150 mb csv file into flume's spool directory, when it is getting loaded into hdfs, the file was …

flume
Filtering log files in Flume using interceptors

I have an http server writing log files which I then load into HDFS using Flume First I want to …

hadoop flume