How can i get all group list with kafka0.10.x

apache-kafka apache-zookeeper kafka-consumer-api apache-kafka-connect
wxmimperio picture wxmimperio · Jan 16, 2017 · Viewed 18.5k times · Source

when i use kafka0.8.x，i can get all group list with zookeeper by path /consumers/group_id, because offsets will commit to zookeeper in 0.8.x.

But in version of 0.10.x, offsets commited to kafka broker like a path /brokers/topics/__consumer_offsets and path /consumers in zookeeper has nothing. so I can not get consumer group list by zookeeper.

Answer

amethystic picture amethystic · Jan 16, 2017

To list all consumer groups across all topics:

 bin/kafka-consumer-groups.sh --bootstrap-server broker1:9092 --list

To view offsets for the consumer group:

 bin/kafka-consumer-groups.sh --bootstrap-server broker1:9092 --describe --group test-consumer-group

See Managing Consumer Groups for detailed information.

Related questions

Kafka : How to connect kafka-console-consumer to fetch remote broker topic content?

I have setup a kafka zookeeper and 3 brokers on one machine on ec2 with ports 9092..9094 and am trying to consume the topic content from another machine. The ports 2181 (zk), 9092, 9093 and 9094 (servers) are open to the consumer machine. I can even …

Read More
INFO Closed socket connection for client /127.0.0.1:48452 which had sessionid 0x15698f5ac360001 (org.apache.zookeeper.server.NIOServerCnxn)

I installed fresh zookeeper & kafka both. I started them both. Then when I want to see the list of topics with this command: bin/kafka-topics.sh --list --zookeeper localhost 2181 It gives me the socket connection closed. Here is the …

Read More
Kafka suddenly reset the consumer Offset

I'm working with Kafka 0.8 & zookeeper 3.3.5. Actually, we have a dozen of topic we are consuming without any issue. Recently, we started to feed and consume a new topic that has a weird behavior. The consumed offset was suddenly reset. …

Read More