Top "Kafka-consumer-api" questions

Use for questions related to the Apache Kafka consumer API

Is it possible to create a kafka topic with dynamic partition count?

I am using kafka to stream the events of page visits by the website users to an analytics service. Each …

apache-kafka partitioning kafka-consumer-api
How does kafka consumer auto commit work?

I am reading this one: Automatic Commit The easiest way to commit offsets is to allow the consumer to do …

java apache-kafka offset kafka-consumer-api autocommit
Kafka suddenly reset the consumer Offset

I'm working with Kafka 0.8 & zookeeper 3.3.5. Actually, we have a dozen of topic we are consuming without any issue. Recently, …

java apache-zookeeper producer-consumer apache-kafka kafka-consumer-api
Kafka Topic vs Partition topic

I would like to know what is the difference between simple topic & partition topic.As per my understanding to …

java apache-kafka kafka-consumer-api
How to handle kafka publishing failure in robust way

I'm using Kafka and we have a use case to build a fault tolerant system where not even a single …

java cassandra redis apache-kafka kafka-consumer-api
Kafka consumer exception and offset commits

I've been trying to do some POC work for Spring Kafka. Specifically, I wanted to experiment with what are the …

java spring apache-kafka kafka-consumer-api spring-kafka
Kafka Connect JDBC sink connector not working

I am trying to use Kafka Connect JDBC sink connector to insert data into Oracle but it is throwing an …

apache-kafka kafka-consumer-api apache-kafka-connect
Kafka consumer "failed to find leader" when fetching topic metadata

When I try to use the Kafka producer and consumer (0.9.0) script to push/pull messages from a topic, I get …

apache-kafka apache-zookeeper kafka-consumer-api kafka-producer-api
How to read messages from kafka consumer group without consuming?

I'm managing a kafka queue using a common consumer group across multiple machines. Now I also need to show the …

apache-kafka kafka-consumer-api pykafka
Kafka Consumer Rebalancing Algorithm

Can someone please tell me what the rebalancing algorithm is for Kafka consumers? I would like to understand how partition …

apache-kafka kafka-consumer-api