Top "Kafka-consumer-api" questions

Use for questions related to the Apache Kafka consumer API

Kafka: The message when serialized is larger than the maximum request size you have configured with the max.request.size configuration

Getting the following error (Kafka 2.1.0): 2018-12-03 21:22:37.873 ERROR 37645 --- [nio-8080-exec-1] o.s.k.support.LoggingProducerListener : Exception thrown when sending …

apache-kafka kafka-consumer-api kafka-producer-api spring-kafka
Does kafka have any default web UI

I have a couple questions in Kafka. 1) Does Kafka have a default web UI? 2) How can we gracefully shutdown a …

apache-kafka kafka-consumer-api kafka-producer-api
Apache Kafka-Exception : org.apache.kafka.clients.consumer.KafkaConsumer.subscribe(Ljava/util/List;)V

I am using Apache Kafka version kafka_2.10-0.10.1.0 During Poc i have created simple producer and consumer. When i am …

java apache-kafka kafka-consumer-api nosuchmethoderror
kafka-python - How do I commit a partition?

Using kafka-python-1.0.2. If I have a topic with 10 partitions, how do I go about committing a particular partition, while looping …

python kafka-consumer-api kafka-python
Kafka - difference between Log end offset(LEO) vs High Watermark(HW)

What is the difference between LEO and HW in Replica ( Leader Replica)? Will they contain the same number? I can …

apache-kafka kafka-consumer-api kafka-producer-api
kafka failed authentication due to: SSL handshake failed

I have to add encryption and authentication with SSL in kafka. This is what I have done: Generate certificate for …

apache-kafka kafka-consumer-api kafka-producer-api
Kafka throws java.nio.channels.ClosedChannelException

When i try to consume messages from the kafka server which is hosted in ec2 with kafka console tool (V 0.9.0.1 , …

apache-kafka kafka-consumer-api kafka-producer-api
What is the difference in Kafka between a Consumer Group Coordinator and a Consumer Group Leader?

I see references to Kafka Consumer Group Coordinators and Consumer Group Leaders... What is the difference? What is the benefit …

apache-kafka kafka-consumer-api
kafka-python consumer not receiving messages

I am having trouble with KafaConsumer to make it read from the beginning, or from any other explicit offset. Running …

python apache-kafka kafka-consumer-api kafka-python
Is it possible to transfer files using Kafka?

I have thousands of files generated each day which I want to stream using Kafka. When I try to read …

apache-kafka kafka-consumer-api kafka-producer-api