Leader Not Available Kafka in Console Producer

apache-kafka producer
Vishesh picture Vishesh · Mar 4, 2016 · Viewed 182.6k times · Source

I am trying to use Kafka.
All configurations are done properly but when I try to produce message from console I keep getting the following error

WARN Error while fetching metadata with correlation id 39 : 
     {4-3-16-topic1=LEADER_NOT_AVAILABLE} (org.apache.kafka.clients.NetworkClient)

Kafka version: 2.11-0.9.0.0

Answer

Alexey Raga picture Alexey Raga · Mar 15, 2016

It could be related to advertised.host.name setting in your server.properties.

What could happen is that your producer is trying to find out who is the leader for a given partition, figures out its advertised.host.name and advertised.port and tries to connect. If these settings are not configured correctly it then may think that the leader is unavailable.

Related questions

Topic can't be found when producing messages: UNKNOWN_TOPIC_OR_PARTITION

I have a two-nodes Kafka cluster (EC2 instances) where each node is used as a separate broker. When I run a producer on the leader instance with the following command: kafka-console-producer.sh --broker-list localhost:9092 --topic test I get the following …

Read More
Interact with kafka docker container from outside of docker host

I have built a kafka docker container and orchestrate it using docker-compose. Calling docker ps I get the following putput: CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 5bde6f76246e hieutrtr/docker-kafka:0.0.1 "/start.sh" About an hour ago Up …

Read More
Spring Kafka asynchronous send calls block

I'm using Spring-Kafka version 1.2.1 and, when the Kafka server is down/unreachable, the asynchronous send calls block for a time. It seems to be the TCP timeout. The code is something like this: ListenableFuture<SendResult<K, V>&…

Read More