Top "Kafka-python" questions

Kafka 10 - Python Client with Authentication and Authorization

I have a Kafka10 cluster with SASL_SSL (Authentication( JAAS ) and Authorization) enabled. Able to connect thru SASL using the …

python apache-kafka kafka-python

kafka-python read from last produced message after a consumer restart

i am using kafka-python to consume messages from a kafka queue (kafka version 0.10.2.0). In particular i am using KafkaConsumer type. …

python apache-kafka kafka-python

How to pass data from Kafka to Spark Streaming?

I am trying to pass data from kafka to spark streaming. This is what I've done till now: Installed both …

apache-spark apache-kafka spark-streaming kafka-python

kafka-python raise UnrecognizedBrokerVersion Error

I am getting this error when constructing KafkaProducer with the kafka-python package: [ERROR] UnrecognizedBrokerVersion: UnrecognizedBrokerVersion Traceback (most recent call last): …

python apache-kafka kafka-python aws-msk

Flask - Pulling the live stream kafka data - Integrating Kafka with Python Flask

This project is for real time search engine - log analysis performance. I have a live streaming data out from …

python flask socket.io flask-socketio kafka-python

Kafka python consumer reading all the messages when started

I am using the below code to read messages from a topic. I am facing two issues. Whenever i start …

python apache-kafka kafka-python

Python: how to mock a kafka topic for unit tests?

We have a message scheduler that generates a hash-key from the message attributes before placing it on a Kafka topic …

python unit-testing apache-kafka kafka-python

Can't Consume JSON Messages From Kafka Using Kafka-Python's Deserializer

I am trying to send a very simple JSON object through Kafka and read it out the other side using …

python json kafka-python

Sending Large CSV to Kafka using python Spark

I am trying to send a large CSV to kafka. The basic structure is to read a line of the …

python apache-spark apache-kafka pyspark kafka-python