Learn Python Tutorials

i am using kafka-python to consume messages from a kafka queue (kafka version 0.10.2.0). In particu… Read more Kafka-python Read From Last Produced Message After A Consumer Restart

I am trying to run an app that uses a kafka producer (Python client), and an apache beam pipeline t… Read more How To Consume Messages Using Beam's External Kafka Transform (locally)

I am trying out Flink's new Python streaming API and attempting to run my script with ./flink-1… Read more Apache Flink: Kafka Connector In Python Streaming Api, "cannot Load User Class"

I have a running and tested Kafka cluster, and am trying to use a Python script to send messages to… Read more Python Producer Can Send Via Shell, But Not .py

I am receiving from a remote server Kafka Avro messages in Python (using the consumer of Confluent … Read more How To Decode/deserialize Avro With Python From Kafka

I'm trying to build an application with kafka-python where a consumer reads data from a range o… Read more Kafka-python Consumer Start Reading From Offset (automatically)

I am using the Jupyter notebook with Pyspark with the following docker image: Jupyter all-spark-not… Read more Adding Custom Jars To Pyspark In Jupyter Notebook

There are lots of online examples of reading json from Kafka (to write to parquet) - but I cannot f… Read more Spark Streaming: Read CSV String From Kafka, Write To Parquet