Skip to content Skip to sidebar Skip to footer

Pyspark Structured Streaming From Kafka Does Not Output To Console For Debugging

Below is my code. I have tried many different select variations, and yet the app runs, but without showing messages which are being written every second. I have a Spark Streaming

Solution 1:

kafka.bootstrap.servers is the Kafka broker address (default port 9092), not Zookeeper (port 2181)

Also note your starting offsets are the latest, so you must produce data after starting the streaming application.

If you want to see existing topic data, use the earliest offsets.

Post a Comment for "Pyspark Structured Streaming From Kafka Does Not Output To Console For Debugging"