in Apache Spark by

What are receivers in Apache Spark Streaming?

1 Answer

0 votes
by

Receivers in Apache Spark Streaming are components that ingest data from various sources like Kafka, Flume, Kinesis, or TCP sockets. These receivers collect data and store it in Spark's memory for processing. Spark Streaming supports two types of receivers:

Reliable Receivers: These receivers acknowledge the sources upon successfully receiving data, ensuring no data loss.

Unreliable Receivers: These do not acknowledge the sources; hence, there might be data loss if the receiver fails.

...