0 votes
in Spark Sql by
Explain the types of DStream transformations in Spark?

1 Answer

0 votes
by

There are two types of transformations on DStream.

Stateless Transformations

Stateful Transformations

Stateless Transformations: The batch processing doesn’t depend on the previous output batch.

Example: reduceByKey(), map(), filter().

Stateful Transformations: The batch processing depends on the previous batch intermediate results.

Example: Sliding windows transformations.

Related questions

0 votes
0 votes
asked Mar 7, 2020 in Spark Sql by rahuljain1
0 votes
asked Mar 14, 2020 in Spark Sql by rajeshsharma
...