0 votes
in Spark Preliminaries by
Why are partitions immutable?

1 Answer

0 votes
by
With each change, a new partition is made. Partitions use the HDFS API, so they can't be changed, are spread out, and can handle mistakes. Because of this, partitions are aware of where the results are.

Related questions

+2 votes
asked Jan 24, 2020 in JAVA by rahuljain1
0 votes
asked Nov 15, 2023 in Azure by Robin
...