0 votes
in Apache Spark by
What is the lineage in Spark?

1 Answer

0 votes
by

In Apache Spark, when a transformation (map or filter etc.) is called, it is not executed by Spark immediately; instead, a lineage is created for each transformation. This lineage is used to keep track of what all transformations have to be applied on that RDD. It also traces the location from where it has to read the data.

Related questions

0 votes
asked Aug 25, 2022 in Apache Spark by sharadyadav1986
0 votes
asked Aug 25, 2022 in Apache Spark by sharadyadav1986
...