Question

What do you understand by a lineage graph in Spark?

Answer 1

In Apache Spark, the lineage graph is a dependencies graph between existing RDD and new RDD. It specifies that all the dependencies between the RDD are recorded in a graph rather than the original data.