in Spark Sql by
What is the role of checkpoints in Spark?

► Click here to show 1 Answer

0 votes

Spark provides checkpoints to run around the clock for a program and also making it resilient failure by not relating application logic. In these, the lineage graphs are very much used to recover the Resilient Distribution Datasets from failure. Spark comes with API for managing and adding checkpoints. Then finally, the user decides which data to the checkpoints.

Learn More with Madanswer

Related questions

0 votes
asked Mar 14, 2020 in Spark Sql by rajeshsharma