The main task of Spark Core is to implement several vital functions such as memory management, fault-tolerance, monitoring jobs, job setting up, and communication with storage systems. It also contains additional libraries, built atop the middle that is used to diverse workloads for streaming, machine learning, and SQL.
The Spark Core is mainly used for the following tasks:
- Fault tolerance and recovery.
- To interact with storage systems.
- Memory management.
- Scheduling and monitoring jobs on a cluster.
