What are the functions of SparkCore in Spark?

Question

Q: What are the functions of SparkCore in Spark?

Answer 1

Spark core is nothing but a space engine for distributed data processing and large-scale parallel process. The Spark core is also known as the distributed execution engine while the Python APIs, Java, and Scala offer ETL application platform. Spark core can perform different functions like monitoring jobs, storage system interactions, job scheduling, memory management, and fault-tolerance. Further, it can allow workload streaming, machine learning, and SQL.

The Spark core can also be responsible for:

Monitoring, Scheduling, and distributing jobs on a cluster

Fault recovery and memory management

Ecosystems interactions