0 votes
in PySpark by
What are the main characteristics of PySpark?

1 Answer

0 votes
by

Following are the main four main characteristics of PySpark:

  1. Nodes are abstracted: The nodes are abstracted in PySpark. It means we cannot access the individual worker nodes.
  2. PySpark is based on MapReduce: PySpark is based on the MapReduce model of Hadoop. It means that the programmer provides the map and the reduced functions.
  3. APIs for Spark features: PySpark provides APIs for utilizing Spark features.
  4. Abstracted Network: PySpark provides abstracted networks. It means that the networks are abstracted in PySpark, and it facilitates only implicit communication.

Related questions

0 votes
asked Mar 13, 2022 in PySpark by rajeshsharma
0 votes
asked Mar 13, 2022 in PySpark by rajeshsharma
...