Login
Remember
Register
Ask a Question
What are the main characteristics of PySpark?
0
votes
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
What are the main characteristics of PySpark?
pyspark-characteristics
Please
log in
or
register
to answer this question.
1
Answer
0
votes
answered
Mar 13, 2022
by
rajeshsharma
Following are the main four main characteristics of PySpark:
Nodes are abstracted: The nodes are abstracted in PySpark. It means we cannot access the individual worker nodes.
PySpark is based on MapReduce: PySpark is based on the MapReduce model of Hadoop. It means that the programmer provides the map and the reduced functions.
APIs for Spark features: PySpark provides APIs for utilizing Spark features.
Abstracted Network: PySpark provides abstracted networks. It means that the networks are abstracted in PySpark, and it facilitates only implicit communication.
...
