Home
Recent Q&A
Java
Cloud
JavaScript
Python
SQL
PHP
HTML
C++
Data Science
DBMS
Devops
Hadoop
Machine Learning
Azure
Blockchain
Devops
Ask a Question
What are the main characteristics of PySpark?
Home
PySpark
What are the main characteristics of PySpark?
0
votes
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
What are the main characteristics of PySpark?
pyspark-characteristics
Please
log in
or
register
to answer this question.
1
Answer
0
votes
answered
Mar 13, 2022
by
rajeshsharma
Following are the main four main characteristics of PySpark:
Nodes are abstracted: The nodes are abstracted in PySpark. It means we cannot access the individual worker nodes.
PySpark is based on MapReduce: PySpark is based on the MapReduce model of Hadoop. It means that the programmer provides the map and the reduced functions.
APIs for Spark features: PySpark provides APIs for utilizing Spark features.
Abstracted Network: PySpark provides abstracted networks. It means that the networks are abstracted in PySpark, and it facilitates only implicit communication.
Your comment on this answer:
Email me at this address if a comment is added after mine:
Email me if a comment is added after mine
Privacy: Your email address will only be used for sending these notifications.
Related questions
0
votes
Q: What are the key advantages of PySpark RDD?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
pyspark-rdd
0
votes
Q: What do you understand by a cluster manager? What are the different cluster manager types supported by PySpark?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
cluster-message
pyspark-cluster
0
votes
Q: What do you understand by "joins" in PySpark DataFrame? What are the different types of joins available in PySpark?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
pyspark-data-frame
0
votes
Q: What are the different types of algorithms supported in PySpark?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
pyspark-algorithms
0
votes
Q: Why are Partitions immutable in PySpark?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
pyspark-partition
0
votes
Q: What are the prerequisites to learn PySpark?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
pyspark-prerequisites
0
votes
Q: What are the key advantages and disadvantages of PySpark?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
pyspark-advantages
pyspark-disadvantages
0
votes
Q: What is DStream in PySpark?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
pyspark-dstream
0
votes
Q: Can we create PySpark DataFrame from external data sources?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
pyspark-data-frame
0
votes
Q: What do you understand by startsWith() and endsWith() methods in PySpark?
asked
Mar 13, 2022
in
PySpark
by
rajeshsharma
spark-endswith
spark-startswith
...