in Spark Sql by
Q:
Explain about partitions in Apache Spark in Spark?

1 Answer

0 votes
by

As the name indicates partition means a logical and smaller division of data which is similar to the ‘split’ in MapReduce. It is the process to derive data logical units to speed up the process. Spark can manage the partitions to minimize the network traffic between the executors and also it can read data from the nodes into RDD. Partitions can also be known as the data set in the large distributed chunk and it can be used to optimize the operations to hold chunks. Everything in the Spark can be performed through partition RDD.

Click here to read more about Loan/Mortgage
Click here to read more about Insurance

Related questions

0 votes
asked Mar 14, 2020 in Spark Sql by rajeshsharma
0 votes
asked Mar 14, 2020 in Spark Sql by rajeshsharma
0 votes
asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986
0 votes
asked Mar 14, 2020 in Spark Sql by rajeshsharma
0 votes
asked Mar 14, 2020 in Spark Sql by rajeshsharma
...