in Spark Sql by
How to minimize data transfers working with Spark in Spark?

1 Answer

0 votes
The data transfer minimization and shuffling removal can be very much helpful in writing Spark programs that can run reliably. There are different ways of minimizing data transfers with Spark:

They are:

Using Accumulators

Using Broadcast Variable

Avoiding operations by key

Related questions

+1 vote
asked Jun 30, 2019 in Spark Sql by anonymous
0 votes
asked Mar 14, 2020 in Spark Sql by rajeshsharma
0 votes
asked Feb 12 in Spark Sql by sharadyadav1986
0 votes
asked Mar 9, 2020 in Spark Sql by SakshiSharma