What are the operations that can cause a shuffle in Spark?

Question

What are the operations that can cause a shuffle in Spark?

1 Answer

Related questions

0 votes

Q: What are the main operations that can be done on a RDD in Apache Spark?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: What is a Shuffle operation in Spark?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: Explain about the partitioning, shuffle and sort phase

asked Jan 26, 2020 in Big Data | Hadoop by rajeshsharma (23.9k points)

0 votes

Q: How can you isolate the cursors from intervening with the write operations in MongoDB ?

asked Mar 22, 2020 in Big Data | Hadoop by SakshiSharma (32.2k points)

0 votes

Q: What are the main languages supported by Apache Spark?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: What are the common Actions in Apache Spark?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: What are the common Transformations in Apache Spark?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: What are the two ways to create RDD in Spark?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: What is a Parquet file in Spark?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: What is a DataFrame in Spark SQL?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: What is the difference between Apache Spark and Apache Hadoop MapReduce?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: What is purpose of Spark SQL?

asked Jan 13, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

+1 vote

Q: What is the default maximum dynamic partition that can be created by a mapper/reducer?

asked Jan 10, 2020 in Big Data | Hadoop by sharadyadav1986 (31.7k points)

0 votes

Q: The Property that decides what is the maximum number of files that can be sampled during the use of the LIMIT clause is

asked Apr 8, 2020 in Big Data | Hadoop by GeorgeBell (5.2k points)

+1 vote

Q: the candidate can ask the interviewer why the hadoop infrastructure is configured in that particular way, why the company chose to use the selected big data tools

asked Feb 23, 2020 in Big Data | Hadoop by rahuljain1 (6.5k points)

SakshiSharma · Answer 1 · 2020-01-13T09:44:34+0000

Some of the common operations that can cause a shuffle internally in Spark are as follows:

1. Repartition

2. Coalesce

3. GroupByKey

4. ReduceByKey

5. Cogroup

6. Join

What are the operations that can cause a shuffle in Spark?

Please log in or register to answer this question.

1 Answer

Related questions

Top Trending Technologies Questions and Answers

HOT LINKS

TRANDING TECHNOLOGIES

CONTACT US

Follow us on Social Media