in Spark Sql by
Q:
Why we have to use broadcast variables while working with Spark in Spark?

1 Answer

0 votes
by

The broadcast variables can be referred to as read-only variables present on every machine(in-memory cache). The broadcast variables usage can eliminate variable ship copy necessity, in this way the data can process at high speed. Storing the lookup table in the memory can be possible through broadcast variables. It is used to enhance the efficiency of retrieval compared to Resilient Distribution Datasets loops.

Related questions

0 votes
asked Dec 18, 2020 in SVN by SakshiSharma
+1 vote
asked Mar 10, 2020 in Big Data | Hadoop by Hodge
0 votes
asked Feb 16 in Spark Preliminaries by Robindeniel
+1 vote
asked Mar 8, 2020 in Spark Sql by rahuljain1
...