in Spark Sql by
Q:
Why we have to use broadcast variables while working with Spark in Spark?

1 Answer

0 votes
by

The broadcast variables can be referred to as read-only variables present on every machine(in-memory cache). The broadcast variables usage can eliminate variable ship copy necessity, in this way the data can process at high speed. Storing the lookup table in the memory can be possible through broadcast variables. It is used to enhance the efficiency of retrieval compared to Resilient Distribution Datasets loops.

Click here to read more about Loan/Mortgage
Click here to read more about Insurance

Related questions

0 votes
asked Aug 19, 2019 in Selenium by rahulsharma
0 votes
asked Nov 26, 2020 in Sql by SakshiSharma
...