Jan 11, 2020 in Big Data | Hadoop
Q: What is the use of Distributed Cache in Hadoop?

1 Answer

0 votes
Jan 11, 2020

Hadoop provides a utility called Distributed Cache to improve the performance of jobs by caching the files used by applications.

An application can specify which file it wants to cache by using JobConf configuration.

Hadoop framework copies these files to the nodes one which a task has to be executed. This is done before the start of

 

execution of a task.

DistributedCache supports distribution of simple read only text files as well as complex files like jars, zips etc.

Related questions

+1 vote
Jun 28 in HDFS
+1 vote
Jun 28 in HDFS
...