Question

Explain about spill factor with respect to the RAM in Hadoop?

Answer 1

Spill factor is the size after which your files move to the temp file. Hadoop-temp directory is used for this. Default value for io.sort.spill.percent is 0.80. A value less than 0.5 is not recommended.