• Home
  • Recent Q&A
  • Java
  • Cloud
  • JavaScript
  • Python
  • SQL
  • PHP
  • HTML
  • C++
  • Data Science
  • DBMS
  • Devops
  • Hadoop
  • Machine Learning
in Hadoop by
Q:
What would happen if you store too many small files in a cluster on HDFS?

1 Answer

0 votes
by

What would happen if you store too many small files in a cluster on HDFS?

Storing several small files on HDFS generates a lot of metadata files. To store these metadata in the RAM is a challenge as each file, block, or directory takes 150 bytes for metadata. Thus, the cumulative size of all the metadata will be too large.

Related questions

0 votes
asked Jan 23, 2020 in JAVA by rahuljain1
0 votes
asked Nov 5, 2020 in Hadoop by SakshiSharma
...