0 votes
in Hadoop by
What would happen if you store too many small files in a cluster on HDFS?

1 Answer

0 votes
by

What would happen if you store too many small files in a cluster on HDFS?

Storing several small files on HDFS generates a lot of metadata files. To store these metadata in the RAM is a challenge as each file, block, or directory takes 150 bytes for metadata. Thus, the cumulative size of all the metadata will be too large.

Related questions

0 votes
asked Jul 21, 2023 in Deep Learning by rahuljain1
0 votes
asked Feb 23, 2020 in Big Data | Hadoop by rahuljain1
...