0 votes
in Hadoop by
What would happen if you store too many small files in a cluster on HDFS?

1 Answer

0 votes
by

What would happen if you store too many small files in a cluster on HDFS?

Storing several small files on HDFS generates a lot of metadata files. To store these metadata in the RAM is a challenge as each file, block, or directory takes 150 bytes for metadata. Thus, the cumulative size of all the metadata will be too large.

...