[gpfsug-discuss] Those users.... millions of files per directory - not necessarily a mistake

Marc A Kaplan makaplan at us.ibm.com
Thu Aug 23 16:23:33 BST 2018


Millions of files per directory, may well be a mistake... 

BUT there are some very smart use cases that might take advantage of GPFS 
having good performance with large directories --
because GPFS uses extensible hashing -- it is better to store millions of 
files in a single GPFS directory than artificially scatter them among 
directories based on the mistaken notion that large directories are bad. 
(Yeah, they are in most implementations, but not in GPFS.)


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20180823/ac43e952/attachment-0002.htm>


More information about the gpfsug-discuss mailing list