[gpfsug-discuss] Those users....

[Lines, Robert]

Make a better storage system and they will find a better way to abuse it.

A PI during an annual talk to the facility:  Because databases are hard and file systems have done a far better job of scaling we have implemented our datastore using files, file name and directory names.  It handles the high concurrency far better than any database server we could have built for the amount we are charged for that same very tiny amount of data.  Ignoring that the internal pricing for storage is based on sane usage and not packing your entire data set into small enough files that it all lives in the SSD tier.

So I feel for you.

Rob

From: <gpfsug-discuss-bounces at spectrumscale.org> on behalf of "Oesterlin, Robert" <Robert.Oesterlin at nuance.com>
Reply-To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date: Wednesday, August 22, 2018 at 1:12 PM
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: [gpfsug-discuss] Those users....

Sometimes, I look at the data that's being stored in my file systems and just shake my head:

/gpfs/<path removed>/Restricted/EventChangeLogs/deduped/working contains 17,967,350 files (in ONE directory)

Bob Oesterlin
Sr Principal Storage Engineer, Nuance
507-269-0413

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20180822/cfa986a1/attachment-0002.htm>