[gpfsug-discuss] gpfsug-discuss Digest, Vol 87, Issue 21

[Prasad Surampudi]

I am trying to analyze a filehist report of a Spectrum Scale filesystem I recently collected. Given below is the data and I have put my interpretation in parentheses. Could someone from Sale development review and let me know if my interpretation is correct? Filesystem block size is 16 MB and system pool block size is 256 KB.


GPFS Filehist report for Test Filesystem


All: Files                    =       38,808,641 (38 Million Total Files)

All: Files in inodes          =        8153748

Available space               = 1550139596472320     1550140 GB        1550 TB

Total Size of files           = 1110707126790022

Total Size of files in inodes =    26008177568

Total Space                   = 1123175375306752     1123175 GB        1123 TB

Largest File                  =  3070145200128 -  ( 2.8 TB)

Average Size                  =       28620098 – ( 27 MB )

Non-zero: Files               =       38642491

Average NZ size               =       28743155

Directories                   =         687233 (Total Number of Directories)

Directories in inode          =         650552

Total Dir Space               =     5988433920

Avg Entries per dir           =           57.5 (Avg # files per Directory)

Files with indirect blocks    =         181003

File%ile represents the cummulative percentage of files.

Space%ile represents the cummulative percentage of total space used.

AvlSpc%ile represents the cummulative percentage used of total available space.


Histogram of files <= one 16M block in size

Subblocks    Count  File%ile  Space%ile   AvlSpc%ile

--------- -------- ---------- ----------  ----------

        0  7,669,346     19.76%      0.00%       0.00% ( ~7 Million files <= 512 KB )

        1 25,548,588     85.59%      1.19%       0.86% - ( ~25 Million files > 512 KB <= 1 MB )

        2  1,270,115     88.87%      1.31%       0.95% - (~1 Million files > 1 MB <= 1.5 MB )

....
....
....


       32    10387     97.37%      2.43%       1.76%



Histogram of files with N 16M blocks (plus end fragment)

   Blocks    Count  File%ile  Space%ile   AvlSpc%ile

--------- -------- ---------- ----------  ----------

        1   177550     97.82%      2.70%       1.95% ( ~177 K files <= 16 MB)

....
....
....

      100      640     99.77%     17.31%      12.54%

Number of files with more than 100 16M blocks

     101+    88121    100.00%    100.00%      72.46% ( ~88 K files > 1600 MB)



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20190423/19449f02/attachment-0001.htm>