[gpfsug-discuss] big difference between output of 'mmlsquota' and 'du'?

[Alex Chekholko]

Hi,

For a fileset with a quota on it, we have mmlsquota reporting 39TB 
utilization (out of 50TB quota), with 0 in_doubt.

Running a 'du' on the same directory (where the fileset is junctioned) 
shows 21TB usage.

I looked for sparse files (files that report different size via ls vs 
du).  I looked at 'du --apparent-size ...'

https://en.wikipedia.org/wiki/Sparse_file

What else could it be?

Is there some attribute I can scan for inside GPFS?
Maybe where FILE_SIZE does not equal KB_ALLOCATED?
https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_usngfileattrbts.htm


[root at scg-gs0 ~]# du -sm --apparent-size /srv/gsfs0/projects/gbsc/*
3977	/srv/gsfs0/projects/gbsc/Backups
1	/srv/gsfs0/projects/gbsc/benchmark
13109	/srv/gsfs0/projects/gbsc/Billing
198719	/srv/gsfs0/projects/gbsc/Clinical
1	/srv/gsfs0/projects/gbsc/Clinical_Vendors
1206523	/srv/gsfs0/projects/gbsc/Data
1	/srv/gsfs0/projects/gbsc/iPoP
123165	/srv/gsfs0/projects/gbsc/Macrogen
58676	/srv/gsfs0/projects/gbsc/Misc
6625890	/srv/gsfs0/projects/gbsc/mva
1	/srv/gsfs0/projects/gbsc/Proj
17	/srv/gsfs0/projects/gbsc/Projects
3290502	/srv/gsfs0/projects/gbsc/Resources
1	/srv/gsfs0/projects/gbsc/SeqCenter
1	/srv/gsfs0/projects/gbsc/share
514041	/srv/gsfs0/projects/gbsc/SNAP_Scoring
1	/srv/gsfs0/projects/gbsc/TCGA_Variants
267873	/srv/gsfs0/projects/gbsc/tools
9597797	/srv/gsfs0/projects/gbsc/workspace

(adds up to about 21TB)

[root at scg-gs0 ~]# mmlsquota -j projects.gbsc --block-size=G gsfs0
                          Block Limits 
  |     File Limits
Filesystem type             GB      quota      limit   in_doubt    grace 
|    files   quota    limit in_doubt    grace  Remarks
gsfs0      FILESET       39889      51200      51200          0     none 
|  1663212       0        0        4     none


[root at scg-gs0 ~]# mmlsfileset gsfs0 |grep gbsc
projects.gbsc            Linked    /srv/gsfs0/projects/gbsc

Regards,
-- 
Alex Chekholko chekh at stanford.edu