[gpfsug-discuss] big difference between output of 'mmlsquota' and'du'?

[Yuri L Volobuev]

'du' tallies up 'blocks allocated', not file sizes.  So it shouldn't matter
whether any sparse files are present.  GPFS doesn't charge quota for data
in snapshots (whether it should is a separate question).  The observed
discrepancy has two plausible causes:

1) Inaccuracy in quota accounting (more likely)
2) Artefacts of data replication (less likely)

Running mmcheckquota in this situation would be a good idea.

yuri



From:	Alex Chekholko <chekh at stanford.edu>
To:	gpfsug-discuss at spectrumscale.org,
Date:	09/12/2016 12:04 PM
Subject:	[gpfsug-discuss] big difference between output of 'mmlsquota'
            and	'du'?
Sent by:	gpfsug-discuss-bounces at spectrumscale.org



Hi,

For a fileset with a quota on it, we have mmlsquota reporting 39TB
utilization (out of 50TB quota), with 0 in_doubt.

Running a 'du' on the same directory (where the fileset is junctioned)
shows 21TB usage.

I looked for sparse files (files that report different size via ls vs
du).  I looked at 'du --apparent-size ...'

https://en.wikipedia.org/wiki/Sparse_file

What else could it be?

Is there some attribute I can scan for inside GPFS?
Maybe where FILE_SIZE does not equal KB_ALLOCATED?
https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_usngfileattrbts.htm



[root at scg-gs0 ~]# du -sm --apparent-size /srv/gsfs0/projects/gbsc/*
3977		 /srv/gsfs0/projects/gbsc/Backups
1		 /srv/gsfs0/projects/gbsc/benchmark
13109		 /srv/gsfs0/projects/gbsc/Billing
198719		 /srv/gsfs0/projects/gbsc/Clinical
1		 /srv/gsfs0/projects/gbsc/Clinical_Vendors
1206523		 /srv/gsfs0/projects/gbsc/Data
1		 /srv/gsfs0/projects/gbsc/iPoP
123165		 /srv/gsfs0/projects/gbsc/Macrogen
58676		 /srv/gsfs0/projects/gbsc/Misc
6625890		 /srv/gsfs0/projects/gbsc/mva
1		 /srv/gsfs0/projects/gbsc/Proj
17		 /srv/gsfs0/projects/gbsc/Projects
3290502		 /srv/gsfs0/projects/gbsc/Resources
1		 /srv/gsfs0/projects/gbsc/SeqCenter
1		 /srv/gsfs0/projects/gbsc/share
514041		 /srv/gsfs0/projects/gbsc/SNAP_Scoring
1		 /srv/gsfs0/projects/gbsc/TCGA_Variants
267873		 /srv/gsfs0/projects/gbsc/tools
9597797		 /srv/gsfs0/projects/gbsc/workspace

(adds up to about 21TB)

[root at scg-gs0 ~]# mmlsquota -j projects.gbsc --block-size=G gsfs0
                          Block Limits
  |     File Limits
Filesystem type             GB      quota      limit   in_doubt    grace
|    files   quota    limit in_doubt    grace  Remarks
gsfs0      FILESET       39889      51200      51200          0     none
|  1663212       0        0        4     none


[root at scg-gs0 ~]# mmlsfileset gsfs0 |grep gbsc
projects.gbsc            Linked    /srv/gsfs0/projects/gbsc

Regards,
--
Alex Chekholko chekh at stanford.edu

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20160912/b0e584c4/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20160912/b0e584c4/attachment-0002.gif>