[gpfsug-discuss] big difference between output of 'mmlsquota' and 'du'?

[Bryan Banister]

I'd recommend running a mmcheckquota and then check mmlsquota again,
-Bryan

-----Original Message-----
From: gpfsug-discuss-bounces at spectrumscale.org [mailto:gpfsug-discuss-bounces at spectrumscale.org] On Behalf Of Alex Chekholko
Sent: Monday, September 12, 2016 2:03 PM
To: gpfsug-discuss at spectrumscale.org
Subject: [gpfsug-discuss] big difference between output of 'mmlsquota' and 'du'?

Hi,

For a fileset with a quota on it, we have mmlsquota reporting 39TB utilization (out of 50TB quota), with 0 in_doubt.

Running a 'du' on the same directory (where the fileset is junctioned) shows 21TB usage.

I looked for sparse files (files that report different size via ls vs du).  I looked at 'du --apparent-size ...'

https://en.wikipedia.org/wiki/Sparse_file

What else could it be?

Is there some attribute I can scan for inside GPFS?
Maybe where FILE_SIZE does not equal KB_ALLOCATED?
https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_usngfileattrbts.htm


[root at scg-gs0 ~]# du -sm --apparent-size /srv/gsfs0/projects/gbsc/*
3977    /srv/gsfs0/projects/gbsc/Backups
1       /srv/gsfs0/projects/gbsc/benchmark
13109   /srv/gsfs0/projects/gbsc/Billing
198719  /srv/gsfs0/projects/gbsc/Clinical
1       /srv/gsfs0/projects/gbsc/Clinical_Vendors
1206523 /srv/gsfs0/projects/gbsc/Data
1       /srv/gsfs0/projects/gbsc/iPoP
123165  /srv/gsfs0/projects/gbsc/Macrogen
58676   /srv/gsfs0/projects/gbsc/Misc
6625890 /srv/gsfs0/projects/gbsc/mva
1       /srv/gsfs0/projects/gbsc/Proj
17      /srv/gsfs0/projects/gbsc/Projects
3290502 /srv/gsfs0/projects/gbsc/Resources
1       /srv/gsfs0/projects/gbsc/SeqCenter
1       /srv/gsfs0/projects/gbsc/share
514041  /srv/gsfs0/projects/gbsc/SNAP_Scoring
1       /srv/gsfs0/projects/gbsc/TCGA_Variants
267873  /srv/gsfs0/projects/gbsc/tools
9597797 /srv/gsfs0/projects/gbsc/workspace

(adds up to about 21TB)

[root at scg-gs0 ~]# mmlsquota -j projects.gbsc --block-size=G gsfs0
                          Block Limits
  |     File Limits
Filesystem type             GB      quota      limit   in_doubt    grace
|    files   quota    limit in_doubt    grace  Remarks
gsfs0      FILESET       39889      51200      51200          0     none
|  1663212       0        0        4     none


[root at scg-gs0 ~]# mmlsfileset gsfs0 |grep gbsc
projects.gbsc            Linked    /srv/gsfs0/projects/gbsc

Regards,
--
Alex Chekholko chekh at stanford.edu

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

________________________________

Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial product.