[gpfsug-discuss] big difference between output of 'mmlsquota' and 'du'?

[Buterbaugh, Kevin L]

Hi Alex,

While the numbers don’t match exactly, they’re close enough to prompt me to ask if data replication is possibly set to two?  Thanks…

Kevin

On Sep 12, 2016, at 2:03 PM, Alex Chekholko <chekh at stanford.edu<mailto:chekh at stanford.edu>> wrote:

Hi,

For a fileset with a quota on it, we have mmlsquota reporting 39TB utilization (out of 50TB quota), with 0 in_doubt.

Running a 'du' on the same directory (where the fileset is junctioned) shows 21TB usage.

I looked for sparse files (files that report different size via ls vs du).  I looked at 'du --apparent-size ...'

https://en.wikipedia.org/wiki/Sparse_file

What else could it be?

Is there some attribute I can scan for inside GPFS?
Maybe where FILE_SIZE does not equal KB_ALLOCATED?
https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_usngfileattrbts.htm


[root at scg-gs0 ~]# du -sm --apparent-size /srv/gsfs0/projects/gbsc/*
3977 /srv/gsfs0/projects/gbsc/Backups
1 /srv/gsfs0/projects/gbsc/benchmark
13109 /srv/gsfs0/projects/gbsc/Billing
198719 /srv/gsfs0/projects/gbsc/Clinical
1 /srv/gsfs0/projects/gbsc/Clinical_Vendors
1206523 /srv/gsfs0/projects/gbsc/Data
1 /srv/gsfs0/projects/gbsc/iPoP
123165 /srv/gsfs0/projects/gbsc/Macrogen
58676 /srv/gsfs0/projects/gbsc/Misc
6625890 /srv/gsfs0/projects/gbsc/mva
1 /srv/gsfs0/projects/gbsc/Proj
17 /srv/gsfs0/projects/gbsc/Projects
3290502 /srv/gsfs0/projects/gbsc/Resources
1 /srv/gsfs0/projects/gbsc/SeqCenter
1 /srv/gsfs0/projects/gbsc/share
514041 /srv/gsfs0/projects/gbsc/SNAP_Scoring
1 /srv/gsfs0/projects/gbsc/TCGA_Variants
267873 /srv/gsfs0/projects/gbsc/tools
9597797 /srv/gsfs0/projects/gbsc/workspace

(adds up to about 21TB)

[root at scg-gs0 ~]# mmlsquota -j projects.gbsc --block-size=G gsfs0
                        Block Limits  |     File Limits
Filesystem type             GB      quota      limit   in_doubt    grace |    files   quota    limit in_doubt    grace  Remarks
gsfs0      FILESET       39889      51200      51200          0     none |  1663212       0        0        4     none


[root at scg-gs0 ~]# mmlsfileset gsfs0 |grep gbsc
projects.gbsc            Linked    /srv/gsfs0/projects/gbsc

Regards,
--
Alex Chekholko chekh at stanford.edu

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

—
Kevin Buterbaugh - Senior System Administrator
Vanderbilt University - Advanced Computing Center for Research and Education
Kevin.Buterbaugh at vanderbilt.edu<mailto:Kevin.Buterbaugh at vanderbilt.edu> - (615)875-9633



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20160912/67feae0d/attachment-0002.htm>