<html><body><p>'du' tallies up 'blocks allocated', not file sizes. So it shouldn't matter whether any sparse files are present. GPFS doesn't charge quota for data in snapshots (whether it should is a separate question). The observed discrepancy has two plausible causes:<br><br>1) Inaccuracy in quota accounting (more likely)<br>2) Artefacts of data replication (less likely)<br><br>Running mmcheckquota in this situation would be a good idea. <br><br>yuri<br><br><img width="16" height="16" src="cid:1__=07BB0ABFDFEBD3168f9e8a93df938690918c07B@" border="0" alt="Inactive hide details for Alex Chekholko ---09/12/2016 12:04:12 PM---Hi, For a fileset with a quota on it, we have mmlsquota re"><font color="#424282">Alex Chekholko ---09/12/2016 12:04:12 PM---Hi, For a fileset with a quota on it, we have mmlsquota reporting 39TB</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">Alex Chekholko <chekh@stanford.edu></font><br><font size="2" color="#5F5F5F">To: </font><font size="2">gpfsug-discuss@spectrumscale.org, </font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">09/12/2016 12:04 PM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">[gpfsug-discuss] big difference between output of 'mmlsquota' and 'du'?</font><br><font size="2" color="#5F5F5F">Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><tt>Hi,<br><br>For a fileset with a quota on it, we have mmlsquota reporting 39TB <br>utilization (out of 50TB quota), with 0 in_doubt.<br><br>Running a 'du' on the same directory (where the fileset is junctioned) <br>shows 21TB usage.<br><br>I looked for sparse files (files that report different size via ls vs <br>du). I looked at 'du --apparent-size ...'<br><br></tt><tt><a href="https://en.wikipedia.org/wiki/Sparse_file">https://en.wikipedia.org/wiki/Sparse_file</a></tt><tt><br><br>What else could it be?<br><br>Is there some attribute I can scan for inside GPFS?<br>Maybe where FILE_SIZE does not equal KB_ALLOCATED?<br></tt><tt><a href="https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_usngfileattrbts.htm">https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_usngfileattrbts.htm</a></tt><tt><br><br><br>[root@scg-gs0 ~]# du -sm --apparent-size /srv/gsfs0/projects/gbsc/*<br>3977 /srv/gsfs0/projects/gbsc/Backups<br>1 /srv/gsfs0/projects/gbsc/benchmark<br>13109 /srv/gsfs0/projects/gbsc/Billing<br>198719 /srv/gsfs0/projects/gbsc/Clinical<br>1 /srv/gsfs0/projects/gbsc/Clinical_Vendors<br>1206523 /srv/gsfs0/projects/gbsc/Data<br>1 /srv/gsfs0/projects/gbsc/iPoP<br>123165 /srv/gsfs0/projects/gbsc/Macrogen<br>58676 /srv/gsfs0/projects/gbsc/Misc<br>6625890 /srv/gsfs0/projects/gbsc/mva<br>1 /srv/gsfs0/projects/gbsc/Proj<br>17 /srv/gsfs0/projects/gbsc/Projects<br>3290502 /srv/gsfs0/projects/gbsc/Resources<br>1 /srv/gsfs0/projects/gbsc/SeqCenter<br>1 /srv/gsfs0/projects/gbsc/share<br>514041 /srv/gsfs0/projects/gbsc/SNAP_Scoring<br>1 /srv/gsfs0/projects/gbsc/TCGA_Variants<br>267873 /srv/gsfs0/projects/gbsc/tools<br>9597797 /srv/gsfs0/projects/gbsc/workspace<br><br>(adds up to about 21TB)<br><br>[root@scg-gs0 ~]# mmlsquota -j projects.gbsc --block-size=G gsfs0<br> Block Limits <br> | File Limits<br>Filesystem type GB quota limit in_doubt grace <br>| files quota limit in_doubt grace Remarks<br>gsfs0 FILESET 39889 51200 51200 0 none <br>| 1663212 0 0 4 none<br><br><br>[root@scg-gs0 ~]# mmlsfileset gsfs0 |grep gbsc<br>projects.gbsc Linked /srv/gsfs0/projects/gbsc<br><br>Regards,<br>-- <br>Alex Chekholko chekh@stanford.edu<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></tt><tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br><br></tt><br><BR>
</body></html>