<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Hi Alex,
<div class=""><br class="">
</div>
<div class="">While the numbers don’t match exactly, they’re close enough to prompt me to ask if data replication is possibly set to two? Thanks…</div>
<div class=""><br class="">
</div>
<div class="">Kevin</div>
<div class=""><br class="">
<div>
<blockquote type="cite" class="">
<div class="">On Sep 12, 2016, at 2:03 PM, Alex Chekholko <<a href="mailto:chekh@stanford.edu" class="">chekh@stanford.edu</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div class="">Hi,<br class="">
<br class="">
For a fileset with a quota on it, we have mmlsquota reporting 39TB utilization (out of 50TB quota), with 0 in_doubt.<br class="">
<br class="">
Running a 'du' on the same directory (where the fileset is junctioned) shows 21TB usage.<br class="">
<br class="">
I looked for sparse files (files that report different size via ls vs du). I looked at 'du --apparent-size ...'<br class="">
<br class="">
<a href="https://en.wikipedia.org/wiki/Sparse_file" class="">https://en.wikipedia.org/wiki/Sparse_file</a><br class="">
<br class="">
What else could it be?<br class="">
<br class="">
Is there some attribute I can scan for inside GPFS?<br class="">
Maybe where FILE_SIZE does not equal KB_ALLOCATED?<br class="">
https://www.ibm.com/support/knowledgecenter/STXKQY_4.2.0/com.ibm.spectrum.scale.v4r2.adv.doc/bl1adv_usngfileattrbts.htm<br class="">
<br class="">
<br class="">
[root@scg-gs0 ~]# du -sm --apparent-size /srv/gsfs0/projects/gbsc/*<br class="">
3977<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Backups<br class="">
1<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/benchmark<br class="">
13109<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Billing<br class="">
198719<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Clinical<br class="">
1<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Clinical_Vendors<br class="">
1206523<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Data<br class="">
1<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/iPoP<br class="">
123165<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Macrogen<br class="">
58676<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Misc<br class="">
6625890<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/mva<br class="">
1<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Proj<br class="">
17<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Projects<br class="">
3290502<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/Resources<br class="">
1<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/SeqCenter<br class="">
1<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/share<br class="">
514041<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/SNAP_Scoring<br class="">
1<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/TCGA_Variants<br class="">
267873<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/tools<br class="">
9597797<span class="Apple-tab-span" style="white-space:pre"> </span>/srv/gsfs0/projects/gbsc/workspace<br class="">
<br class="">
(adds up to about 21TB)<br class="">
<br class="">
[root@scg-gs0 ~]# mmlsquota -j projects.gbsc --block-size=G gsfs0<br class="">
Block Limits | File Limits<br class="">
Filesystem type GB quota limit in_doubt grace | files quota limit in_doubt grace Remarks<br class="">
gsfs0 FILESET 39889 51200 51200 0 none | 1663212 0 0 4 none<br class="">
<br class="">
<br class="">
[root@scg-gs0 ~]# mmlsfileset gsfs0 |grep gbsc<br class="">
projects.gbsc Linked /srv/gsfs0/projects/gbsc<br class="">
<br class="">
Regards,<br class="">
-- <br class="">
Alex Chekholko chekh@stanford.edu<br class="">
<br class="">
_______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at spectrumscale.org<br class="">
http://gpfsug.org/mailman/listinfo/gpfsug-discuss<br class="">
</div>
</div>
</blockquote>
</div>
<br class="">
<div class="">
<div class="">—</div>
<div class="">Kevin Buterbaugh - Senior System Administrator</div>
<div class="">Vanderbilt University - Advanced Computing Center for Research and Education</div>
<div class=""><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" class="">Kevin.Buterbaugh@vanderbilt.edu</a> - (615)875-9633</div>
<div class=""><br class="">
</div>
<br class="Apple-interchange-newline">
</div>
<br class="">
</div>
</body>
</html>