<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
Hi Kums,
<div class=""><br class="">
</div>
<div class="">Thanks so much … this gave me exactly what I was looking for and the output was what I suspected I would see. Unfortunately, that means that the mystery of why we’re having these occasional high I/O wait times persists, but oh well…</div>
<div class=""><br class="">
</div>
<div class="">Kevin<br class="">
<div><br class="">
<blockquote type="cite" class="">
<div class="">On Jul 9, 2018, at 3:51 PM, Kumaran Rajaram <<a href="mailto:kums@us.ibm.com" class="">kums@us.ibm.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class=""><font size="2" face="Arial" class="">Hi Kevin,</font><br class="">
<br class="">
<font size="2" color="red" face="Arial" class="">>>I want to know what NSDs a single file has its’ blocks on?</font><br class="">
<br class="">
<font size="2" face="Arial" class="">You may use </font><font size="2" color="blue" face="Arial" class=""><i class="">/usr/lpp/mmfs/samples/fpo/mmgetlocation</i></font><font size="2" face="Arial" class="">to obtain the file-to-NSD block layout map. Use the
-h option for this tools usage (</font><font size="2" color="blue" face="Arial" class=""><i class="">mmgetlocation -h</i></font><font size="2" face="Arial" class="">).
</font><br class="">
<br class="">
<font size="2" face="Arial" class="">Sample output is below:</font><br class="">
<br class="">
<font size="2" face="Arial" class=""># File-system block size is 4MiB and sample file is 40MiB.</font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""># ls -lh /mnt/gpfs3a/data_out/lf</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">-rw-r--r-- 1 root root 40M Jul 9 16:42 /mnt/gpfs3a/data_out/lf</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""># du -sh /mnt/gpfs3a/data_out/lf</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">40M /mnt/gpfs3a/data_out/lf</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""># mmlsfs gpfs3a | grep 'Block size'</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> -B 4194304 Block size</i></font><br class="">
<br class="">
<font size="2" face="Arial" class=""># The file data is striped across 10 x NSDs (DMD_NSDX) constituting the file-system</font><br class="">
<br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""># /usr/lpp/mmfs/samples/fpo/mmgetlocation -f /mnt/gpfs3a/data_out/lf</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">[FILE /mnt/gpfs3a/data_out/lf INFORMATION]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> FS_DATA_BLOCKSIZE : 4194304 (bytes)</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> FS_META_DATA_BLOCKSIZE : 4194304 (bytes)</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> FS_FILE_DATAREPLICA : 1</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> FS_FILE_METADATAREPLICA : 1</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> FS_FILE_STORAGEPOOLNAME : system</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> FS_FILE_ALLOWWRITEAFFINITY : no</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> FS_FILE_WRITEAFFINITYDEPTH : 0</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> FS_FILE_BLOCKGROUPFACTOR : 1</i></font><br class="">
<br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 0 (offset 0) : [DMD_NSD5 c72f1m5u37ib0,c72f1m5u39ib0]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 1 (offset 4194304) : [DMD_NSD6 c72f1m5u39ib0,c72f1m5u37ib0]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 2 (offset 8388608) : [DMD_NSD7 c72f1m5u37ib0,c72f1m5u39ib0]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 3 (offset 12582912) : [DMD_NSD8 c72f1m5u39ib0,c72f1m5u37ib0]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 4 (offset 16777216) : [DMD_NSD9 c72f1m5u37ib0,c72f1m5u39ib0]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 5 (offset 20971520) : [DMD_NSD10 c72f1m5u39ib0,c72f1m5u37ib0]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 6 (offset 25165824) : [DMD_NSD1 c72f1m5u37ib0,c72f1m5u39ib0]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 7 (offset 29360128) : [DMD_NSD2 c72f1m5u39ib0,c72f1m5u37ib0]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 8 (offset 33554432) : [DMD_NSD3 c72f1m5u37ib0,c72f1m5u39ib0]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">chunk(s)# 9 (offset 37748736) : [DMD_NSD4 c72f1m5u39ib0,c72f1m5u37ib0]</i></font><br class="">
<br class="">
<br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">[FILE: /mnt/gpfs3a/data_out/lf SUMMARY INFO]</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class="">replica1:</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> c72f1m5u37ib0,c72f1m5u39ib0: 5 chunk(s)</i></font><br class="">
<font size="2" color="blue" face="Arial" class=""><i class=""> c72f1m5u39ib0,c72f1m5u37ib0: 5 chunk(s)</i></font><br class="">
<br class="">
<font size="2" face="Arial" class="">Thanks and Regards,</font><br class="">
<font size="2" face="Arial" class="">-Kums</font><br class="">
<br class="">
<br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">From: </font><font size="1" face="sans-serif" class="">"Buterbaugh, Kevin L" <<a href="mailto:Kevin.Buterbaugh@Vanderbilt.Edu" class="">Kevin.Buterbaugh@Vanderbilt.Edu</a>></font><br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">To: </font><font size="1" face="sans-serif" class="">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" class="">gpfsug-discuss@spectrumscale.org</a>></font><br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">Date: </font><font size="1" face="sans-serif" class="">07/09/2018 04:05 PM</font><br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">Subject: </font><font size="1" face="sans-serif" class="">[gpfsug-discuss] What NSDs does a file have blocks on?</font><br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">Sent by: </font><font size="1" face="sans-serif" class=""><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" class="">gpfsug-discuss-bounces@spectrumscale.org</a></font><br class="">
<hr noshade="" class="">
<br class="">
<br class="">
<br class="">
<font size="3" class="">Hi All, </font><br class="">
<br class="">
<font size="3" class="">I am still working on my issue of the occasional high I/O wait times and that has raised another question … I know that I can run mmfileid to see what files have a block on a given NSD, but is there a way to do the opposite? I.e. I
want to know what NSDs a single file has its’ blocks on? The mmlsattr command does not appear to show this information unless it’s got an undocumented option. Thanks…</font><br class="">
<br class="">
<font size="3" class="">Kevin</font><br class="">
<br class="">
<font size="3" class="">—</font><br class="">
<font size="3" class="">Kevin Buterbaugh - Senior System Administrator</font><br class="">
<font size="3" class="">Vanderbilt University - Advanced Computing Center for Research and Education</font><br class="">
<a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" class=""><font size="3" color="blue" class=""><u class="">Kevin.Buterbaugh@vanderbilt.edu</u></font></a><font size="3" class="">- (615)875-9633</font><br class="">
<br class="">
<br class="">
<tt class=""><font size="2" class="">_______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class="">
</font></tt><a href="https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C523052f2a40c48efb5a808d5e5ddc6b0%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C636667663044944884&sdata=Q2Wg8yDwA9yu%2FZgJXELr7V3qHAY7I7eKPTBHkqVKA5I%3D&reserved=0" originalsrc="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" shash="hK6STwuoCskgDFJhTZXLYvNlRZORjPn6IFLE0fyrnWBCMU6D/YB9mLfX+rKZ/5oscNHQY5GFbapmEGt1ZxSPus17yxmsO96UNhuMosnY1E1sAyns0qY7aw/0wG5Su9aqkoQDw09Ou2Chx9oQbbBRM1h0rBgQXQntkTXQVbOZe3o=" class=""><tt class=""><font size="2" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt class=""><font size="2" class=""><br class="">
</font></tt><br class="">
<br class="">
_______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class="">
<a href="https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C523052f2a40c48efb5a808d5e5ddc6b0%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C636667663044944884&sdata=Q2Wg8yDwA9yu%2FZgJXELr7V3qHAY7I7eKPTBHkqVKA5I%3D&reserved=0" class="">https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C523052f2a40c48efb5a808d5e5ddc6b0%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C636667663044944884&sdata=Q2Wg8yDwA9yu%2FZgJXELr7V3qHAY7I7eKPTBHkqVKA5I%3D&reserved=0</a><br class="">
</div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>