<div dir="ltr"><div>Hi,</div><div><br></div><div>this is a undocumented mmpmon call, so you are on your own, but here is the correct description : </div>
<div><br></div><br><table width="100%" cellpadding="3" cellspacing="0">
<colgroup><col width="55*">
<col width="201*">
</colgroup><thead>
<tr valign="top">
<td width="21%" style="border-top-width:1px;border-style:solid none solid solid;border-top-color:rgb(0,0,0);border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0.04in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_n_</font></font></p>
</td>
<td width="79%" style="border:1px solid rgb(0,0,0);padding:0.04in">
<p><font face="Helmet"><font style="font-size:10pt">IP
address of the node responding. This is the address by which
GPFS knows the node.</font></font></p>
</td>
</tr>
</thead>
<tbody>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_nn_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">The
name by which GPFS knows the node. </font></font>
</p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_rc_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">The
reason/error code. In this case, the reply value is <font face="Courier, monospace"><font style="font-size:12pt">0
</font></font>(OK). </font></font>
</p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_t_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Current
time of day in seconds (absolute seconds since Epoch (1970)).</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_tu_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Microseconds
part of the current time of day.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_cl_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">The
name of the cluster that owns the file system.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_fs_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">The
name of the file system for which data are being presented.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_d_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">The
number of disks in the <span lang="en-US">file system.</span></font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_br_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Total
number of bytes read from disk (not counting those read from
cache.)</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_bw_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Total
number of bytes written, to both disk and cache.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_c_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">The
total number of read operations supplied from cache.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_r_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">The
total number of read operations supplied from disk.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_w_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">The
total number of write operations, to both disk and cache.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_oc_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Count
of open() call requests serviced by GPFS.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_cc_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Number
of close() call requests serviced by GPFS.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_rdc_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Number
of application read <span lang="en-US">requests</span> serviced
by GPFS. </font></font>
</p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_wc_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Number
of application write requests serviced by GPFS.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_dir_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Number
of readdir() call requests serviced by GPFS.</font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">_iu_</font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font face="Helmet"><font style="font-size:10pt">Number
of inode updates to disk. </font></font>
</p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">_irc_</font></font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">Number
of inode reads.</font></font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">_idc_</font></font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">Number
of inode deletions.</font></font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">_icc_</font></font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">Number
of inode creations.</font></font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">_bc_</font></font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">Number
of bytes read from the cache. </font></font></font>
</p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">_sch_</font></font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">Number
of stat cache hits.</font></font></font></p>
</td>
</tr>
<tr valign="top">
<td width="21%" style="border-style:none none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);padding:0in 0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">_scm_</font></font></font></p>
</td>
<td width="79%" style="border-style:none solid solid;border-bottom-width:1px;border-bottom-color:rgb(0,0,0);border-left-width:1px;border-left-color:rgb(0,0,0);border-right-width:1px;border-right-color:rgb(0,0,0);padding:0in 0.04in 0.04in">
<p><font color="#ff0000"><font face="Helmet"><font style="font-size:10pt">Number
of stat cache misses.</font></font></font></p>
</td>
</tr>
</tbody>
</table></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Jul 7, 2016 at 7:09 PM, Aaron Knister <span dir="ltr"><<a href="mailto:aaron.s.knister@nasa.gov" target="_blank">aaron.s.knister@nasa.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Does anyone know what the fields in the mmpmon gfis output indicate?<br>
<br>
# socat /var/mmfs/mmpmon/mmpmonSocket -<br>
_event_ newconnection _t_ 1467937547 _tu_ 372882 _n_ 10.101.11.1 _node_ local_node<br>
mmpmon gfis<br>
_response_ begin mmpmon gfis<br>
_mmpmon::gfis_ _n_ 10.101.11.1 _nn_ lorej001 _rc_ 0 _t_ 1467937550 _tu_ 518265 _cl_ disguise-gpfs _fs_ thome _d_ 5 _br_ 0 _bw_ 0 _c_ 0 _r_ 0 _w_ 0 _oc_ 0 _cc_ 0 _rdc_ 0 _wc_ 0 _dir_ 0 _iu_ 0 _irc_<br>
<br>
<br>
Here's my best guess:<br>
<br>
_d_ number of disks in the filesystem<br>
_br_ bytes read from disk<br>
_bw_ bytes written to disk<br>
_c_ cache ops<br>
_r_ read ops<br>
_w_ write ops<br>
_oc_ open() calls<br>
_cc_ close() calls<br>
_rdc_ read() calls<br>
_wc_ write() calls<br>
_dir_ readdir calls<br>
_iu_ inode update count<br>
_irc_ inode read count<br>
_idc_ inode delete count<br>
_icc_ inode create count<br>
_bc_ bytes read from cache<br>
_sch_ stat cache hits<br>
_scm_ stat cache misses<br>
<br>
This is all because the mmpmon fs_io_s command doesn't give me a way that I can find to distinguish block/stat cache hits from cache misses which makes it harder to pinpoint misbehaving applications on the system.<span class="HOEnZb"><font color="#888888"><br>
<br>
-Aaron<br>
<br>
-- <br>
Aaron Knister<br>
NASA Center for Climate Simulation (Code 606.2)<br>
Goddard Space Flight Center<br>
<a href="tel:%28301%29%20286-2776" value="+13012862776" target="_blank">(301) 286-2776</a><br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" rel="noreferrer" target="_blank">spectrumscale.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br>
</font></span></blockquote></div><br></div>