<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns:mv="http://macVmlSchemaUri" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Title" content="">
<meta name="Keywords" content="">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Courier New";
panose-1:2 7 3 9 2 2 5 2 4 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:sans-serif;
panose-1:0 0 0 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
tt
{mso-style-priority:99;
font-family:"Courier New",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.msoIns
{mso-style-type:export-only;
mso-style-name:"";
text-decoration:underline;
color:teal;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body bgcolor="white" lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Can you tell me how LROC plays into this? I’m trying to understand if the difference between gpfs_ns_bytes_read and gpfs_is_bytes_read on a cluster-wide basis reflects the amount of data that is recalled from pagepool+LROC (assuming the
majority of the nodes have LROC.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Any insight on LROC stats would helpful as well.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><img width="823" height="277" id="Picture_x0020_1" src="cid:image001.png@01D2E3A4.63CEE1D0"><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Bob Oesterlin<br>
Sr Principal Storage Engineer, Nuance<br>
507-269-0413<o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Times New Roman",serif"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black"><gpfsug-discuss-bounces@spectrumscale.org> on behalf of IBM Spectrum Scale <scale@us.ibm.com><br>
<b>Reply-To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Date: </b>Monday, June 12, 2017 at 4:01 PM<br>
<b>To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject: </b>[EXTERNAL] Re: [gpfsug-discuss] Meaning of API Stats Category<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"sans-serif",serif">Hello Kristy,</span>
<br>
<br>
<span style="font-size:10.0pt;font-family:"sans-serif",serif">The GPFSFileSystemAPI and GPFSNodeAPI sensor metrics are from the point of view of "applications" in the sense that they provide stats about I/O requests made to files in GPFS file systems from user
level applications using POSIX interfaces like open(), close(), read(), write(), etc.</span>
<br>
<br>
<span style="font-size:10.0pt;font-family:"sans-serif",serif">This is in contrast to similarly named sensors without the "API" suffix, like GPFSFilesystem and GPFSNode. Those sensors provide stats about I/O requests made by the GPFS code to NSDs (disks) making
up GPFS file systems.</span> <br>
<br>
<span style="font-size:10.0pt;font-family:"sans-serif",serif">The relationship between application I/O and disk I/O might or might not be obvious. Consider some examples. An application that starts sequentially reading a file might, at least initially, cause
more disk I/O than expected because GPFS has decided to prefetch data. An application write() might not immediately cause a the writing of disk blocks due to the operation of the pagepool. Ultimately, application write()s might cause twice as much data written
to disk due to the replication factor of the file system. Application I/O concerns itself with user data; disk I/O might have to occur to handle the user data and associated file system metadata (like inodes and indirect blocks).</span>
<br>
<br>
<span style="font-size:10.0pt;font-family:"sans-serif",serif">The difference between GPFSFileSystemAPI and GPFSNodeAPI: GPFSFileSystemAPI reports stats for application I/O per filesystem per node; GPFSNodeAPI reports application I/O stats per node. Similarly,
GPFSFilesystem reports stats for disk I/O per filesystem per node; GPFSNode reports disk I/O stats per node.</span>
<br>
<br>
<span style="font-size:10.0pt;font-family:"sans-serif",serif">I hope this helps.</span>
<br>
<span style="font-size:10.0pt;font-family:"sans-serif",serif">Eric Agar</span> <br>
<br>
<br>
<span style="font-size:10.0pt;font-family:"sans-serif",serif">Regards, The Spectrum Scale (GPFS) team<br>
<br>
------------------------------------------------------------------------------------------------------------------<br>
If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at
</span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ibm.com_developerworks_community_forums_html_forum-3Fid-3D11111111-2D0000-2D0000-2D0000-2D000000000479&d=DwMGaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=5sAByjnB2P9tv298gm9m1cJjOe9Sjm2TqyQYw-vXIDo&s=AkUR-geA0jejuYEiraffUNtNEXHMtZG6k-r-k1lEwpU&e="><span style="font-size:10.0pt;font-family:"sans-serif",serif">https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</span></a><span style="font-size:10.0pt;font-family:"sans-serif",serif">.
<br>
<br>
If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries.
<br>
<br>
The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.</span>
<br>
<br>
<br>
<br>
<span style="font-size:7.5pt;font-family:"sans-serif",serif;color:#5F5F5F">From: </span><span style="font-size:7.5pt;font-family:"sans-serif",serif">"Oesterlin, Robert" <Robert.Oesterlin@nuance.com></span>
<br>
<span style="font-size:7.5pt;font-family:"sans-serif",serif;color:#5F5F5F">To: </span><span style="font-size:7.5pt;font-family:"sans-serif",serif">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></span>
<br>
<span style="font-size:7.5pt;font-family:"sans-serif",serif;color:#5F5F5F">Date: </span><span style="font-size:7.5pt;font-family:"sans-serif",serif">06/12/2017 04:43 PM</span>
<br>
<span style="font-size:7.5pt;font-family:"sans-serif",serif;color:#5F5F5F">Subject: </span><span style="font-size:7.5pt;font-family:"sans-serif",serif">Re: [gpfsug-discuss] Meaning of API Stats Category</span>
<br>
<span style="font-size:7.5pt;font-family:"sans-serif",serif;color:#5F5F5F">Sent by: </span><span style="font-size:7.5pt;font-family:"sans-serif",serif">gpfsug-discuss-bounces@spectrumscale.org</span>
<o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" noshade="" style="color:#F0F0F0" align="center">
</div>
<p class="MsoNormal"><br>
<br>
<br>
<span style="font-size:10.0pt">Hi Kristy</span> <br>
<span style="font-size:10.0pt"> </span> <br>
<span style="font-size:10.0pt">What I *think* the difference is:</span> <br>
<span style="font-size:10.0pt"> </span> <br>
<span style="font-size:10.0pt">gpfs_fis: - calls to the GPFS file system interface</span>
<br>
<span style="font-size:10.0pt">gpfs_fs: calls from the node that actually make it to the NSD server/metadata</span>
<br>
<span style="font-size:10.0pt"> </span> <br>
<span style="font-size:10.0pt">The difference being what’s served out of the local node pagepool.</span>
<br>
<span style="font-size:10.0pt"> </span> <br>
<span style="font-size:10.0pt">Bob Oesterlin<br>
Sr Principal Storage Engineer, Nuance<br>
</span><br>
<span style="font-size:10.0pt"> </span> <br>
<b><span style="font-size:12.0pt">From: </span></b><span style="font-size:12.0pt"><gpfsug-discuss-bounces@spectrumscale.org> on behalf of Kristy Kallback-Rose <kkr@lbl.gov><b><br>
Reply-To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>
Date: </b>Monday, June 12, 2017 at 3:17 PM<b><br>
To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>
Subject: </b>[EXTERNAL] [gpfsug-discuss] Meaning of API Stats Category</span> <br>
<span style="font-size:10.0pt"> </span> <br>
<span style="font-size:10.0pt">Hi, </span><br>
<span style="font-size:10.0pt"> </span> <br>
<span style="font-size:10.0pt"> Can anyone provide more detail about what is meant by the following two categories of stats? The PDG has a limited description as far as I could see. I'm not sure what is meant by Application PoV. Would the Grafana bridge count
as an "application"?</span> <br>
<span style="font-size:10.0pt"> </span> <br>
<span style="font-size:10.0pt"> </span><tt><span style="font-size:10.0pt">_______________________________________________</span></tt><span style="font-size:10.0pt;font-family:"Courier New",serif"><br>
<tt>gpfsug-discuss mailing list</tt><br>
<tt>gpfsug-discuss at spectrumscale.org</tt><br>
</span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwMGaQ&c=djjh8EKwHtOepW4Bjau0lKhLlu-DxM1dlgP0rrLsOzY&r=LPDewt1Z4o9eKc86MXmhqX-45Cz1yz1ylYELF9olLKU&m=5sAByjnB2P9tv298gm9m1cJjOe9Sjm2TqyQYw-vXIDo&s=b65SdhLjucv9k789Livfsbk7DozTcQn6rCOB0zM21tE&e="><tt><span style="font-size:10.0pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><span style="font-size:10.0pt;font-family:"Courier New",serif"><br>
</span><br>
<br>
<br>
<o:p></o:p></p>
</div>
</body>
</html>