<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Thanks Eric. No one who is a ZIMon developer has jumped up to contradict this, so I’ll go with it :-)<div class=""><br class=""></div><div class="">Many thanks. This is helpful to understand where the data is coming from and would be a welcome addition to the documentation.</div><div class=""><br class=""></div><div class="">Cheers,</div><div class="">Kristy<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Feb 15, 2018, at 9:08 AM, Eric Agar <<a href="mailto:agar@us.ibm.com" class="">agar@us.ibm.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class=""><p class=""><font size="2" class="">Kristy,</font><br class=""><br class=""><font size="2" class="">I experimented a bit with this some months ago and looked at the ZIMon source code. I came to the conclusion that ZIMon is reporting values obtained from the IB counters (actually, delta values adjusted for time) and that yes, for port_xmit_data and port_rcv_data, one would need to multiply the values by 4 to make sense of them.</font><br class=""><br class=""><font size="2" class="">To obtain a port_xmit_data value, the ZIMon sensor first looks for /sys/class/infiniband/<ibdev>/ports/<port>/counters_ext/port_xmit_data_64, and if that is not found then looks for /sys/class/infiniband/<ibdev>/ports/<port>/counters/port_xmit_data. Similarly for other counters/metrics.</font><br class=""><br class=""><font size="2" class="">Full disclosure: I am not an IB expert nor a ZIMon developer.</font><br class=""><br class=""><font size="2" class="">I hope this helps.</font><br class=""><font size="2" class=""><br class=""><br class="">Eric M. Agar<br class=""><a href="mailto:agar@us.ibm.com" class="">agar@us.ibm.com</a><br class=""></font><br class=""><br class=""><span id="cid:1__=0ABB08A6DFCD836B8f9e8a93df938690918c0AB@"><graycol.gif></span><font size="2" color="#424282" class="">Kristy Kallback-Rose ---02/14/2018 08:47:59 PM---Hi, Can one of the IBMers tell me if port_xmit_data and port_rcv_data from Zimon can be interpreted</font><br class=""><br class=""><font size="2" color="#5F5F5F" class="">From: </font><font size="2" class="">Kristy Kallback-Rose <<a href="mailto:kkr@lbl.gov" class="">kkr@lbl.gov</a>></font><br class=""><font size="2" color="#5F5F5F" class="">To: </font><font size="2" class="">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" class="">gpfsug-discuss@spectrumscale.org</a>></font><br class=""><font size="2" color="#5F5F5F" class="">Date: </font><font size="2" class="">02/14/2018 08:47 PM</font><br class=""><font size="2" color="#5F5F5F" class="">Subject: </font><font size="2" class="">[gpfsug-discuss] RDMA data from Zimon</font><br class=""><font size="2" color="#5F5F5F" class="">Sent by: </font><font size="2" class=""><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" class="">gpfsug-discuss-bounces@spectrumscale.org</a></font><br class=""></p><hr width="100%" size="2" align="left" noshade="" style="color:#8091A5; " class=""><br class=""><br class=""><br class="">Hi,<br class=""><br class="">Can one of the IBMers tell me if port_xmit_data and port_rcv_data from Zimon can be interpreted as RDMA Bytes/sec? Ideally, also how this data is being collected? I’m looking here: <a href="https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1hlp_monnetworksmetrics.htm" class=""><u class=""><font color="#0000FF" class="">https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1hlp_monnetworksmetrics.htm</font></u></a><br class=""><br class="">But then I also look here: <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__community.mellanox.com_docs_DOC-2D2751&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=zIRb70L9sx_FvvC9IcWVKLOSOOFnx-hIGfjw0kUN7bw&s=ataLzjZMTIJfHxa5qXIwQdCTq09CQveIxYNnxJQ5pgs&e=" class=""><u class=""><font color="#0000FF" class="">https://community.mellanox.com/docs/DOC-2751</font></u></a><br class=""><br class="">and see "Total number of data octets, divided by 4 (lanes), received on all VLs. This is 64 bit counter.” So I wasn’t sure if some multiplication by 4 was in order.<br class=""><br class="">Please advise.<br class=""><br class="">Cheers,<br class="">Kristy<tt class=""><font size="2" class="">_______________________________________________<br class="">gpfsug-discuss mailing list<br class="">gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class=""></font></tt><tt class=""><font size="2" class=""><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=zIRb70L9sx_FvvC9IcWVKLOSOOFnx-hIGfjw0kUN7bw&s=D1g4YTG5WeUiHI3rCPr_kkPxbG9V9E-18UGXBeCvfB8&e=" class="">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=zIRb70L9sx_FvvC9IcWVKLOSOOFnx-hIGfjw0kUN7bw&s=D1g4YTG5WeUiHI3rCPr_kkPxbG9V9E-18UGXBeCvfB8&e=</a></font></tt><tt class=""><font size="2" class=""><br class=""></font></tt><br class=""><br class=""><br class="">
</div>
_______________________________________________<br class="">gpfsug-discuss mailing list<br class="">gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br class=""></div></blockquote></div><br class=""></div></body></html>