<html><body><p><font size="2">Kristy,</font><br><br><font size="2">I experimented a bit with this some months ago and looked at the ZIMon source code. I came to the conclusion that ZIMon is reporting values obtained from the IB counters (actually, delta values adjusted for time) and that yes, for port_xmit_data and port_rcv_data, one would need to multiply the values by 4 to make sense of them.</font><br><br><font size="2">To obtain a port_xmit_data value, the ZIMon sensor first looks for /sys/class/infiniband/<ibdev>/ports/<port>/counters_ext/port_xmit_data_64, and if that is not found then looks for /sys/class/infiniband/<ibdev>/ports/<port>/counters/port_xmit_data. Similarly for other counters/metrics.</font><br><br><font size="2">Full disclosure: I am not an IB expert nor a ZIMon developer.</font><br><br><font size="2">I hope this helps.</font><br><font size="2"><br><br>Eric M. Agar<br>agar@us.ibm.com<br></font><br><br><img width="16" height="16" src="cid:1__=0ABB08A6DFCD836B8f9e8a93df938690918c0AB@" border="0" alt="Inactive hide details for Kristy Kallback-Rose ---02/14/2018 08:47:59 PM---Hi, Can one of the IBMers tell me if port_xmit_data"><font size="2" color="#424282">Kristy Kallback-Rose ---02/14/2018 08:47:59 PM---Hi, Can one of the IBMers tell me if port_xmit_data and port_rcv_data from Zimon can be interpreted</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">Kristy Kallback-Rose <kkr@lbl.gov></font><br><font size="2" color="#5F5F5F">To: </font><font size="2">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">02/14/2018 08:47 PM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">[gpfsug-discuss] RDMA data from Zimon</font><br><font size="2" color="#5F5F5F">Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br>Hi,<br><br>Can one of the IBMers tell me if port_xmit_data and port_rcv_data from Zimon can be interpreted as RDMA Bytes/sec? Ideally, also how this data is being collected? I’m looking here: <a href="https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1hlp_monnetworksmetrics.htm"><u><font color="#0000FF">https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1hlp_monnetworksmetrics.htm</font></u></a><br><br>But then I also look here: <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__community.mellanox.com_docs_DOC-2D2751&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=zIRb70L9sx_FvvC9IcWVKLOSOOFnx-hIGfjw0kUN7bw&s=ataLzjZMTIJfHxa5qXIwQdCTq09CQveIxYNnxJQ5pgs&e="><u><font color="#0000FF">https://community.mellanox.com/docs/DOC-2751</font></u></a><br><br>and see "Total number of data octets, divided by 4 (lanes), received on all VLs. This is 64 bit counter.” So I wasn’t sure if some multiplication by 4 was in order.<br><br>Please advise.<br><br>Cheers,<br>Kristy<tt><font size="2">_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><tt><font size="2"><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=zIRb70L9sx_FvvC9IcWVKLOSOOFnx-hIGfjw0kUN7bw&s=D1g4YTG5WeUiHI3rCPr_kkPxbG9V9E-18UGXBeCvfB8&e=">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=zIRb70L9sx_FvvC9IcWVKLOSOOFnx-hIGfjw0kUN7bw&s=D1g4YTG5WeUiHI3rCPr_kkPxbG9V9E-18UGXBeCvfB8&e=</a></font></tt><tt><font size="2"><br></font></tt><br><br><BR>
</body></html>