[gpfsug-discuss] Infiniband Quality of Service settings?

[John Hearns]

Having the bad manners to answer my own question:

Example
If you define a service level of 2 for GPFS in the InfiniBand
subnet manager set verbsRdmaQpRtrSl to 2.

mmchconfig verbsRdmaQpRtrSl=2

I guess though that I still need the service ID to set the Service Level in qos-policy.conf





From: gpfsug-discuss-bounces at spectrumscale.org [mailto:gpfsug-discuss-bounces at spectrumscale.org] On Behalf Of John Hearns
Sent: Tuesday, June 13, 2017 3:37 PM
To: gpfsug main discussion list
Subject: [gpfsug-discuss] Infiniband Quality of Service settings?

I am investigating setting up Quality of Service parameters on an Infiniband fabric.
The specific goal is to reduce the bandwidth which certain servers can use,
ie if there are untested or development codes running on these servers in our cluster then they cannot
adversely affect production users.
I hope I do not show too much of my ignorance here.

Perhaps out of date, but I find that Lustre does have a facility for setting the port range and hence associating with an ULP in Infiniband
http://www.spinics.net/lists/linux-rdma/msg02150.html<https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.spinics.net%2Flists%2Flinux-rdma%2Fmsg02150.html&data=01%7C01%7Cjohn.hearns%40asml.com%7C749677dab06c40e19a7208d4b26135b1%7Caf73baa8f5944eb2a39d93e96cad61fc%7C1&sdata=DHXnsw%2F8MPuwjYc5bNF558Ks6Z%2B7x%2FeKBZd3G27Db8A%3D&reserved=0>
https://community.mellanox.com/thread/3660<https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcommunity.mellanox.com%2Fthread%2F3660&data=01%7C01%7Cjohn.hearns%40asml.com%7C749677dab06c40e19a7208d4b26135b1%7Caf73baa8f5944eb2a39d93e96cad61fc%7C1&sdata=Feb0nG5KrN%2BXKGqmwdYRhD7XxudCW2u1rp%2FvVEM1Yao%3D&reserved=0>
(There. I said the L word. Is a quick soaping to the mouth needed?)

Can anyone comment what the Infiniband Service ID for GPFS traffic is please?
If the answer is blindingly obvious and is displayed by a Bat signal in the clouds above every datacenter containing
GPFS then I am suitably apologetic. If it is buried in a footnote in a Redbook then a bit less apologetic.

If you are familiar with Appendix A of the IBTA Architecture Release then it is truly a joy.

-- The information contained in this communication and any attachments is confidential and may be privileged, and is for the sole use of the intended recipient(s). Any unauthorized review, use, disclosure or distribution is prohibited. Unless explicitly stated otherwise in the body of this communication or the attachment thereto (if any), the information is provided on an AS-IS basis without any express or implied warranties or liabilities. To the extent you are relying on this information, you are doing so at your own risk. If you are not the intended recipient, please notify the sender immediately by replying to this message and destroy all copies of this message and any attachments. Neither the sender nor the company/group of companies he or she represents shall be liable for the proper and complete transmission of the information contained in this communication, or for any delay in its receipt.
-- The information contained in this communication and any attachments is confidential and may be privileged, and is for the sole use of the intended recipient(s). Any unauthorized review, use, disclosure or distribution is prohibited. Unless explicitly stated otherwise in the body of this communication or the attachment thereto (if any), the information is provided on an AS-IS basis without any express or implied warranties or liabilities. To the extent you are relying on this information, you are doing so at your own risk. If you are not the intended recipient, please notify the sender immediately by replying to this message and destroy all copies of this message and any attachments. Neither the sender nor the company/group of companies he or she represents shall be liable for the proper and complete transmission of the information contained in this communication, or for any delay in its receipt.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20170613/d1c12933/attachment-0002.htm>