[gpfsug-discuss] RDMA write error IBV_WC_RETRY_EXC_ERR

[Yaron Daniel]

Hi

Did u upgrade OFED version in some of the servers to v5.x ?

 
Regards
 


 
 
Yaron Daniel
 94 Em Ha'Moshavot Rd

Lab Services Consultant – Storage and Cloud
 Petach Tiqva, 49527
IBM Global Markets, Systems HW Sales
 Israel
 
 
 
Phone:
+972-3-916-5672
 
 
Fax:
+972-3-916-5672
 
 
Mobile:
+972-52-8395593
 
 
e-mail:
yard at il.ibm.com
 
 
Webex:            https://ibm.webex.com/meet/yard
IBM Israel

 
 
 

  
 



From:   "Wahl, Edward" <ewahl at osc.edu>
To:     "gpfsug main discussion list" <gpfsug-discuss at spectrumscale.org>
Date:   07/09/2021 10:21 PM
Subject:        [EXTERNAL] Re: [gpfsug-discuss] RDMA write error 
IBV_WC_RETRY_EXC_ERR
Sent by:        gpfsug-discuss-bounces at spectrumscale.org



>-E- Link: ib2s5/U1/P6<-->node152/U1/P1 - Unexpected actual link speed 10

This looks like a bad cable (or port).   Trying re-seating the cable on 
both ends, or replacing it to get to full Link Speed.
Re-run ibdiagnet to confirm or use something like 'ibportstate' to check 
it.

Ed Wahl
OSC


-----Original Message-----
From: gpfsug-discuss-bounces at spectrumscale.org 
<gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of Iban Cabrillo
Sent: Friday, July 9, 2021 11:57 AM
To: gpfsug-discuss <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] RDMA write error IBV_WC_RETRY_EXC_ERR

Thanks both of you, for your fast answer,

   I just restart the server with the biggest waiters, and seems that 
every thing is working now

   Using de ib diag command I see these errors:

   -E- lid=0x0380 dev=4115 gpfs03/U1/P1
        Performance Monitor counter         : Value 
        port_xmit_discard                   : 65535      (overflow)
-E- lid=0x0ed0 dev=4115 gpfs01/U2/P1
        Performance Monitor counter         : Value 
        port_xmit_discard                   : 65535      (overflow)
......
-E- Link: ib2s5/U1/P6<-->node152/U1/P1 - Unexpected actual link speed 10 
(enable_speed1="2.5 or 5 or 10 or FDR10", enable_speed2="2.5 or 5 or 10 or 
FDR10" ther efore final speed should be FDR10)

Regards, I
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss 





-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20210711/b551b0de/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1114 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20210711/b551b0de/attachment-0004.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 8361 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20210711/b551b0de/attachment-0005.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/jpeg
Size: 5211 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20210711/b551b0de/attachment-0002.jpe>