[gpfsug-discuss] RDMA write error IBV_WC_RETRY_EXC_ERR

Wahl, Edward ewahl at osc.edu
Fri Jul 9 19:30:51 BST 2021


>-E- Link: ib2s5/U1/P6<-->node152/U1/P1 - Unexpected actual link speed 10

This looks like a bad cable (or port).   Trying re-seating the cable on both ends, or replacing it to get to full Link Speed.
Re-run ibdiagnet to confirm or use something like 'ibportstate' to check it.

Ed Wahl
OSC


-----Original Message-----
From: gpfsug-discuss-bounces at spectrumscale.org <gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of Iban Cabrillo
Sent: Friday, July 9, 2021 11:57 AM
To: gpfsug-discuss <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] RDMA write error IBV_WC_RETRY_EXC_ERR

Thanks both of you, for your fast answer,

   I just restart the server with the biggest waiters, and seems that every thing is working now

   Using de ib diag command I see these errors:

   -E- lid=0x0380 dev=4115 gpfs03/U1/P1
        Performance Monitor counter         : Value     
        port_xmit_discard                   : 65535      (overflow)
-E- lid=0x0ed0 dev=4115 gpfs01/U2/P1
        Performance Monitor counter         : Value     
        port_xmit_discard                   : 65535      (overflow)
......
-E- Link: ib2s5/U1/P6<-->node152/U1/P1 - Unexpected actual link speed 10 (enable_speed1="2.5 or 5 or 10 or FDR10", enable_speed2="2.5 or 5 or 10 or FDR10" ther efore final speed should be FDR10)

Regards, I


More information about the gpfsug-discuss mailing list