<span style=" font-size:10pt;font-family:sans-serif">Hi</span><br><br><span style=" font-size:10pt;font-family:sans-serif">Did u upgrade
OFED version in some of the servers to v5.x ?<br></span><br><span style=" font-size:9pt;font-family:Arial"> </span><br><span style=" font-size:10pt;font-family:Arial">Regards</span><br><span style=" font-size:9pt;font-family:Arial"> </span><br><table width=780 style="border-collapse:collapse;"><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><br><span style=" font-size:1pt;font-family:Arial"> </span><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:1pt;font-family:Arial"> </span><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:blue;font-family:Arial"><b>Yaron
Daniel</b></span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> 94
Em Ha'Moshavot Rd</span><td width=96 rowspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=right><img align=bottom src=cid:_1_11900BF81190066C0035D312C225870F style="border:0px solid;"></div><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:blue;font-family:Arial"><b>Lab
Services Consultant – Storage and Cloud</b></span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> Petach
Tiqva, 49527</span><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:blue;font-family:Arial"><b>IBM
Global Markets, Systems HW Sales</b></span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> Israel</span><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:blue;font-family:Arial"><b> </b></span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> </span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:9pt;font-family:Arial"> </span><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">Phone:</span><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">+972-3-916-5672</span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> </span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">Fax:</span><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">+972-3-916-5672</span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> 
</span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">Mobile:</span><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">+972-52-8395593</span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> 
</span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">e-mail:</span><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">yard@il.ibm.com</span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> 
</span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><a href="Webex:%20%20%20%20%20%20%20%20%20%20%20%20https://ibm.webex.com/meet/yard"><span style=" font-size:10pt;color:blue;font-family:Arial">Webex:           
</span><span style=" font-size:12pt;color:blue;font-family:Times New Roman"><u>https://ibm.webex.com/meet/yard</u></span></a><span style=" font-size:10pt;color:blue;font-family:Arial"><u><br></u></span><a href="Webex:%20%20%20%20%20%20%20%20%20%20%20%20%20https://ibm.webex.com/meet/yard%0dIBM%20Israel"><span style=" font-size:10pt;color:blue;font-family:Arial"><u>IBM
Israel</u></span></a><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial"> </span><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial"> </span></table><p style="margin-top:0px;margin-Bottom:0px"></p><br><span style=" font-size:12pt">  </span><br><span style=" font-size:12pt"> </span><img src=cid:_1_1191B20C1191ADF40035D312C225870F alt="Lab Services Consultant: Storage" style="border:0px solid;"><img src=cid:_2_1191B4181191ADF40035D312C225870F alt="No alt text provided for this image" style="border:0px solid;"><br><br><br><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">From:
       </span><span style=" font-size:9pt;font-family:sans-serif">"Wahl,
Edward" <ewahl@osc.edu></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">To:
       </span><span style=" font-size:9pt;font-family:sans-serif">"gpfsug
main discussion list" <gpfsug-discuss@spectrumscale.org></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Date:
       </span><span style=" font-size:9pt;font-family:sans-serif">07/09/2021
10:21 PM</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Subject:
       </span><span style=" font-size:9pt;font-family:sans-serif">[EXTERNAL]
Re: [gpfsug-discuss] RDMA write error IBV_WC_RETRY_EXC_ERR</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Sent
by:        </span><span style=" font-size:9pt;font-family:sans-serif">gpfsug-discuss-bounces@spectrumscale.org</span><br><hr noshade><br><br><br><tt><span style=" font-size:10pt">>-E- Link: ib2s5/U1/P6<-->node152/U1/P1
- Unexpected actual link speed 10<br><br>This looks like a bad cable (or port).   Trying re-seating the cable
on both ends, or replacing it to get to full Link Speed.<br>Re-run ibdiagnet to confirm or use something like 'ibportstate' to check
it.<br><br>Ed Wahl<br>OSC<br><br><br>-----Original Message-----<br>From: gpfsug-discuss-bounces@spectrumscale.org <gpfsug-discuss-bounces@spectrumscale.org>
On Behalf Of Iban Cabrillo<br>Sent: Friday, July 9, 2021 11:57 AM<br>To: gpfsug-discuss <gpfsug-discuss@spectrumscale.org><br>Subject: Re: [gpfsug-discuss] RDMA write error IBV_WC_RETRY_EXC_ERR<br><br>Thanks both of you, for your fast answer,<br><br>   I just restart the server with the biggest waiters, and seems that
every thing is working now<br><br>   Using de ib diag command I see these errors:<br><br>   -E- lid=0x0380 dev=4115 gpfs03/U1/P1<br>        Performance Monitor counter      
  : Value     <br>        port_xmit_discard        
          : 65535      (overflow)<br>-E- lid=0x0ed0 dev=4115 gpfs01/U2/P1<br>        Performance Monitor counter      
  : Value     <br>        port_xmit_discard        
          : 65535      (overflow)<br>......<br>-E- Link: ib2s5/U1/P6<-->node152/U1/P1 - Unexpected actual link speed
10 (enable_speed1="2.5 or 5 or 10 or FDR10", enable_speed2="2.5
or 5 or 10 or FDR10" ther efore final speed should be FDR10)<br><br>Regards, I<br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></span></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><span style=" font-size:10pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><tt><span style=" font-size:10pt"><br></span></tt><br><br><BR>
<BR>