<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
tt
{mso-style-priority:99;
font-family:"Courier New";}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">I can’t help but comment that it’s amazing that GPFS is using a txt config file instead of requiring a command run that stores config data into a non-editable
(but still editable) flat file database… Wow 2018!!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Hahahahaha!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">-Bryan<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> gpfsug-discuss-bounces@spectrumscale.org [mailto:gpfsug-discuss-bounces@spectrumscale.org]
<b>On Behalf Of </b>Mathias Dietz<br>
<b>Sent:</b> Tuesday, January 09, 2018 3:44 AM<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject:</b> Re: [gpfsug-discuss] mmhealth with 4.2.3-5 gives many false alarms ib_rdma_nic_unrecognized<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><em><span style="font-size:8.5pt;font-family:"Verdana",sans-serif;color:#333333">Note: External Email</span></em><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" align="center">
</div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Hello Heiner,</span><br>
<br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">with 4.2.3-5 mmhealth is always monitoring all ports of a configured IB adapter even if the port is not specified in verbsPorts.
</span><br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">Development has implemented a fix which is planned to be part of 4.2.3-7 (February).</span><br>
<br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">To get rid of the false alarm in the meantime you could disable the Infiniband monitoring altogether.
</span><br>
<br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">To disable Infiniband monitoring on a node:</span><br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">1. Open the file /var/mmfs/mmsysmon/mmsysmonitor.conf</span><br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">2. Locate the<i> [network]</i>section
</span><br>
<span style="font-size:10.0pt;font-family:"Courier New"">3. Add below: <i>ib_rdma_enable_monitoring=False
</i></span><br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">4. Save file and run "<i>mmsysmoncontrol restart"</i></span><br>
<br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">If you have questions feel free to contact me directly by email.
</span><br>
<br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">Mit freundlichen Grüßen / Kind regards<br>
<br>
Mathias Dietz<br>
<br>
Spectrum Scale RAS Architect & Release Lead Architect (4.2.3/5.0)<br>
---------------------------------------------------------------------------<br>
IBM Deutschland<br>
Am Weiher 24<br>
65451 Kelsterbach<br>
Phone: +49 70342744105<br>
Mobile: +49-15152801035<br>
E-Mail: <a href="mailto:mdietz@de.ibm.com">mdietz@de.ibm.com</a><br>
-----------------------------------------------------------------------------<br>
IBM Deutschland Research & Development GmbH<br>
Vorsitzender des Aufsichtsrats: Martina Koederitz, Geschäftsführung: Dirk WittkoppSitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294</span><br>
<br>
<br>
<br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">From: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">"Billich Heinrich Rainer (PSI)" <<a href="mailto:heiner.billich@psi.ch">heiner.billich@psi.ch</a>></span><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">To: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a>></span><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Date: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">01/09/2018 09:31 AM</span><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Subject: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">[gpfsug-discuss] mmhealth with 4.2.3-5 gives many false alarms ib_rdma_nic_unrecognized</span><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Sent by: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif"><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a></span><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" noshade="" style="color:#A0A0A0" align="center">
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
<br>
<br>
<tt><span style="font-size:10.0pt">Hello,</span></tt><span style="font-size:10.0pt;font-family:"Courier New""><br>
<br>
<tt>I just upgraded to 4.2.3-5 and now see many failures ‘ib_rdma_nic_unrecognized’ in mmhealth, like</tt><br>
<br>
<br>
<tt>Component Status Status Change Reasons</tt><br>
<tt>------------------------------------------------------------------------------------------</tt><br>
<tt>NETWORK DEGRADED 2018-01-06 15:57:21 ib_rdma_nic_unrecognized(mlx4_0/1)</tt><br>
<tt> mlx4_0/1 FAILED 2018-01-06 15:57:21 ib_rdma_nic_unrecognized</tt><br>
<br>
<br>
<tt>I didn’t see this messages with 4.2.3-4. The relevant lines in /usr/lpp/mmfs/lib/mmsysmon/NetworkService.py changed between -4 and -5.</tt><br>
<br>
<tt>What seems to happen: I have Mellanox VPI cards with one port Infiniband and one port Ethernet. mmhealth complains about the Ethernet port. Hmm – I did specify the active Infiniband ports only in verbsPorts, I don’t see why mmhealth cares about any other
ports when it checks RDMA.</tt><br>
<br>
<tt>So probably a bug, I’ll open a PMR unless somebody points me to a different solution. I tried but I can’t hide this event in mmhealth.</tt><br>
<br>
<tt>Cheers,</tt><br>
<tt>Heiner</tt><br>
<br>
<tt>--</tt><br>
<tt>Paul Scherrer Institut</tt><br>
<tt>Science IT</tt><br>
<tt>Heiner Billich</tt><br>
<tt>WHGA 106</tt><br>
<tt>CH 5232 Villigen PSI</tt><br>
<tt>056 310 36 02</tt><br>
</span><a href="https://www.psi.ch/"><tt><span style="font-size:10.0pt">https://www.psi.ch</span></tt></a><span style="font-size:10.0pt;font-family:"Courier New""><br>
<br>
<br>
<br>
<br>
<br>
<tt>_______________________________________________</tt><br>
<tt>gpfsug-discuss mailing list</tt><br>
<tt>gpfsug-discuss at spectrumscale.org</tt><br>
</span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><span style="font-size:10.0pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><span style="font-size:10.0pt;font-family:"Courier New""><br>
</span><br>
<br>
<o:p></o:p></p>
</div>
<br>
<hr>
<font face="Arial" color="Gray" size="1"><br>
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this
email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness
or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial
product.<br>
</font>
</body>
</html>