<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div dir="ltr" >Matthias,</div>
<div dir="ltr" > </div>
<div dir="ltr" >If you are only using 2 nodes you need to use tie breaker disks,</div>
<div dir="ltr" >other wise as per Aaron's comment to avoid split brain scenarios you need to have a minimum of 3 nodes to validate</div>
<div dir="ltr" ><font size="2" face="Default Monospace,Courier New,Courier,monospace" >(n/2+1) quorum nodes </font></div>
<div dir="ltr" > </div>
<div dir="ltr" ><font size="2" face="Default Monospace,Courier New,Courier,monospace" >Can you create a 3rd node as a virtual server and apply the role of quorum, to it, it also becomes useful as a gui server / management server?</font></div>
<div dir="ltr" > </div>
<div dir="ltr" ><font size="2" face="Default Monospace,Courier New,Courier,monospace" >regards,</font></div>
<div dir="ltr" ><div dir="ltr" style="font-family:Arial;font-size:10.5pt" ><div dir="ltr" style="font-family:Arial;font-size:10.5pt" ><div dir="ltr" style="font-family:Arial;font-size:10.5pt" ><div dir="ltr" style="margin-top: 20px;" ><div style="font-size: 12pt; font-weight: bold; font-family: sans-serif; color: #7C7C5F;" >Andrew Beattie</div>
<div style="font-size: 10pt; font-weight: bold; font-family: sans-serif;" >Software Defined Storage - IT Specialist</div>
<div style="font-size: 8pt; font-family: sans-serif; margin-top: 10px;" ><div><span style="font-weight: bold; color: #336699;" >Phone: </span>614-2133-7927</div>
<div><span style="font-weight: bold; color: #336699;" >E-mail: </span><a href="mailto:abeattie@au1.ibm.com" style="color: #555" target="_blank">abeattie@au1.ibm.com</a></div></div></div></div></div></div></div>
<div dir="ltr" > </div>
<div dir="ltr" > </div>
<blockquote data-history-content-modified="1" dir="ltr" style="border-left:solid #aaaaaa 2px; margin-left:5px; padding-left:5px; direction:ltr; margin-right:0px" >----- Original message -----<br>From: Matthias Knigge <Matthias.Knigge@rohde-schwarz.com><br>Sent by: gpfsug-discuss-bounces@spectrumscale.org<br>To: gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>Cc:<br>Subject: Re: [gpfsug-discuss] [Newsletter] Re: Problem with mmlscluster and callback scripts<br>Date: Mon, Sep 10, 2018 9:21 PM<br> <br><!--Notes ACF
<meta http-equiv="Content-Type" content="text/html; charset=utf8" >--> <!--[if !mso]><style></style><![endif]--><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit" >
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div><p><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D;mso-fareast-language:EN-US" >Hi Fred,<o:p></o:p></span></p>
<p><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D;mso-fareast-language:EN-US" ><o:p> </o:p></span></p>
<p><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D;mso-fareast-language:EN-US" lang="EN-US" >I have the same problem with the version 5.0.1.0.<o:p></o:p></span></p>
<p><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D;mso-fareast-language:EN-US" lang="EN-US" ><o:p> </o:p></span></p>
<p><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D;mso-fareast-language:EN-US" lang="EN-US" >Thanks,<o:p></o:p></span></p>
<p><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D;mso-fareast-language:EN-US" lang="EN-US" >Matthias<o:p></o:p></span></p>
<p><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D;mso-fareast-language:EN-US" lang="EN-US" ><o:p> </o:p></span></p>
<p><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D;mso-fareast-language:EN-US" lang="EN-US" ><o:p> </o:p></span></p>
<p><span style="font-size:10.0pt;font-family:"Helv",sans-serif;color:black" lang="EN-US" >Best Regards<br><br>Matthias Knigge<br>R&D File Based Media Solutions<br><br>Rohde & Schwarz<br>GmbH & Co. KG<br>Hanomaghof 1<br>30449 Hannover<br>Telefon +49 511 67 80 7 213<br>Fax +49 511 37 19 74<br>Internet: Matthias.Knigge@rohde-schwarz.com<br>------------------------------------------------------------<br>Geschäftsführung / Executive Board: Christian Leicher (Vorsitzender / Chairman), Peter Riedel, Sitz der Gesellschaft / Company's Place of Business: München, Registereintrag / Commercial Register No.: HRA 16 270, Persönlich haftender Gesellschafter / Personally Liable Partner: RUSEG Verwaltungs-GmbH, Sitz der Gesellschaft / Company's Place of Business: München, Registereintrag / Commercial Register No.: HRB 7 534, Umsatzsteuer-Identifikationsnummer (USt-IdNr.) / VAT Identification No.: DE 130 256 683, Elektro-Altgeräte Register (EAR) / WEEE Register No.: DE 240 437 86</span><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D" lang="EN-US" ><o:p></o:p></span></p>
<p><span style="font-size:11.0pt;font-family:"Arial",sans-serif;color:#1F497D;mso-fareast-language:EN-US" lang="EN-US" ><o:p> </o:p></span></p>
<p><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" >From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" > gpfsug-discuss-bounces@spectrumscale.org <gpfsug-discuss-bounces@spectrumscale.org> <b>On Behalf Of </b>Frederick Stock<br><b>Sent:</b> Friday, September 07, 2018 3:20 PM<br><b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br><b>Subject:</b> *EXT* [Newsletter] Re: [gpfsug-discuss] Problem with mmlscluster and callback scripts<o:p></o:p></span></p>
<p><o:p> </o:p></p>
<p style="margin-bottom:6.0pt;line-height:112%" ><span style="font-family:"Arial",sans-serif" >Are you really running version 5.0.2? If so then I presume you have a beta version since it has not yet been released. For beta problems there is a specific feedback mechanism that should be used to report problems.</span><br><br><span style="font-family:"Arial",sans-serif" >Fred<br>__________________________________________________<br>Fred Stock | IBM Pittsburgh Lab | 720-430-8821<br><a href="mailto:stockf@us.ibm.com" target="_blank">stockf@us.ibm.com</a></span><br><br><br><br><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif;color:#5F5F5F" >From: </span><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif" >Matthias Knigge <<a href="mailto:Matthias.Knigge@rohde-schwarz.com" target="_blank">Matthias.Knigge@rohde-schwarz.com</a>></span><br><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif;color:#5F5F5F" >To: </span><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif" >"<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a>" <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a>></span><br><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif;color:#5F5F5F" >Date: </span><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif" >09/07/2018 08:08 AM</span><br><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif;color:#5F5F5F" >Subject: </span><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif" >[gpfsug-discuss] Problem with mmlscluster and callback scripts</span><br><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif;color:#5F5F5F" >Sent by: </span><span style="font-size:7.5pt;line-height:112%;font-family:"Arial",sans-serif" ><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectrumscale.org</a></span><o:p></o:p></p>
<div style="margin-bottom:6.0pt;text-align:center;line-height:112%" align="center" ><hr style="color:#A0A0A0" width="100%" size="2" noshade="noshade" align="center" ></div>
<p style="margin-bottom:12.0pt;line-height:112%" ><br><br><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >Hello together,</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >I am using the version 5.0.2.0 of GPFS and have problems with the command mmlscluster and callback-scripts. It is a small cluster of two nodes only. If I shutdown one of the nodes sometimes mmlscluster reports the following output:</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >[root@gpfs-tier1 gpfs5.2]# mmgetstate</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >Node number Node name GPFS state</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >-------------------------------------------</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > 1 gpfs-tier1 arbitrating</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >[root@gpfs-tier1 gpfs5.2]# mmlscluster</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >ssh: connect to host gpfs-tier2 port 22: No route to host</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >mmlscluster: Unable to retrieve GPFS cluster files from node gpfs-tier2</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >mmlscluster: Command failed. Examine previous error messages to determine cause.</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >Normally the output is like this:</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >[root@gpfs-tier1 gpfs5.2]# mmlscluster</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >GPFS cluster information</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >========================</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > GPFS cluster name: TIERCLUSTER.gpfs-tier1</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > GPFS cluster id: 12458173498278694815</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > GPFS UID domain: TIERCLUSTER.gpfs-tier1</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > Remote shell command: /usr/bin/ssh</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > Remote file copy command: /usr/bin/scp</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > Repository type: server-based</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >GPFS cluster configuration servers:</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >-----------------------------------</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > Primary server: gpfs-tier2</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > Secondary server: gpfs-tier1</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >Node Daemon node name IP address Admin node name Designation</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >----------------------------------------------------------------------</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > 1 gpfs-tier1 192.168.178.10 gpfs-tier1 quorum-manager</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > 2 gpfs-tier2 192.168.178.11 gpfs-tier2 quorum-manager</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >[root@gpfs-tier1 gpfs5.2]# mmlscallback</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >NodeDownCallback</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > command = /var/mmfs/rs/nodedown.ksh</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > priority = 1</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > event = quorumNodeLeave</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > parms = %eventNode %quorumNodes</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >NodeUpCallback</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > command = /var/mmfs/rs/nodeup.ksh</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > priority = 1</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > event = quorumNodeJoin</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > parms = %eventNode %quorumNodes</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >If I shutdown the filesystem via mmshutdown the callback script works but if I shutdown the whole node the scripts does not run.</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >The latest log-entry in mmfs.log.latest shows only this information:</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >2018-09-07_13:12:36.724+0200: [I] Cluster Manager connection broke. Probing cluster TIERCLUSTER.gpfs-tier1</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >2018-09-07_13:12:37.226+0200: [E] Unable to contact enough other quorum nodes during cluster probe.</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >2018-09-07_13:12:37.226+0200: [E] Lost membership in cluster TIERCLUSTER.gpfs-tier1. Unmounting file systems.</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >2018-09-07_13:12:38.448+0200: [N] Connecting to 192.168.178.11 gpfs-tier2 <c0p1></span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >Could anybody help me in this case? I want to try to start a script if one node goes down or up to change the roles for starting the filesystem. The callback event NodeLeave and NodeJoin do not run too.</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >Any more information required? If yes, please let me know!</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >Many thanks in advance and a nice weekend!</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >Matthias</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" >Best Regards<br><br>Matthias Knigge<br>R&D File Based Media Solutions<br><br>Rohde & Schwarz<br>GmbH & Co. KG<br>Hanomaghof 1<br>30449 Hannover<br>Telefon +49 511 67 80 7 213<br>Fax +49 511 37 19 74<br>Internet: <a href="mailto:Matthias.Knigge@rohde-schwarz.com" target="_blank">Matthias.Knigge@rohde-schwarz.com</a><br>------------------------------------------------------------<br>Geschäftsführung / Executive Board: Christian Leicher (Vorsitzender / Chairman), Peter Riedel, Sitz der Gesellschaft / Company's Place of Business: München, Registereintrag / Commercial Register No.: HRA 16 270, Persönlich haftender Gesellschafter / Personally Liable Partner: RUSEG Verwaltungs-GmbH, Sitz der Gesellschaft / Company's Place of Business: München, Registereintrag / Commercial Register No.: HRB 7 534, Umsatzsteuer-Identifikationsnummer (USt-IdNr.) / VAT Identification No.: DE 130 256 683, Elektro-Altgeräte Register (EAR) / WEEE Register No.: DE 240 437 86</span><br><span style="font-size:10.0pt;line-height:112%;font-family:"Arial",sans-serif" > </span><tt><span style="font-size:10.0pt;line-height:112%" >_______________________________________________</span></tt><br><span style="font-size:10.0pt;line-height:112%;font-family:"Courier New"" ><tt>gpfsug-discuss mailing list</tt><br><tt>gpfsug-discuss at spectrumscale.org</tt></span><br><tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><br><br><br><o:p></o:p></p></div>
<div><font size="2" face="Default Monospace,Courier New,Courier,monospace" >_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></font></div></blockquote>
<div dir="ltr" > </div></div></div><BR>