<html><body><p><font size="2">Hi Renata,</font><br><br><font size="2">You may want to reduce the set of quorum nodes. If your version supports the --force option, you can run</font><br><br><font size="2">mmchnode --noquorum -N <broken-nodes> --force</font><br><br><font size="2">It is a good idea to configure tiebreaker disks in a cluster that has only 2 quorum nodes.</font><br><br><font size="2">Regards, The Spectrum Scale (GPFS) team<br><br>------------------------------------------------------------------------------------------------------------------<br>If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at <a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479">https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</a>. <br><br>If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. <br><br>The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.</font><br><br><img width="16" height="16" src="cid:1__=0ABB082ADFE7DE038f9e8a93df938690918c0AB@" border="0" alt="Inactive hide details for Renata Maria Dart ---06/27/2018 02:21:52 PM---Hi, we have a client cluster of 4 nodes with 3 quorum n"><font size="2" color="#424282">Renata Maria Dart ---06/27/2018 02:21:52 PM---Hi, we have a client cluster of 4 nodes with 3 quorum nodes. One of the quorum nodes is no longer i</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">Renata Maria Dart <renata@slac.stanford.edu></font><br><font size="2" color="#5F5F5F">To: </font><font size="2">gpfsug-discuss@spectrumscale.org</font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">06/27/2018 02:21 PM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">[gpfsug-discuss] gpfs client cluster, lost quorum, ccr issues</font><br><font size="2" color="#5F5F5F">Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><tt><font size="2">Hi, we have a client cluster of 4 nodes with 3 quorum nodes. One of the<br>quorum nodes is no longer in service and the other was reinstalled with<br>a newer OS, both without informing the gpfs admins. Gpfs is still<br>"working" on the two remaining nodes, that is, they continue to have access<br>to the gpfs data on the remote clusters. But, I can no longer get<br>any gpfs commands to work. On one of the 2 nodes that are still serving data,<br><br>root@ocio-gpu01 ~]# mmlscluster<br>get file failed: Not enough CCR quorum nodes available (err 809)<br>gpfsClusterInit: Unexpected error from ccr fget mmsdrfs. Return code: 158<br>mmlscluster: Command failed. Examine previous error messages to determine cause.<br><br><br>On the reinstalled node, this fails in the same way:<br><br>[root@ocio-gpu02 ccr]# mmstartup<br>get file failed: Not enough CCR quorum nodes available (err 809)<br>gpfsClusterInit: Unexpected error from ccr fget mmsdrfs. Return code: 158<br>mmstartup: Command failed. Examine previous error messages to determine cause.<br><br><br>I have looked through the users group interchanges but didn't find anything<br>that seems to fit this scenario.<br><br>Is there a way to salvage this cluster? Can it be done without<br>shutting gpfs down on the 2 nodes that continue to work?<br><br>Thanks for any advice,<br><br>Renata Dart<br>SLAC National Accelerator Lb<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><tt><font size="2"><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></font></tt><tt><font size="2"><br><br></font></tt><br><br><BR>
</body></html>