<html><body bgcolor="#FFFFFF"><p><font size="2">Looks like a bug in the code. The command hung in grep command. It has missing argument.</font><br><br><font size="2">Please open a PMR to have this fix.</font><br><br><font size="2">Instead of "service gpfs start", can you use mmstartup? You can also try to run mm list command before service gpfs start as a workaround.</font><br><br><font size="2">Regards, The Spectrum Scale (GPFS) team<br><br>------------------------------------------------------------------------------------------------------------------<br>If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at <a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479">https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</a>. <br><br>If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. <br><br>The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.</font><br><br><img width="16" height="16" src="cid:1__=0ABB0BA5DFE4C81E8f9e8a93df938690918c0AB@" border="0" alt="Inactive hide details for "Oesterlin, Robert" ---06/05/2017 11:54:48 AM---Our node build process re-adds a node to the cluster "><font size="2" color="#424282">"Oesterlin, Robert" ---06/05/2017 11:54:48 AM---Our node build process re-adds a node to the cluster and then does a “service gpfs start”, but GPFS</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">"Oesterlin, Robert" <Robert.Oesterlin@nuance.com></font><br><font size="2" color="#5F5F5F">To: </font><font size="2">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">06/05/2017 11:54 AM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">[gpfsug-discuss] Odd behavior - GPSF failed to start after initial node add</font><br><font size="2" color="#5F5F5F">Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><font face="Calibri">Our node build process re-adds a node to the cluster and then does a “service gpfs start”, but GPFS doesn’t start. From the build log:</font><br><font face="Calibri"> </font><br><font face="Calibri">+ ssh -o StrictHostKeyChecking=no nrg1-gpfs01.nrg1.us.grid.nuance.com '/usr/local/sbin/addnode.sh cnq-r02r09u27.nrg1.us.grid.nuance.com'</font><br><font face="Calibri">+ rc=0</font><br><font face="Calibri">+ chkconfig gpfs on</font><br><font face="Calibri">+ service gpfs start</font><br><font face="Calibri"> </font><br><font face="Calibri">The “service gpfs start” command hangs and never seems to return.</font><br><font face="Calibri"> </font><br><font face="Calibri">If I look at the process tree:</font><br><font face="Calibri"> </font><br><font face="Calibri">[root@cnq-r02r09u27 ~]# ps ax | egrep "mm|gpfs"</font><br><font face="Calibri">11715 ? S 0:00 /bin/bash ./nrgX_gpfs_post</font><br><font face="Calibri">12191 ? Ssl 0:00 /usr/lpp/mmfs/bin/mmsdrserv 1191 10 10 /var/adm/ras/mmsdrserv.log 128 yes no</font><br><font face="Calibri">12208 ? S 0:00 /usr/lpp/mmfs/bin/mmksh /usr/lpp/mmfs/bin/mmccrmonitor 15</font><br><font face="Calibri">12271 ? S 0:00 /bin/sh /sbin/service gpfs start</font><br><font face="Calibri">12276 ? S 0:00 /bin/sh /etc/init.d/gpfs start</font><br><font face="Calibri">12278 ? S 0:00 /usr/lpp/mmfs/bin/mmksh /usr/lpp/mmfs/bin/mmautoload reboot</font><br><font face="Calibri">12292 ? S 0:00 /usr/lpp/mmfs/bin/mmksh /usr/lpp/mmfs/bin/mmautoload reboot</font><br><font face="Calibri">12293 ? S 0:00 /bin/grep -lw /var/mmfs/gen/nodeFiles/*.num</font><br><font face="Calibri">12294 ? S 0:00 /bin/sed -e s%/var/mmfs/gen/nodeFiles/....%% -e s/\.num$//</font><br><font face="Calibri">21639 ? S 0:00 /usr/lpp/mmfs/bin/mmksh /usr/lpp/mmfs/bin/mmccrmonitor 15</font><br><font face="Calibri"> </font><br><font face="Calibri">This is GPFS 4.2.2-1</font><br><font face="Calibri"> </font><br><font face="Calibri">This seems to occur only on the initial startup after build - if I try to start GPFS again, it works just fine - any ideas on what it’s sitting here waiting? Nothing in mmfslog (does not exist)</font><br><font face="Calibri"> </font><br><font face="Calibri">Bob Oesterlin<br>Sr Principal Storage Engineer, Nuance<br>507-269-0413</font><br><font face="Times New Roman"> </font><br><font face="Calibri"> </font><tt><font size="2">_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><tt><font size="2"><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></font></tt><tt><font size="2"><br></font></tt><br><br><BR>
</body></html>