<font size=3 face="Arial">Just to follow up on the question about where
to learn why a NSD is marked down you should see a message in the GPFS
log, /var/adm/ras/mmfs.log.*</font><br><br><font size=2 face="sans-serif">Regards, The Spectrum Scale (GPFS) team<br><br>------------------------------------------------------------------------------------------------------------------<br>If you feel that your question can benefit other users of Spectrum
Scale (GPFS), then please post it to the public IBM developerWroks Forum
at </font><a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479"><font size=2 face="sans-serif">https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</font></a><font size=2 face="sans-serif">.
<br><br>If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact 1-800-237-5511
in the United States or your local IBM Service Center in other countries.
<br><br>The forum is informally monitored as time permits and should not be used
for priority messages to the Spectrum Scale (GPFS) team.</font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">"Grunenberg, Renar"
<Renar.Grunenberg@huk-coburg.de></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">'gpfsug main discussion
list' <gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">07/12/2018 06:01 AM</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">Re: [gpfsug-discuss]
Analyse steps if disk are down after reboot</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=3 face="Arial">Hallo Achim, hallo Simon,</font><br><font size=3 face="Arial">first thanks for your answers. I think Achims
answers map these at best. The nsd-servers (only 2) for these disk were
mistakenly restart in a same time window. </font><br><font size=3 face="Arial"> </font><p><font size=3 face="Arial">Renar Grunenberg<br>Abteilung Informatik – Betrieb<br><br>HUK-COBURG<br>Bahnhofsplatz<br>96444 Coburg</font><table width=393 style="border-collapse:collapse;"><tr height=8><td width=74 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=3 face="Arial">Telefon:</font><td width=315 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=3 face="Arial">09561
96-44110</font><tr height=8><td width=74 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=3 face="Arial">Telefax:</font><td width=315 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=3 face="Arial">09561
96-44104</font><tr height=8><td width=74 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=3 face="Arial">E-Mail:</font><td width=315 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=3 face="Arial">Renar.Grunenberg@huk-coburg.de</font><tr height=8><td width=74 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=3 face="Arial">Internet:</font><td width=315 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><a href="www.huk.de"><font size=3 face="Arial">www.huk.de</font></a></table><p><hr><font size=1 face="Arial">HUK-COBURG Haftpflicht-Unterstützungs-Kasse
kraftfahrender Beamter Deutschlands a. G. in Coburg<br>Reg.-Gericht Coburg HRB 100; St.-Nr. 9212/101/00021<br>Sitz der Gesellschaft: Bahnhofsplatz, 96444 Coburg<br>Vorsitzender des Aufsichtsrats: Prof. Dr. Heinrich R. Schradin.<br>Vorstand: Klaus-Jürgen Heitmann (Sprecher), Stefan Gronbach, Dr. Hans Olav
Herøy, Dr. Jörg Rheinländer (stv.), Sarah Rössler, Daniel Thomas.</font><font size=3 face="Arial"><br></font><hr><font size=1 face="Arial">Diese Nachricht enthält vertrauliche und/oder
rechtlich geschützte Informationen.<br>Wenn Sie nicht der richtige Adressat sind oder diese Nachricht irrtümlich
erhalten haben,<br>informieren Sie bitte sofort den Absender und vernichten Sie diese Nachricht.<br>Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Nachricht
ist nicht gestattet.<br><br>This information may contain confidential and/or privileged information.<br>If you are not the intended recipient (or have received this information
in error) please notify the<br>sender immediately and destroy this information.<br>Any unauthorized copying, disclosure or distribution of the material in
this information is strictly forbidden.</font><font size=3 face="Arial"><br></font><hr><br><font size=2 face="Calibri"><b>Von:</b> gpfsug-discuss-bounces@spectrumscale.org
[</font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=2 face="Calibri">mailto:gpfsug-discuss-bounces@spectrumscale.org</font></a><font size=2 face="Calibri">]
<b>Im Auftrag von </b>Achim Rehor<b><br>Gesendet:</b> Donnerstag, 12. Juli 2018 11:47<b><br>An:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Betreff:</b> Re: [gpfsug-discuss] Analyse steps if disk are down after
reboot</font><br><font size=3 face="Arial"> </font><br><font size=2 face="Arial">Hi Renar, </font><font size=3 face="Arial"><br></font><font size=2 face="Arial"><br>whenever an access to a NSD happens, there is a potential that the node
cannot access the disk, so if the (only) NSD server is down, there will
be no chance to access the disk, and the disk will be set down.<br>If you have twintailed disks, the 'second' (or possibly some more) NSD
server will be asked, switching to networked access, and in that case only
if that also fails, the disk will be set to down as well. </font><font size=3 face="Arial"><br></font><font size=2 face="Arial"><br>Not sure how your setup is, but if you reboot 2 NSD servers, and some client
possibly did IO to a file served by just these 2, then the 'down' state
would be explainable. </font><font size=3 face="Arial"><br></font><font size=2 face="Arial"><br>Rebooting of an NSD server should never set a disk to down, except, he
was the only one serving that NSD.</font><font size=3 face="Arial"><br></font><font size=1 face="Arial"><br><br>Mit freundlichen Grüßen / Kind regards</font><p><font size=2 face="Arial"><b>Achim Rehor</b></font><p><table width=599 style="border-collapse:collapse;"><tr height=8><td width=599 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><tr height=8><td width=599 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial"> </font><tr height=8><td width=495 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial">Software
Technical Support Specialist AIX/ Emea HPC Support</font><td width=104 rowspan=10 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=right><img align=bottom src=cid:_1_6E55C4506E55BD50003F7FD3852582C8 alt=cid:image001.gif@01D419D7.A9373E60 style="border:0px solid;"></div><tr height=8><td width=495 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial">IBM
Certified Advanced Technical Expert - Power Systems with AIX</font><tr height=8><td width=495 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial">TSCC
Software Service, Dept. 7922</font><tr height=8><td width=495 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial">Global
Technology Services </font><tr height=8><td width=495 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><tr height=8><td width=48 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">Phone:</font><td width=196 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">+49-7034-274-7862</font><td width=251 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> IBM
Deutschland</font><tr height=8><td width=48 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">E-Mail:</font><td width=196 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><a href="mailto:Achim.Rehor@de.ibm.com"><font size=1 color=blue face="Arial"><u>Achim.Rehor@de.ibm.com</u></font></a><td width=251 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> Am
Weiher 24</font><tr height=8><td width=48 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=196 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=251 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> 65451
Kelsterbach</font><tr height=8><td width=48 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=196 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=251 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> Germany</font><tr height=8><td width=48 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=196 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=251 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><tr height=8><td width=599 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><tr height=8><td width=599 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial"> </font><tr height=8><td width=599 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#a2a2a2 face="Arial">IBM
Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter <br>Geschäftsführung: Martin Hartmann (Vorsitzender), Norbert Janzen, Stefan
Lutz, Nicole Reimer, Dr. Klaus Seifert, Wolfgang Wendt <br>Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart,
HRB 14562 WEEE-Reg.-Nr. DE 99369940 </font></table><p><font size=3 face="Arial"> </font><p><font size=3 face="Arial"> <br><br><br></font><font size=1 color=#5f5f5f face="Arial"><br>From: </font><font size=1 face="Arial">"Grunenberg,
Renar" <</font><a href="mailto:Renar.Grunenberg@huk-coburg.de"><font size=1 color=blue face="Arial"><u>Renar.Grunenberg@huk-coburg.de</u></font></a><font size=1 face="Arial">></font><font size=1 color=#5f5f5f face="Arial"><br>To: </font><font size=1 face="Arial">"'gpfsug-discuss@spectrumscale.org'"
<</font><a href="mailto:gpfsug-discuss@spectrumscale.org"><font size=1 color=blue face="Arial"><u>gpfsug-discuss@spectrumscale.org</u></font></a><font size=1 face="Arial">></font><font size=1 color=#5f5f5f face="Arial"><br>Date: </font><font size=1 face="Arial">12/07/2018
10:17</font><font size=1 color=#5f5f5f face="Arial"><br>Subject: </font><font size=1 face="Arial">[gpfsug-discuss]
Analyse steps if disk are down after reboot</font><font size=1 color=#5f5f5f face="Arial"><br>Sent by: </font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=1 color=blue face="Arial"><u>gpfsug-discuss-bounces@spectrumscale.org</u></font></a><div align=center><hr noshade></div><br><font size=3 face="Arial"><br><br><br>Hallo All,<br> <br>we see after a reboot of two NSD-Servers some disks in different filesystems
are down and we don’t see why. <br>The logs (messages, dmesg, kern,..) are saying nothing. We are on Rhel7.4
and SS 5.0.1.1.<br>The question now, there are any log, structures in the gpfs deamon that
log these situation? What was the reason why the deamon hast no access
to the disks at that startup phase.<br>Any hints are appreciated. </font><p><font size=3 face="Arial">Renar Grunenberg<br>Abteilung Informatik – Betrieb<br><br>HUK-COBURG<br>Bahnhofsplatz<br>96444 Coburg</font><p><table width=387 style="border-collapse:collapse;"><tr height=8><td width=73 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=3 face="Arial">Telefon:</font><td width=314 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=3 face="Arial">09561
96-44110</font><tr height=8><td width=73 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=3 face="Arial">Telefax:</font><td width=314 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=3 face="Arial">09561
96-44104</font><tr height=8><td width=73 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=3 face="Arial">E-Mail:</font><td width=314 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><a href="mailto:Renar.Grunenberg@huk-coburg.de"><font size=3 color=blue face="Arial"><u>Renar.Grunenberg@huk-coburg.de</u></font></a><tr height=8><td width=73 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=3 face="Arial">Internet:</font><td width=314 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><a href="www.huk.de"><font size=3 color=blue face="Arial"><u>www.huk.de</u></font></a></table><div align=center><hr></div><br><font size=1 face="Arial">HUK-COBURG Haftpflicht-Unterstützungs-Kasse
kraftfahrender Beamter Deutschlands a. G. in Coburg<br>Reg.-Gericht Coburg HRB 100; St.-Nr. 9212/101/00021<br>Sitz der Gesellschaft: Bahnhofsplatz, 96444 Coburg<br>Vorsitzender des Aufsichtsrats: Prof. Dr. Heinrich R. Schradin.<br>Vorstand: Klaus-Jürgen Heitmann (Sprecher), Stefan Gronbach, Dr. Hans Olav
Herøy, Dr. Jörg Rheinländer (stv.), Sarah Rössler, Daniel Thomas.</font><div align=center><hr></div><br><font size=1 face="Arial">Diese Nachricht enthält vertrauliche und/oder
rechtlich geschützte Informationen.<br>Wenn Sie nicht der richtige Adressat sind oder diese Nachricht irrtümlich
erhalten haben,<br>informieren Sie bitte sofort den Absender und vernichten Sie diese Nachricht.<br>Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Nachricht
ist nicht gestattet.<br><br>This information may contain confidential and/or privileged information.<br>If you are not the intended recipient (or have received this information
in error) please notify the<br>sender immediately and destroy this information.<br>Any unauthorized copying, disclosure or distribution of the material in
this information is strictly forbidden.</font><div align=center><hr></div><br><font size=2 face="Courier New">_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font><font size=3 color=blue face="Arial"><u><br></u></font><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><font size=2 color=blue face="Courier New"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></a><p><font size=3 face="Arial"> </font><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size=2><br></font></tt><p><p><BR>