<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css">BODY {
FONT-FAMILY: arial
}
</style>
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Arial",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Arial",sans-serif;}
tt
{mso-style-priority:99;
font-family:"Courier New";}
span.E-MailFormatvorlage19
{mso-style-type:personal-reply;
font-family:"Arial",sans-serif;
color:windowtext;
font-weight:normal;
font-style:normal;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 2.0cm 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="DE" link="blue" vlink="purple">
<p></p>
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Hallo Achim, hallo Simon,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">first thanks for your answers. I think Achims answers map these at best. The nsd-servers (only 2) for these disk were mistakenly restart in a same time window.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div></div>
</div>
<p></p>
<p><font style="font-family:Arial;">Renar</font> <font style="font-family:Arial;">Grunenberg</font><br>
<font style="font-family:Arial;">Abteilung Informatik – Betrieb</font><br>
<br>
<font style="font-family:Arial;">HUK-COBURG</font><br>
<font style="font-family:Arial;">Bahnhofsplatz</font><br>
<font style="font-family:Arial;">96444</font> <font style="font-family:Arial;">Coburg</font><br>
<table class="e99458e1-5ec6-48e0-be6e-87fa3b2fe8c4Table" style="font-family:Arial;">
<tbody>
<tr>
<td><font style="font-family:Arial;"><font style="font-family:Arial;"><font style="font-family:Arial;">Telefon:</font></font></font></td>
<td><font style="font-family:Arial;"><font style="font-family:Arial;"><font style="font-family:Arial;">09561 96-44110</font></font></font></td>
</tr>
<tr>
<td><font style="font-family:Arial;"><font style="font-family:Arial;"><font style="font-family:Arial;">Telefax:</font></font></font></td>
<td><font style="font-family:Arial;"><font style="font-family:Arial;"><font style="font-family:Arial;">09561 96-44104</font></font></font></td>
</tr>
<tr>
<td><font style="font-family:Arial;"><font style="font-family:Arial;"><font style="font-family:Arial;">E-Mail:</font></font></font></td>
<td><font style="font-family:Arial;"><font style="font-family:Arial;">Renar.Grunenberg@huk-coburg.de</font></font></td>
</tr>
<tr>
<td><font style="font-family:Arial;"><font style="font-family:Arial;"><font style="font-family:Arial;">Internet:</font></font></font></td>
<td><font style="font-family:Arial;"><font style="font-family:Arial;"><font style="font-family:Arial;">www.huk.de</font></font></font></td>
</tr>
</tbody>
</table>
</p>
<hr id="HR1">
<font face="Arial"><font size="1">HUK-COBURG Haftpflicht-Unterstützungs-Kasse kraftfahrender Beamter Deutschlands a. G. in Coburg<br>
Reg.-Gericht Coburg HRB 100; St.-Nr. 9212/101/00021<br>
Sitz der Gesellschaft: Bahnhofsplatz, 96444 Coburg<br>
Vorsitzender des Aufsichtsrats: Prof. Dr. Heinrich R. Schradin.<br>
Vorstand: Klaus-Jürgen Heitmann (Sprecher), Stefan Gronbach, Dr. Hans Olav Herøy, Dr. Jörg Rheinländer (stv.), Sarah Rössler, Daniel Thomas.<br>
</font>
<hr id="HR1">
</font><font size="1" face="Arial">Diese Nachricht enthält vertrauliche und/oder rechtlich geschützte Informationen.<br>
Wenn Sie nicht der richtige Adressat sind oder diese Nachricht irrtümlich erhalten haben,<br>
informieren Sie bitte sofort den Absender und vernichten Sie diese Nachricht.<br>
Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Nachricht ist nicht gestattet.<br>
<br>
This information may contain confidential and/or privileged information.<br>
If you are not the intended recipient (or have received this information in error) please notify the<br>
sender immediately and destroy this information.<br>
Any unauthorized copying, disclosure or distribution of the material in this information is strictly forbidden.<br>
</font>
<hr id="HR1">
<p></p>
<p></p>
<p></p>
<div class="WordSection1">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Von:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> gpfsug-discuss-bounces@spectrumscale.org [mailto:gpfsug-discuss-bounces@spectrumscale.org]
<b>Im Auftrag von </b>Achim Rehor<br>
<b>Gesendet:</b> Donnerstag, 12. Juli 2018 11:47<br>
<b>An:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Betreff:</b> Re: [gpfsug-discuss] Analyse steps if disk are down after reboot<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:10.0pt">Hi Renar, </span><br>
<br>
<span style="font-size:10.0pt">whenever an access to a NSD happens, there is a potential that the node cannot access the disk, so if the (only) NSD server is down, there will be no chance to access the disk, and the disk will be set down.<br>
If you have twintailed disks, the 'second' (or possibly some more) NSD server will be asked, switching to networked access, and in that case only if that also fails, the disk will be set to down as well.
</span><br>
<br>
<span style="font-size:10.0pt">Not sure how your setup is, but if you reboot 2 NSD servers, and some client possibly did IO to a file served by just these 2, then the 'down' state would be explainable.
</span><br>
<br>
<span style="font-size:10.0pt">Rebooting of an NSD server should never set a disk to down, except, he was the only one serving that NSD.</span><br>
<br>
<span style="font-size:7.5pt"><br>
Mit freundlichen Grüßen / Kind regards</span><o:p></o:p></p>
<p><b><span style="font-size:10.0pt">Achim Rehor</span></b><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="0" style="width:450.0pt;border-collapse:collapse">
<tbody>
<tr style="height:6.0pt">
<td width="600" colspan="4" style="width:450.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" noshade="" style="color:#A0A0A0" align="center">
</div>
</td>
</tr>
<tr style="height:6.0pt">
<td width="600" colspan="4" style="width:450.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt"> </span><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="496" colspan="3" style="width:372.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt">Software Technical Support Specialist AIX/ Emea HPC Support</span><o:p></o:p></p>
</td>
<td width="104" rowspan="10" style="width:77.25pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal" align="right" style="text-align:right"><img width="103" height="164" id="Bild_x0020_2" src="cid:image001.gif@01D419D7.A9373E60" alt="cid:image001.gif@01D419D7.A9373E60"><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="496" colspan="3" style="width:372.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt">IBM Certified Advanced Technical Expert - Power Systems with AIX</span><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="496" colspan="3" style="width:372.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt">TSCC Software Service, Dept. 7922</span><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="496" colspan="3" style="width:372.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt">Global Technology Services </span>
<o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="496" colspan="3" style="width:372.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" noshade="" style="color:#A0A0A0" align="center">
</div>
</td>
</tr>
<tr style="height:6.0pt">
<td width="44" style="width:33.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0">Phone:</span><o:p></o:p></p>
</td>
<td width="197" style="width:147.75pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0">+49-7034-274-7862</span><o:p></o:p></p>
</td>
<td width="255" style="width:191.25pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> IBM Deutschland</span><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="44" style="width:33.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0">E-Mail:</span><o:p></o:p></p>
</td>
<td width="197" style="width:147.75pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><a href="mailto:Achim.Rehor@de.ibm.com"><span style="font-size:7.5pt">Achim.Rehor@de.ibm.com</span></a><o:p></o:p></p>
</td>
<td width="255" style="width:191.25pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> Am Weiher 24</span><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="44" style="width:33.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> </span><o:p></o:p></p>
</td>
<td width="197" style="width:147.75pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> </span><o:p></o:p></p>
</td>
<td width="255" style="width:191.25pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> 65451 Kelsterbach</span><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="44" style="width:33.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> </span><o:p></o:p></p>
</td>
<td width="197" style="width:147.75pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> </span><o:p></o:p></p>
</td>
<td width="255" style="width:191.25pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> Germany</span><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="44" style="width:33.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> </span><o:p></o:p></p>
</td>
<td width="197" style="width:147.75pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> </span><o:p></o:p></p>
</td>
<td width="255" style="width:191.25pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#0060A0"> </span><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="600" colspan="4" style="width:450.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" noshade="" style="color:#A0A0A0" align="center">
</div>
</td>
</tr>
<tr style="height:6.0pt">
<td width="600" colspan="4" style="width:450.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt"> </span><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="600" colspan="4" style="width:450.0pt;padding:0cm 0cm 0cm 0cm;height:6.0pt">
<p class="MsoNormal"><span style="font-size:7.5pt;color:#A2A2A2">IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter
<br>
Geschäftsführung: Martin Hartmann (Vorsitzender), Norbert Janzen, Stefan Lutz, Nicole Reimer, Dr. Klaus Seifert, Wolfgang Wendt
<br>
Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 14562 WEEE-Reg.-Nr. DE 99369940
</span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p><o:p> </o:p></p>
<p> <br>
<br>
<br>
<br>
<span style="font-size:7.5pt;color:#5F5F5F">From: </span><span style="font-size:7.5pt">"Grunenberg, Renar" <</span><a href="mailto:Renar.Grunenberg@huk-coburg.de"><span style="font-size:7.5pt">Renar.Grunenberg@huk-coburg.de</span></a><span style="font-size:7.5pt">></span><br>
<span style="font-size:7.5pt;color:#5F5F5F">To: </span><span style="font-size:7.5pt">"'gpfsug-discuss@spectrumscale.org'" <</span><a href="mailto:gpfsug-discuss@spectrumscale.org"><span style="font-size:7.5pt">gpfsug-discuss@spectrumscale.org</span></a><span style="font-size:7.5pt">></span><br>
<span style="font-size:7.5pt;color:#5F5F5F">Date: </span><span style="font-size:7.5pt">12/07/2018 10:17</span><br>
<span style="font-size:7.5pt;color:#5F5F5F">Subject: </span><span style="font-size:7.5pt">[gpfsug-discuss] Analyse steps if disk are down after reboot</span><br>
<span style="font-size:7.5pt;color:#5F5F5F">Sent by: </span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><span style="font-size:7.5pt">gpfsug-discuss-bounces@spectrumscale.org</span></a><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" noshade="" style="color:#A0A0A0" align="center">
</div>
<p class="MsoNormal"><br>
<br>
<br>
Hallo All,<br>
<br>
we see after a reboot of two NSD-Servers some disks in different filesystems are down and we don’t see why.
<br>
The logs (messages, dmesg, kern,..) are saying nothing. We are on Rhel7.4 and SS 5.0.1.1.<br>
The question now, there are any log, structures in the gpfs deamon that log these situation? What was the reason why the deamon hast no access to the disks at that startup phase.<br>
Any hints are appreciated. <o:p></o:p></p>
<p>Renar Grunenberg<br>
Abteilung Informatik – Betrieb<br>
<br>
HUK-COBURG<br>
Bahnhofsplatz<br>
96444 Coburg<o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="0" style="width:267.75pt;border-collapse:collapse">
<tbody>
<tr style="height:6.0pt">
<td width="68" style="width:50.25pt;padding:.75pt .75pt .75pt .75pt;height:6.0pt">
<p class="MsoNormal">Telefon:<o:p></o:p></p>
</td>
<td width="289" style="width:214.5pt;padding:.75pt .75pt .75pt .75pt;height:6.0pt">
<p class="MsoNormal">09561 96-44110<o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="68" style="width:50.25pt;padding:.75pt .75pt .75pt .75pt;height:6.0pt">
<p class="MsoNormal">Telefax:<o:p></o:p></p>
</td>
<td width="289" style="width:214.5pt;padding:.75pt .75pt .75pt .75pt;height:6.0pt">
<p class="MsoNormal">09561 96-44104<o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="68" style="width:50.25pt;padding:.75pt .75pt .75pt .75pt;height:6.0pt">
<p class="MsoNormal">E-Mail:<o:p></o:p></p>
</td>
<td width="289" style="width:214.5pt;padding:.75pt .75pt .75pt .75pt;height:6.0pt">
<p class="MsoNormal"><a href="mailto:Renar.Grunenberg@huk-coburg.de">Renar.Grunenberg@huk-coburg.de</a><o:p></o:p></p>
</td>
</tr>
<tr style="height:6.0pt">
<td width="68" style="width:50.25pt;padding:.75pt .75pt .75pt .75pt;height:6.0pt">
<p class="MsoNormal">Internet:<o:p></o:p></p>
</td>
<td width="289" style="width:214.5pt;padding:.75pt .75pt .75pt .75pt;height:6.0pt">
<p class="MsoNormal"><a href="www.huk.de">www.huk.de</a><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" align="center">
</div>
<p class="MsoNormal"><span style="font-size:7.5pt">HUK-COBURG Haftpflicht-Unterstützungs-Kasse kraftfahrender Beamter Deutschlands a. G. in Coburg<br>
Reg.-Gericht Coburg HRB 100; St.-Nr. 9212/101/00021<br>
Sitz der Gesellschaft: Bahnhofsplatz, 96444 Coburg<br>
Vorsitzender des Aufsichtsrats: Prof. Dr. Heinrich R. Schradin.<br>
Vorstand: Klaus-Jürgen Heitmann (Sprecher), Stefan Gronbach, Dr. Hans Olav Herøy, Dr. Jörg Rheinländer (stv.), Sarah Rössler, Daniel Thomas.</span><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" align="center">
</div>
<p class="MsoNormal"><span style="font-size:7.5pt">Diese Nachricht enthält vertrauliche und/oder rechtlich geschützte Informationen.<br>
Wenn Sie nicht der richtige Adressat sind oder diese Nachricht irrtümlich erhalten haben,<br>
informieren Sie bitte sofort den Absender und vernichten Sie diese Nachricht.<br>
Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Nachricht ist nicht gestattet.<br>
<br>
This information may contain confidential and/or privileged information.<br>
If you are not the intended recipient (or have received this information in error) please notify the<br>
sender immediately and destroy this information.<br>
Any unauthorized copying, disclosure or distribution of the material in this information is strictly forbidden.</span><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" align="center">
</div>
<p class="MsoNormal"><tt><span style="font-size:10.0pt">_______________________________________________</span></tt><span style="font-size:10.0pt;font-family:"Courier New""><br>
<tt>gpfsug-discuss mailing list</tt><br>
<tt>gpfsug-discuss at spectrumscale.org</tt><br>
</span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><span style="font-size:10.0pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><o:p></o:p></p>
<p><o:p> </o:p></p>
</div>
<p></p>
<p></p>
<p></p>
<p></p>
<p></p>
<p></p>
<p></p>
<p></p>
</body>
</html>