<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>Actually, no just ignore me, it does appear to be fixed in 4.1.1</div>
<div><br>
</div>
<ul>
<li>I cleaned up the node by removing the 4.1.1 packages, then cleaned up /var/mmfs, but then when the config tool reinstalled, it put 4.1.0 back on and didn’t apply the updates to 4.1.1, so it must have been an older version of mmsdrrestore</li></ul>
<div>Simon</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Simon Thompson <<a href="mailto:S.J.Thompson@bham.ac.uk">S.J.Thompson@bham.ac.uk</a>><br>
<span style="font-weight:bold">Reply-To: </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>><br>
<span style="font-weight:bold">Date: </span>Friday, 3 July 2015 12:22<br>
<span style="font-weight:bold">To: </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>><br>
<span style="font-weight:bold">Subject: </span>[gpfsug-discuss] mmsdrestore with CCR enabled (was Re: 4.1.1 protocol support)<br>
</div>
<div><br>
</div>
<div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div><br>
</div>
<div>Bob, (anyone?)</div>
<div><br>
</div>
<div>Have you tried mmsdrestore to see if its working in 4.1.1?</div>
<div><br>
</div>
<div><span style="font-family: Menlo; font-size: 11px;"># mmsdrrestore</span><span style="font-family: Menlo; font-size: 11px;">
</span><span style="font-family: Menlo; font-size: 11px;">-p PRIMARY -R /usr/bin/scp</span><span style="font-family: Menlo; font-size: 11px;"> </span></div>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">Fri 3 Jul 11:56:05 BST 2015: mmsdrrestore: Processing node PRIMARY</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">ccrio initialization failed (err 811)</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">mmsdrrestore: Unable to retrieve GPFS cluster files from CCR.</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">mmsdrrestore: Unexpected error from updateMmfsEnvironment. Return code: 1</p>
<p style="margin: 0px; font-size: 11px; font-family: Menlo;">mmsdrrestore: Command failed. Examine previous error messages to determine cause.</p>
<div><br>
</div>
<div>It seems to copy the mmsdrfs file to the local node into /var/mmfs/gen/mmsdrfs but then fails to actually work.</div>
<div><br>
</div>
<div>Simon</div>
<div><br>
</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Bob Oesterlin <<a href="mailto:oester@gmail.com">oester@gmail.com</a>><br>
<span style="font-weight:bold">Reply-To: </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>><br>
<span style="font-weight:bold">Date: </span>Thursday, 2 July 2015 20:03<br>
<span style="font-weight:bold">To: </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [gpfsug-discuss] 4.1.1 protocol support<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">
<div class="gmail_extra"><br>
<div class="gmail_quote">On Thu, Jul 2, 2015 at 1:52 PM, Simon Thompson (Research Computing - IT Services)
<span dir="ltr"><<a href="mailto:S.J.Thompson@bham.ac.uk" target="_blank">S.J.Thompson@bham.ac.uk</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>I do note that it needs CCR enabled, which we currently don’t have. Now I <span style="font-weight:bold">
think</span> this was because we saw issues with mmsdrestore when adding a node that had been reinstalled back into the cluster. I need to check if that is still the case (we work on being able to pull clients, NSDs etc from the cluster and using xcat to reprovision
and the a config tool to do the relevant bits to rejoin the cluster … makes it easier for us to stage kernel, GPFS, OFED updates as we just blat on a new image).</div>
</blockquote>
</div>
<br>
Yes, and this is why we couldn't use CCR - our compute nodes are netboot, so they go thru a mmsdrrestore every time they reboot. Now, they have fixed this in 4.1.1, which means if you can get (the cluster) to 4.1.1 and turn on CCR, mmsdrrestore should work.
Note to self: Test this out in your sandbox cluster. :-)<br>
<br clear="all">
<div>
<div class="gmail_signature">
<div dir="ltr"><br>
<div>Bob Oesterlin</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</span></div>
</div>
</span>
</body>
</html>