<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>Hi Michael,</div>
<div><br>
</div>
<div>Thanks for that link.</div>
<div><br>
</div>
<div>This is the docs I’d found before:</div>
<div><br>
</div>
<div><a href="http://www-01.ibm.com/support/knowledgecenter/#!/STXKQY_4.1.1/com.ibm.spectrum.scale.v4r11.ins.doc/bl1ins_manualprotocols.htm">http://www-01.ibm.com/support/knowledgecenter/#!/STXKQY_4.1.1/com.ibm.spectrum.scale.v4r11.ins.doc/bl1ins_manualprotocols.htm</a></div>
<div><br>
</div>
<div>I guess one of the reasons for wanting to unpick is because we already have configuration management tools all in place.</div>
<div><br>
</div>
<div>I have no issue about GPFS config being inside GPFS, but we really need to know what is going on (and we can manage to get the RPMs all on etc if we know what is needed from the config management tool).</div>
<div><br>
</div>
<div>I do note that it needs CCR enabled, which we currently don’t have. Now I <span style="font-weight: bold;">
think</span> this was because we saw issues with mmsdrestore when adding a node that had been reinstalled back into the cluster. I need to check if that is still the case (we work on being able to pull clients, NSDs etc from the cluster and using xcat to reprovision
and the a config tool to do the relevant bits to rejoin the cluster … makes it easier for us to stage kernel, GPFS, OFED updates as we just blat on a new image).</div>
<div><br>
</div>
<div>I don’t really want to have a mix of Sernet and IBM samba on there, so am happy to pull out those bits, but obviously need to get the IBM bits working as well.</div>
<div><br>
</div>
<div>Multicluster … well, our “protocol” cluster is a separate cluster from the NSD cluster (can’t remote expel, might want to add other GPFS clusters to the protocol layer etc). Of course the multi cluster talks GPFS protocol, so I don’t see any reason why
it shouldn’t work, but yes, noted its not supported.</div>
<div><br>
</div>
<div>Simon</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Michael Garwood7 <<a href="mailto:GARWOODM@uk.ibm.com">GARWOODM@uk.ibm.com</a>><br>
<span style="font-weight:bold">Reply-To: </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>><br>
<span style="font-weight:bold">Date: </span>Thursday, 2 July 2015 16:55<br>
<span style="font-weight:bold">To: </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [gpfsug-discuss] 4.1.1 protocol support<br>
</div>
<div><br>
</div>
<div>
<div><font size="2" face="sans-serif">Hi Simon,</font> <br>
<br>
<font size="1" face="Arial">1. Most of the chef recipes involve installing the various packages required for the protocols, and some of the new performance monitoring packages required for mmperfquery. There is a series of steps for proper manual install at
</font><a href="http://www-01.ibm.com/support/knowledgecenter/STXKQY_4.1.1/com.ibm.spectrum.scale.v4r11.adv.doc/bl1adv_ces_features.htm"><font size="1" face="Arial">http://www-01.ibm.com/support/knowledgecenter/STXKQY_4.1.1/com.ibm.spectrum.scale.v4r11.adv.doc/bl1adv_ces_features.htm</font></a><font size="1" face="Arial">
but this assumes you have all IBM Samba RPMs and prerequisites installed. The recipes *should* be split out so that at the very least, RPM install is done in its own recipe without configuring or enabling anything...</font><br>
<font size="1" face="Arial">2. I am not 100% sure what deploying IBM Samba on the cluster will do with regards to sernet samba. As far as I am aware there is no code in the installer or chef recipes to check for other samba deployments running but I may be
mistaken. Depending on how sernet samba hooks to GPFS I can't think of any reason why it would cause problems aside from the risk of the protocols not communicating and causing issues with file locks/data overwrites, depending on what workload you have running
on samba.</font> <br>
<font size="1" face="Arial">3. I haven't personally seen multicluster deployments done or tested before, but no, it is not officially supported. The installer has been written with the assumption that you are installing to one cluster, so I wouldn't recommend
trying with multiple clusters - unforseen consequences :)<br>
</font><br>
<font size="1" face="Arial">Regards,</font> <br>
<br>
<font size="3" color="#8f8f8f" face="Arial"><b>Michael Garwood</b></font><font size="1" face="Arial"><br>
IBM Systems Developer</font>
<table width="680" style="border-collapse:collapse;">
<tbody>
<tr height="8">
<td width="680" colspan="2" style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;">
<hr>
</td>
</tr>
<tr valign="top" height="8">
<td width="420" style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;">
<font size="1" color="#4181c0" face="Arial"><b>Phone:</b></font><font size="1" color="#5f5f5f" face="Arial"> 44-161-905-4118</font><font size="1" color="#4181c0" face="Arial"><b><br>
E-mail:</b></font><font size="1" color="#5f5f5f" face="Arial"> </font><a href="mailto:GARWOODM@uk.ibm.com" target="_blank"><font size="1" color="#5f5f5f" face="Arial"><u>GARWOODM@uk.ibm.com</u></font></a></td>
<td width="259" style="border-style:solid;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;">
<div align="right"><font size="1" color="#5f5f5f" face="Arial">40 Blackfriars Street<br>
Manchester, M3 2EG<br>
United Kingdom</font></div>
</td>
</tr>
</tbody>
</table>
<br>
<br>
<br>
<font size="1" face="Arial">IBM United Kingdom Limited<br>
Registered in England and Wales with number 741598<br>
Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6 3AU</font> <br>
<br>
<br>
<br>
<font size="1" color="#5f5f5f" face="sans-serif">From: </font><font size="1" face="sans-serif">"Simon Thompson (Research Computing - IT Services)" <<a href="mailto:S.J.Thompson@bham.ac.uk">S.J.Thompson@bham.ac.uk</a>></font><br>
<font size="1" color="#5f5f5f" face="sans-serif">To: </font><font size="1" face="sans-serif">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>>,
</font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Date: </font><font size="1" face="sans-serif">02/07/2015 16:43</font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Subject: </font><font size="1" face="sans-serif">[gpfsug-discuss] 4.1.1 protocol support</font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Sent by: </font><font size="1" face="sans-serif"><a href="mailto:gpfsug-discuss-bounces@gpfsug.org">gpfsug-discuss-bounces@gpfsug.org</a></font><br>
<hr noshade="">
<br>
<br>
<br>
<tt><font size="2">Hi,<br>
<br>
Just wondering if anyone has looked at the new protocol support stuff in 4.1.1 yet?<br>
<br>
>From what I can see, it wants to use the installer to add things like IBM Samba onto nodes in the cluster. The docs online seem to list manual installation as running the chef template, which is hardly manual...<br>
<br>
1. Id like to know what is being run on my cluster<br>
2. Its an existing install which was using sernet samba, so I don't want to go out and break anything inadvertently<br>
3. My protocol nodes are in a multicluster, and I understand the installer doesn't support multicluster.<br>
<br>
(the docs state that multicluster isn't supported but something like its expected to work).<br>
<br>
So... Has anyone had a go at this yet and have a set of steps?<br>
<br>
I've started unpicking the chef recipe, but just wondering if anyone had already had a go at this?<br>
<br>
(and lets not start on the mildy bemusing error when you "enable" the service with "mmces service enable" (ces service not enabled) - there's other stuff to enable it)...<br>
<br>
Simon<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at gpfsug.org<br>
</font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size="2">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size="2"><br>
<br>
</font></tt><br>
<font size="2" face="sans-serif"><br>
Unless stated otherwise above:<br>
IBM United Kingdom Limited - Registered in England and Wales with number 741598. <br>
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU<br>
</font></div>
</div>
</span>
</body>
</html>