<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
tt
{mso-style-priority:99;
font-family:"Courier New";}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Yes we do this when we really really need to take a remote FS offline, which we try at all costs to avoid unless we have a maintenance window.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Note if you only export via SMB, then you don’t have the same effect (unless something has changed recently)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Simon<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black"><gpfsug-discuss-bounces@spectrumscale.org> on behalf of "valleru@cbio.mskcc.org" <valleru@cbio.mskcc.org><br>
<b>Reply-To: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><br>
<b>Date: </b>Thursday, 3 May 2018 at 15:41<br>
<b>To: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><br>
<b>Subject: </b>Re: [gpfsug-discuss] Spectrum Scale CES and remote file system mounts<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div name="messageBodySection">
<p class="MsoNormal"><a name="_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif">Thanks Mathiaz,
<o:p></o:p></span></a></p>
<div>
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif">Yes i do understand the concern, that if one of the remote file systems go down abruptly - the others will go down too.<o:p></o:p></span></span></p>
</div>
<div>
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></span></p>
</div>
<div>
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif">However, i suppose we could bring down one of the filesystems before a planned downtime? <o:p></o:p></span></span></p>
</div>
<div>
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif">For example, by unexporting the filesystems on NFS/SMB before the downtime?<o:p></o:p></span></span></p>
</div>
<div>
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></span></p>
</div>
<div>
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif">I might not want to be in a situation, where i have to bring down all the remote filesystems because of planned downtime of one of
the remote clusters.<o:p></o:p></span></span></p>
</div>
</div>
<div name="messageSignatureSection">
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></span></p>
<div>
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif">Regards,<o:p></o:p></span></span></p>
</div>
<div>
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif">Lohit<o:p></o:p></span></span></p>
</div>
</div>
<div name="messageReplySection">
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
On May 3, 2018, 7:41 AM -0400, Mathias Dietz <MDIETZ@de.ibm.com>, wrote:<br>
<br>
<o:p></o:p></span></span></p>
<blockquote style="border:none;border-left:solid #1ABC9C 1.0pt;padding:0cm 0cm 0cm 8.0pt;margin-left:3.75pt;margin-top:3.75pt;margin-right:3.75pt;margin-bottom:3.75pt">
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Hi Lohit,</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
<br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">>I am thinking of using a single CES protocol cluster, with remote mounts from 3 storage clusters.</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Technically this should work fine (assuming all 3 clusters use the same uids/guids). However this has not been tested in our Test lab.</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
<br>
<br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">>One thing to watch, be careful if your CES root is on a remote fs, as if that goes away, so do all CES exports.</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Not only the ces root file system is a concern, the whole CES cluster will go down if any remote file systems with NFS exports is not available.</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">e.g. if remote cluster 1 is not available, the CES cluster will unmount the corresponding file system which will lead to a NFS failure on
all CES nodes.</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
<br>
<br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Mit freundlichen Grüßen / Kind regards<br>
<br>
Mathias Dietz<br>
<br>
Spectrum Scale Development - Release Lead Architect (4.2.x)<br>
Spectrum Scale RAS Architect<br>
---------------------------------------------------------------------------<br>
IBM Deutschland<br>
Am Weiher 24<br>
65451 Kelsterbach<br>
Phone: +49 70342744105<br>
Mobile: +49-15152801035<br>
E-Mail: mdietz@de.ibm.com<br>
-----------------------------------------------------------------------------<br>
IBM Deutschland Research & Development GmbH<br>
Vorsitzender des Aufsichtsrats: Martina Koederitz, Geschäftsführung: Dirk WittkoppSitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
<br>
<br>
<br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">From: </span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">valleru@cbio.mskcc.org</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">To: </span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">gpfsug
main discussion list <gpfsug-discuss@spectrumscale.org></span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Date: </span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">01/05/2018
16:34</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Subject: </span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">Re:
[gpfsug-discuss] Spectrum Scale CES and remote file system mounts</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Sent by: </span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">gpfsug-discuss-bounces@spectrumscale.org</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><o:p></o:p></span></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif">
<hr size="0" width="100%" noshade="" style="color:#A0A0A0" align="center">
</span></span></div>
<p class="MsoNormal"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
<br>
<br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Thanks Simon.</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">I will make sure i am careful about the CES root and test nfs exporting more than 2 remote file systems.</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
Regards,<br>
Lohit</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
On Apr 30, 2018, 5:57 PM -0400, Simon Thompson (IT Research Support) <S.J.Thompson@bham.ac.uk>, wrote:</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">You have been able to do this for some time, though I think it's only just supported.<br>
<br>
We've been exporting remote mounts since CES was added.<br>
<br>
At some point we've had two storage clusters supplying data and at least 3 remote file-systems exported over NFS and SMB.<br>
<br>
One thing to watch, be careful if your CES root is on a remote fs, as if that goes away, so do all CES exports. We do have CES root on a remote fs and it works, just be aware...<br>
<br>
Simon<br>
________________________________________<br>
From: gpfsug-discuss-bounces@spectrumscale.org [gpfsug-discuss-bounces@spectrumscale.org] on behalf of valleru@cbio.mskcc.org [valleru@cbio.mskcc.org]<br>
Sent: 30 April 2018 22:11<br>
To: gpfsug main discussion list<br>
Subject: [gpfsug-discuss] Spectrum Scale CES and remote file system mounts<br>
<br>
Hello All,<br>
<br>
I read from the below link, that it is now possible to export remote mounts over NFS/SMB.<br>
<br>
</span></span><span style="mso-bookmark:_MailOriginalBody"></span><a href="https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1adv_protocoloverremoteclu.htm"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1adv_protocoloverremoteclu.htm</span></span><span style="mso-bookmark:_MailOriginalBody"></span></a><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
<br>
I am thinking of using a single CES protocol cluster, with remote mounts from 3 storage clusters.<br>
May i know, if i will be able to export the 3 remote mounts(from 3 storage clusters) over NFS/SMB from a single CES protocol cluster?<br>
<br>
Because according to the limitations as mentioned in the below link:<br>
<br>
</span></span><span style="mso-bookmark:_MailOriginalBody"></span><a href="https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1adv_limitationofprotocolonRMT.htm"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1adv_limitationofprotocolonRMT.htm</span></span><span style="mso-bookmark:_MailOriginalBody"></span></a><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
<br>
It says “You can configure one storage cluster and up to five protocol clusters (current limit).”<br>
<br>
<br>
Regards,<br>
Lohit<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
</span></span><span style="mso-bookmark:_MailOriginalBody"></span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></span><span style="mso-bookmark:_MailOriginalBody"></span></a><span style="mso-bookmark:_MailOriginalBody"><tt><span style="font-size:10.0pt">_______________________________________________</span></tt></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Courier New""><br>
<tt>gpfsug-discuss mailing list</tt><br>
<tt>gpfsug-discuss at spectrumscale.org</tt><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"></span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><span style="mso-bookmark:_MailOriginalBody"><tt><span style="font-size:10.0pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></span><span style="mso-bookmark:_MailOriginalBody"></span></a><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.0pt;font-family:"Courier New""><br>
</span></span><span style="mso-bookmark:_MailOriginalBody"><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><br>
<br>
<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></span><span style="font-size:10.5pt;font-family:"Arial",sans-serif"><o:p></o:p></span></p>
</blockquote>
</div>
</div>
</body>
</html>