<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title></title>
</head>
<body>
<div name="messageBodySection" style="font-size: 14px; font-family: -apple-system, BlinkMacSystemFont, sans-serif;">Thanks Brian,
<div>May i know, if you could explain a bit more on the metadata updates issue?</div>
<div>I am not sure i exactly understand on why the metadata updates would fail between filesystems/between clusters - since every remote cluster will have its own metadata pool/servers.</div>
<div>I suppose the metadata updates for respective remote filesystems should go to respective remote clusters/metadata servers and should not depend on metadata servers of other remote clusters?</div>
<div>Please do correct me if i am wrong.<br /></div>
<div>As of now, our workload is to use NFS/SMB to read files and update files from different remote servers. It is not for running heavy parallel read/write workloads across different servers.</div>
</div>
<div name="messageSignatureSection" style="font-size: 14px; font-family: -apple-system, BlinkMacSystemFont, sans-serif;"><br />
Thanks,
<div>Lohit</div>
</div>
<div name="messageReplySection" style="font-size: 14px; font-family: -apple-system, BlinkMacSystemFont, sans-serif;"><br />
On May 3, 2018, 10:25 AM -0400, Bryan Banister <bbanister@jumptrading.com>, wrote:<br />
<blockquote type="cite" style="margin: 5px 5px; padding-left: 10px; border-left: thin solid #1abc9c;">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Hi Lohit,</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Just another thought, you also have to consider that metadata updates will have to fail between nodes in the CES cluster with those in other clusters because nodes in separate remote clusters do not communicate directly for metadata updates, which depends on your workload is that would be an issue.</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Cheers,</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">-Bryan</span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> </span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b> <span style="font-size:11.0pt;font-family:"Calibri",sans-serif">gpfsug-discuss-bounces@spectrumscale.org [mailto:gpfsug-discuss-bounces@spectrumscale.org] <b>On Behalf Of</b> Mathias Dietz<br />
<b>Sent:</b> Thursday, May 03, 2018 6:41 AM<br />
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br />
<b>Subject:</b> Re: [gpfsug-discuss] Spectrum Scale CES and remote file system mounts</span></p>
<p class="MsoNormal"> </p>
<p class="MsoNormal"><em><span style="font-size:8.5pt;font-family:"Verdana",sans-serif;color:#333333">Note: External Email</span></em></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" align="center" /></div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Hi Lohit,</span><br />
<br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">>I am thinking of using a single CES protocol cluster, with remote mounts from 3 storage clusters.</span><br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">Technically this should work fine (assuming all 3 clusters use the same uids/guids). However this has not been tested in our Test lab.</span><br />
<br />
<br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">>One thing to watch, be careful if your CES root is on a remote fs, as if that goes away, so do all CES exports.</span><br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">Not only the ces root file system is a concern, the whole CES cluster will go down if any remote file systems with NFS exports is not available.</span><br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">e.g. if remote cluster 1 is not available, the CES cluster will unmount the corresponding file system which will lead to a NFS failure on all CES nodes.</span><br />
<br />
<br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">Mit freundlichen Grüßen / Kind regards<br />
<br />
Mathias Dietz<br />
<br />
Spectrum Scale Development - Release Lead Architect (4.2.x)<br />
Spectrum Scale RAS Architect<br />
---------------------------------------------------------------------------<br />
IBM Deutschland<br />
Am Weiher 24<br />
65451 Kelsterbach<br />
Phone: +49 70342744105<br />
Mobile: +49-15152801035<br />
E-Mail: <a href="mailto:mdietz@de.ibm.com">mdietz@de.ibm.com</a><br />
-----------------------------------------------------------------------------<br />
IBM Deutschland Research & Development GmbH<br />
Vorsitzender des Aufsichtsrats: Martina Koederitz, Geschäftsführung: Dirk WittkoppSitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294</span><br />
<br />
<br />
<br />
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">From: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif"><a href="mailto:valleru@cbio.mskcc.org">valleru@cbio.mskcc.org</a></span><br />
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">To: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a>></span><br />
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Date: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">01/05/2018 16:34</span><br />
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Subject: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">Re: [gpfsug-discuss] Spectrum Scale CES and remote file system mounts</span><br />
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Sent by: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif"><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a></span></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" noshade="noshade" style="color:#A0A0A0" align="center" /></div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br />
<br />
<br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">Thanks Simon.</span><br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">I will make sure i am careful about the CES root and test nfs exporting more than 2 remote file systems.</span><br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br />
Regards,<br />
Lohit</span><br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br />
On Apr 30, 2018, 5:57 PM -0400, Simon Thompson (IT Research Support) <<a href="mailto:S.J.Thompson@bham.ac.uk">S.J.Thompson@bham.ac.uk</a>>, wrote:</span><br />
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">You have been able to do this for some time, though I think it's only just supported.<br />
<br />
We've been exporting remote mounts since CES was added.<br />
<br />
At some point we've had two storage clusters supplying data and at least 3 remote file-systems exported over NFS and SMB.<br />
<br />
One thing to watch, be careful if your CES root is on a remote fs, as if that goes away, so do all CES exports. We do have CES root on a remote fs and it works, just be aware...<br />
<br />
Simon<br />
________________________________________<br />
From: <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a> [gpfsug-discuss-bounces@spectrumscale.org] on behalf of <a href="mailto:valleru@cbio.mskcc.org">valleru@cbio.mskcc.org</a> [valleru@cbio.mskcc.org]<br />
Sent: 30 April 2018 22:11<br />
To: gpfsug main discussion list<br />
Subject: [gpfsug-discuss] Spectrum Scale CES and remote file system mounts<br />
<br />
Hello All,<br />
<br />
I read from the below link, that it is now possible to export remote mounts over NFS/SMB.<br />
<br /></span> <a href="https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1adv_protocoloverremoteclu.htm"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1adv_protocoloverremoteclu.htm</span></a><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br />
<br />
I am thinking of using a single CES protocol cluster, with remote mounts from 3 storage clusters.<br />
May i know, if i will be able to export the 3 remote mounts(from 3 storage clusters) over NFS/SMB from a single CES protocol cluster?<br />
<br />
Because according to the limitations as mentioned in the below link:<br />
<br /></span> <a href="https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1adv_limitationofprotocolonRMT.htm"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.0/com.ibm.spectrum.scale.v5r00.doc/bl1adv_limitationofprotocolonRMT.htm</span></a><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br />
<br />
It says “You can configure one storage cluster and up to five protocol clusters (current limit).”<br />
<br />
<br />
Regards,<br />
Lohit<br />
_______________________________________________<br />
gpfsug-discuss mailing list<br />
gpfsug-discuss at spectrumscale.org<br /></span> <a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></a><tt><span style="font-size:10.0pt">_______________________________________________</span></tt><span style="font-size:10.0pt;font-family:"Courier New""><br />
<tt>gpfsug-discuss mailing list</tt><br />
<tt>gpfsug-discuss at spectrumscale.org</tt><br /></span> <a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><span style="font-size:10.0pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><span style="font-size:10.0pt;font-family:"Courier New""><br /></span><br />
<br /></p>
</div>
<br />
<hr />
<font face="Arial" color="gray" size="1"><br />
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial product.<br /></font>_______________________________________________<br />
gpfsug-discuss mailing list<br />
gpfsug-discuss at spectrumscale.org<br />
http://gpfsug.org/mailman/listinfo/gpfsug-discuss<br /></blockquote>
<div></div>
</div>
</body>
</html>