<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Times New Roman \(Body CS\)";
panose-1:2 11 6 4 2 2 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Arial",sans-serif;
color:windowtext;
font-weight:normal;
font-style:normal;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:"Arial",sans-serif">Bill, if my memory serves me correctly, there was a fix done in later versions of Scale (there may be an efix available) for the situation you described. Notably, Scale was
not properly propagating information about files created through NFS. I suggest you contact Scale support to see if they can provide more details, as well as options for obtaining the fix, assuming my mind has not completely failed me on this issue
</span><span style="font-size:14.0pt;font-family:"Apple Color Emoji"">😊</span><span style="font-size:14.0pt;font-family:"Arial",sans-serif"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Arial",sans-serif">Fred<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Verdana",sans-serif;color:#121212;background:white">Fred Stock, Spectrum Scale Development Advocacy<o:p></o:p></span></p>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-family:"Verdana",sans-serif;color:#121212;background:white"><a href="mailto:stockf@us.ibm.com"><span style="color:#0563C1">stockf@us.ibm.com</span></a> | 720-430-8821</span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</div>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:14.0pt;font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:12.0pt;color:black">From:
</span></b><span style="font-size:12.0pt;color:black">gpfsug-discuss <gpfsug-discuss-bounces@gpfsug.org> on behalf of Bill Peters <WPeters@ATPCO.NET><br>
<b>Date: </b>Wednesday, February 22, 2023 at 12:53 PM<br>
<b>To: </b>gpfsug-discuss@spectrumscale.org <gpfsug-discuss@spectrumscale.org><br>
<b>Subject: </b>[EXTERNAL] [gpfsug-discuss] spanning datacenter to AWS<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">Hello all, I’ve been on the mailing list for a few years but have not been active except my introduction email. We are having an issue I’d like to run past everyone
and see if anyone has experience that may help. Currently using <o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerStart<o:p></o:p></span></p>
</div>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%;border-radius:4px">
<tbody>
<tr>
<td style="padding:12.0pt 0in 12.0pt 0in">
<table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%;background:#D0D8DC;border:none;border-top:solid #90A4AE 3.0pt">
<tbody>
<tr>
<td valign="top" style="border:none;padding:0in 7.5pt 3.75pt 4.5pt">
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="left">
<tbody>
<tr>
<td style="padding:3.0pt 6.0pt 3.0pt 6.0pt">
<p class="MsoNormal"><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">This Message Is From an External Sender
<o:p></o:p></span></b></p>
</td>
</tr>
<tr>
<td style="padding:3.0pt 6.0pt 3.0pt 6.0pt">
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">This message came from outside your organization.
<o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerEnd<o:p></o:p></span></p>
</div>
<p class="MsoNormal">Hello all,<o:p></o:p></p>
<p class="MsoNormal">I’ve been on the mailing list for a few years but have not been active except my introduction email.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">We are having an issue I’d like to run past everyone and see if anyone has experience that may help.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Currently using Spectrum Scale Data Management Edition 5.1.1.0<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Our Spectrum Scale cluster is running on Linux VMs on IBM z/VM. We have one application that
<br>
cannot support the z/VM architecture so we used to have those servers running on VMware in our<br>
datacenter and those servers were client nodes in the Spectrum Scale cluster. This configuration<br>
worked great. We recently retired VMWare and moved all that workload to AWS. Because this
<br>
was no longer on our LAN we thought it would be a good idea (IBM support also recommended it) to
<br>
use CES NFS rather than adding the AWS instances to the cluster. Since doing this we have seen
<br>
problems under high IO. Some NFS clients will try to access files that don’t seem to be there
<br>
resulting in file not found errors. We know the files have been created but the NFS clients can’t
<br>
see them. The read process runs successfully shortly after. We are not saturating our AWS
<br>
connection.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">I haven’t seen any NFS tuning that looks like it would help, but that is an option I would be willing to try.
<br>
The other option I’m thinking about is just adding the NFS clients to the cluster. Has anyone spanned
<br>
datacenters like this?<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">Thanks, any help is appreciated.<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal">-Bill<o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.5pt;font-family:"Arial",sans-serif"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.5pt;font-family:"Arial",sans-serif"> </span><o:p></o:p></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" style="margin-left:-.25pt;border-collapse:collapse">
<tbody>
<tr style="height:82.35pt">
<td width="312" valign="top" style="width:3.25in;padding:0in 5.4pt 0in 5.4pt;height:82.35pt">
<p class="MsoNormal" style="line-height:115%"><b><span lang="EN-GB" style="font-size:11.5pt;line-height:115%;font-family:"Arial",sans-serif;color:#32ABC8">Bill Peters</span></b><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><span lang="EN-GB" style="font-size:11.5pt;line-height:115%;font-family:"Arial",sans-serif;color:#595959">Senior Platform Engineer</span><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><span lang="EN-GB" style="font-size:11.5pt;line-height:115%;font-family:"Arial",sans-serif;color:#595959">703-475-3386</span><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><span style="font-size:12.0pt;line-height:115%;color:#595959"><a href="mailto:wpeters@atpco.net">wpeters<span style="font-size:11.5pt;line-height:115%;font-family:"Arial",sans-serif">@atpco.net</span></a></span><span style="font-size:11.5pt;line-height:115%;font-family:"Arial",sans-serif;color:#595959">
</span><span style="font-size:12.0pt;line-height:115%"><br>
<br>
<br>
</span><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><span lang="EN-GB" style="font-size:11.5pt;line-height:115%;font-family:"Arial",sans-serif;color:#32ABC8">atpco.net</span><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><span lang="EN-GB" style="font-size:11.5pt;line-height:115%;font-family:"Arial",sans-serif;color:#595959">45005 Aviation Drive</span><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><span lang="EN-GB" style="font-size:11.5pt;line-height:115%;font-family:"Arial",sans-serif;color:#595959">Dulles, VA 20166</span><span style="font-size:12.0pt;line-height:115%"><br>
<br>
<br>
</span><o:p></o:p></p>
</td>
</tr>
<tr style="height:67.45pt">
<td width="312" valign="top" style="width:3.25in;padding:0in 5.4pt 0in 5.4pt;height:67.45pt">
<p class="MsoNormal" style="line-height:115%"><span style="font-size:12.0pt;line-height:115%"><a href="http://bit.ly/35vlWu3"><span style="color:windowtext;text-decoration:none"><img border="0" width="362" height="96" style="width:3.7708in;height:1.0in" id="Picture_x0020_33" src="cid:image001.png@01D946B7.6FE37F40" alt="A close up of a signDescription automatically generated"></span></a></span><o:p></o:p></p>
</td>
</tr>
<tr style="height:.3in">
<td width="312" style="width:3.25in;padding:0in 5.4pt 0in 5.4pt;height:.3in">
<p class="MsoNormal" style="line-height:115%"><span style="font-size:12.0pt;line-height:115%"><a href="https://www.facebook.com/atpconews/"><span style="color:windowtext;text-decoration:none"><span style="font-size:8.0pt;line-height:115%;color:#32ABC8"><img border="0" width="19" height="19" style="width:.1979in;height:.1979in" id="Picture_x0020_14" src="cid:image002.png@01D946B7.6FE37F40" alt="Title: Facebook - Description: Facebook icon"></span></span></a></span><span style="font-size:8.0pt;line-height:115%;font-family:"Arial",sans-serif;color:#32ABC8">
</span><span style="font-size:12.0pt;line-height:115%"><a href="https://twitter.com/ATPCOnews"><span style="color:windowtext;text-decoration:none"><span style="font-size:8.0pt;line-height:115%;color:#32ABC8"><img border="0" width="19" height="19" style="width:.1979in;height:.1979in" id="Picture_x0020_15" src="cid:image003.png@01D946B7.6FE37F40" alt="Title: Twitter - Description: Twitter icon"></span></span></a></span><span style="font-size:8.0pt;line-height:115%;font-family:"Arial",sans-serif;color:#32ABC8"> </span><span style="font-size:12.0pt;line-height:115%"><a href="https://www.linkedin.com/company/atpco/"><span style="color:windowtext;text-decoration:none"><span style="font-size:8.0pt;line-height:115%;color:#32ABC8"><img border="0" width="19" height="19" style="width:.1979in;height:.1979in" id="Picture_x0020_16" src="cid:image004.png@01D946B7.6FE37F40" alt="Title: LinkedIn - Description: LinkedIn icon"></span></span></a></span><o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal" style="line-height:115%"><span style="font-size:12.0pt;line-height:115%"> </span><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><b><span style="font-size:10.0pt;line-height:115%;font-family:"Arial",sans-serif;color:#32ABC8"> </span></b><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><b><span style="font-size:10.0pt;line-height:115%;font-family:"Arial",sans-serif;color:#32ABC8"> </span></b><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><b><span style="font-size:10.0pt;line-height:115%;font-family:"Arial",sans-serif;color:#32ABC8"> </span></b><o:p></o:p></p>
<p class="MsoNormal" style="line-height:115%"><b><span style="font-size:10.0pt;line-height:115%;font-family:"Arial",sans-serif;color:#32ABC8"> </span></b><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#595959"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:12.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</body>
</html>