<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Christian,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Like any AFM deployment in Spectrum Scale, you define how much local working space you want to allocate in the Spectrum Scale filesystem and files will be cached on demand into this 'working set' and will never exceed this upper bound.<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
If you create a new file on this filesystem (in this fileset) then it will automatically be queued to be replicated onto the backend. If you make continuous changes to a file then setting
<i><span class="keyword parmname">afmAsyncDelay</span></i> can reduce the number of writes to the backend object store.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
The local copy though will be kept and only stubbed as space runs out (or some other explicit rule applied such as via
<i><span class="keyword cmdname">mmafmctl evict</span></i>).</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="Signature">
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p style="line-height:12.0pt"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">Daniel</span><b><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black"><br>
<br>
Daniel Kidger</span></b><br>
<span style="color:black">HPC Storage Solutions Architect, EMEA</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black"><br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#040400"><a href="mailto:daniel.kidger@hpe.com" target="_blank" rel="noopener noreferrer" data-auth="NotApplicable" data-linkindex="0"><span>daniel.kidger@hpe.com</span></a><br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">+44 (0)7818 522266 <br>
<br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#040400"><a href="http://www.hpe.com/" target="_blank" rel="noopener noreferrer" data-auth="NotApplicable" data-linkindex="1"><b><span style="color:black">hpe.com</span></b></a><br>
<br>
</span><span><img style="width: 190px; height: 96px; cursor: pointer; max-width: initial;" width="190" height="96" data-outlook-trace="F:1|T:1" src="cid:25007e89-6cb9-44a6-b342-34415f14c0ed"></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> gpfsug-discuss <gpfsug-discuss-bounces@gpfsug.org> on behalf of Christian Petersson <christian.petersson@isstech.io><br>
<b>Sent:</b> 12 May 2022 13:47<br>
<b>To:</b> IBM Spectrum Scale <scale@us.ibm.com><br>
<b>Cc:</b> gpfsug main discussion list <gpfsug-discuss@gpfsug.org><br>
<b>Subject:</b> Re: [gpfsug-discuss] TCT Premigration Question</font>
<div> </div>
</div>
<div>
<div dir="ltr">Thanks for the answer,
<div>AFM to Cloud Object Storage did we look at but had some thoughts about.</div>
<div>The base design was to replicate a copy from our primary cluster to the backup cluster where we push that data directly to S3.</div>
<div>Our second cluster has much less disk space than our primary cluster and our primary cluster has a HSM function enabled to a tape library.</div>
<div><br>
</div>
<div>If I start using AFM to Object, will that delete the file from my disk and only keep a stub file or similar on the disk?</div>
<div>This is why we are looking at TCT instead of AFM Object, we don't have enough disk space to keep multiple copies of the data on disk, we need to use other storage layers like S3 and Tape. </div>
<div><br>
</div>
<div>/C</div>
</div>
<br>
<div class="x_gmail_quote">
<div dir="ltr" class="x_gmail_attr">On Thu, 12 May 2022 at 14:38, IBM Spectrum Scale <<a href="mailto:scale@us.ibm.com">scale@us.ibm.com</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<span style="font-size:10pt; font-family:sans-serif">Some thoughts to consider regarding your question.</span><br>
<br>
<span style="font-size:11pt; font-family:Calibri"> 1 If this is “new” deployment, it is recommended that you evaluate the AFM object support since the TCT feature is stabilized and no future changes/enhancements will be made to it.
</span><br>
<span style="font-size:11pt; font-family:Calibri"> 2 TCT doesn’t support Ceph cloud object storage. So, though it is an S3 compliant interface, and things are working, in case of any issues in future, IBM would require that you reproduce any problemin
a supported environment.</span><br>
<span style="font-size:11pt; font-family:Calibri"> 3 If a file is skipped for any errors, if it is policy driven (pre)migration, the next policy run would pick up the file again. Even within a single (pre)migrate, TCT does 5 retries, on failure.
So at both levels (within TCT as well as at policy level) file will be retried for migration.</span><br>
<br>
<br>
<span style="font-size:10pt; font-family:sans-serif">Regards, The Spectrum Scale (GPFS) team<br>
<br>
------------------------------------------------------------------------------------------------------------------<br>
If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at
</span><a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479" target="_blank"><span style="font-size:10pt; font-family:sans-serif">https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</span></a><span style="font-size:10pt; font-family:sans-serif">.
<br>
<br>
If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries.
<br>
<br>
The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.</span><br>
<br>
<br>
<br>
<span style="font-size:9pt; color:rgb(95,95,95); font-family:sans-serif">From: </span><span style="font-size:9pt; font-family:sans-serif">"Christian Petersson" <<a href="mailto:christian.petersson@isstech.io" target="_blank">christian.petersson@isstech.io</a>></span><br>
<span style="font-size:9pt; color:rgb(95,95,95); font-family:sans-serif">To: </span><span style="font-size:9pt; font-family:sans-serif"><a href="mailto:gpfsug-discuss@gpfsug.org" target="_blank">gpfsug-discuss@gpfsug.org</a></span><br>
<span style="font-size:9pt; color:rgb(95,95,95); font-family:sans-serif">Date: </span><span style="font-size:9pt; font-family:sans-serif">05/11/2022 03:34 AM</span><br>
<span style="font-size:9pt; color:rgb(95,95,95); font-family:sans-serif">Subject: </span><span style="font-size:9pt; font-family:sans-serif">[EXTERNAL] [gpfsug-discuss] TCT Premigration Question</span><br>
<span style="font-size:9pt; color:rgb(95,95,95); font-family:sans-serif">Sent by: </span><span style="font-size:9pt; font-family:sans-serif">"gpfsug-discuss" <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org" target="_blank">gpfsug-discuss-bounces@gpfsug.org</a>></span><br>
<hr noshade="">
<br>
<br>
<br>
<span style="font-size:1pt; color:white">Hi, I have set up a new Spectrum Scale Cluster where we are using TCT Premigration to a Ceph S3 Cluster, the premigration itself works fine and I got data to our S3 storage. But from time to time I reach our S3 max sessions
and get the following </span><br>
<span style="font-size:1pt; color:white"></span><br>
<span style="font-size:12pt">Hi,</span><br>
<span style="font-size:12pt">I have set up a new Spectrum Scale Cluster where we are using TCT Premigration to a Ceph S3 Cluster, the premigration itself works fine and I got data to our S3 storage.</span><br>
<span style="font-size:12pt">But from time to time I reach our S3 max sessions and get the following errors in our policy.</span><br>
<br>
<span style="font-size:12pt"><1> MCSTG000130E: Command Failed with following reason: Request failed with error : com.ibm.gpfsconnector.messages.GpfsConnectorException: Unable to migrate data to the cloud, an unexpected exception occurred : com.amazonaws.ResetException:
The request to the service failed with a retryable reason, but resetting the request input stream has failed. See exception.getExtraInfo or debug-level logging for the original failure that caused this retry.; If the request involves an input stream, the
maximum stream buffer size can be configured via request.getRequestClientOptions().setReadLimit(int).</span><br>
<br>
<span style="font-size:12pt">But I wonder, if a file get skipt, will Spectrum Scale Automatic retry that file again later or will that be skipped and how can I catch does files for a new migration?</span><br>
<br>
<span style="font-size:12pt">-- </span><br>
<span style="font-size:12pt">Med Vänliga Hälsningar</span><br>
<span style="font-size:12pt">Christian Petersson</span><br>
<br>
<span style="font-size:12pt">E-Post: </span><a href="mailto:Christian.Petersson@isstech.io" target="_blank"><span style="font-size:12pt; color:blue"><u>Christian.Petersson@isstech.io</u></span></a><br>
<span style="font-size:12pt">Mobil: 070-3251577</span><br>
<tt><span style="font-size:10pt">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://gpfsug.org" target="_blank">gpfsug.org</a><br>
</span></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" target="_blank"><tt><span style="font-size:10pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</span></tt></a><tt><span style="font-size:10pt"><br>
</span></tt><br>
<br>
<br>
<br>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
-- <br>
<div dir="ltr" class="x_gmail_signature">
<div dir="ltr">Med Vänliga Hälsningar
<div>Christian Petersson</div>
<div><br>
</div>
<div>E-Post: <a href="mailto:Christian.Petersson@isstech.io" target="_blank">Christian.Petersson@isstech.io</a></div>
<div>Mobil: 070-3251577</div>
<div><br>
</div>
</div>
</div>
</div>
</body>
</html>