[gpfsug-discuss] TCT Premigration Question

[IBM Spectrum Scale]

Some thoughts to consider regarding your question.

        1       If this is “new” deployment, it is recommended that you 
evaluate the AFM object support since the TCT feature is stabilized and no 
future changes/enhancements will be made to it. 
        2       TCT doesn’t support Ceph cloud object storage. So, though 
it is an S3 compliant interface, and things are working, in case of any 
issues in future, IBM would require that you reproduce any problemin a 
supported environment.
        3       If a file is skipped for any errors, if it is policy 
driven (pre)migration, the next policy run would pick up the file again. 
Even within a single (pre)migrate, TCT does 5 retries, on failure. So at 
both levels (within TCT as well as at policy level) file will be retried 
for migration.


Regards, The Spectrum Scale (GPFS) team

------------------------------------------------------------------------------------------------------------------
If you feel that your question can benefit other users of  Spectrum Scale 
(GPFS), then please post it to the public IBM developerWroks Forum at 
https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479
. 

If your query concerns a potential software error in Spectrum Scale (GPFS) 
and you have an IBM software maintenance contract please contact 
1-800-237-5511 in the United States or your local IBM Service Center in 
other countries. 

The forum is informally monitored as time permits and should not be used 
for priority messages to the Spectrum Scale (GPFS) team.



From:   "Christian Petersson" <christian.petersson at isstech.io>
To:     gpfsug-discuss at gpfsug.org
Date:   05/11/2022 03:34 AM
Subject:        [EXTERNAL] [gpfsug-discuss] TCT Premigration Question
Sent by:        "gpfsug-discuss" <gpfsug-discuss-bounces at gpfsug.org>



Hi, I have set up a new Spectrum Scale Cluster where we are using TCT 
Premigration to a Ceph S3 Cluster, the premigration itself works fine and 
I got data to our S3 storage. But from time to time I reach our S3 max 
sessions and get the following 
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender 
This message came from outside your organization. 
 
ZjQcmQRYFpfptBannerEnd
Hi,
I have set up a new Spectrum Scale Cluster where we are using TCT 
Premigration to a Ceph S3 Cluster, the premigration itself works fine and 
I got data to our S3 storage.
But from time to time I reach our S3 max sessions and get the following 
errors in our policy.

<1> MCSTG000130E: Command Failed with following reason: Request failed 
with error : com.ibm.gpfsconnector.messages.GpfsConnectorException: Unable 
to migrate data to the cloud, an unexpected exception occurred : 
com.amazonaws.ResetException: The request to the service failed with a 
retryable reason, but resetting the request input stream has failed. See 
exception.getExtraInfo or debug-level logging for the original failure 
that caused this retry.;  If the request involves an input stream, the 
maximum stream buffer size can be configured via 
request.getRequestClientOptions().setReadLimit(int).

But I wonder, if a file get skipt, will Spectrum Scale Automatic retry 
that file again later or will that be skipped and how can I catch does 
files for a new migration?

-- 
Med Vänliga Hälsningar
Christian Petersson

E-Post: Christian.Petersson at isstech.io
Mobil: 070-3251577
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org 





-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220512/2b9d2c1e/attachment.htm>