[gpfsug-discuss] mass recall from on-prem COS using a policy

IBM Spectrum Scale scale at us.ibm.com
Tue Jul 19 19:12:20 BST 2022



Hi Amey,

Can you provide them guidance from TCT angle.

Regards, The Spectrum Scale (GPFS) team

------------------------------------------------------------------------------------------------------------------

If you feel that your question can benefit other users of  Spectrum Scale
(GPFS), then please post it to the public IBM developerWroks Forum at
https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479.


If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact
1-800-237-5511 in the United States or your local IBM Service Center in
other countries.

The forum is informally monitored as time permits and should not be used
for priority messages to the Spectrum Scale (GPFS) team.



From:	"Paul Ward" <p.ward at nhm.ac.uk>
To:	"gpfsug main discussion list" <gpfsug-discuss at gpfsug.org>
Date:	19-07-2022 09.34 PM
Subject:	[EXTERNAL] Re: [gpfsug-discuss] mass recall from on-prem COS
            using a policy
Sent by:	"gpfsug-discuss" <gpfsug-discuss-bounces at gpfsug.org>



Thank you. Ill-placed on ESS or COS? I understood restriping was for NSDs,
so that would be on our ESS not COS? The direction I want to move the files
is from COS to ESS. We do not have AFM enabled, we are using TCT. ‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.

ZjQcmQRYFpfptBannerEnd
Thank you.

Ill-placed on ESS or COS?

I understood restriping was for NSDs, so that would be on our ESS not COS?
The direction I want to move the files is from COS to ESS.

We do not have AFM enabled, we are using TCT.

From: gpfsug-discuss <gpfsug-discuss-bounces at gpfsug.org> On Behalf Of IBM
Spectrum Scale
Sent: 18 July 2022 20:35
To: gpfsug main discussion list <gpfsug-discuss at gpfsug.org>; Venkateswara R
Puvvada <vpuvvada at in.ibm.com>
Subject: Re: [gpfsug-discuss] mass recall from on-prem COS using a policy



 "KB_Ill" shows how much data are ill placed or ill replicated.  They can
be resolved by mmrestripefs or mmrestripefile.
Copying to AFM team regarding recall in AFM-COS environment.

Regards, The Spectrum Scale (GPFS) team

------------------------------------------------------------------------------------------------------------------

If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact
1-800-237-5511 in the United States or your local IBM Service Center in
other countries.

Inactive hide details for "Paul Ward" ---07/12/2022 11:40:52 AM---Hi all, I
need to recall from on-prem COS a folder with subfo"Paul Ward"
---07/12/2022 11:40:52 AM---Hi all, I need to recall from on-prem COS a
folder with subfolders and files, approximately 4600 fil

From: "Paul Ward" <p.ward at nhm.ac.uk>
To: "gpfsug-discuss at gpfsug.org" <gpfsug-discuss at gpfsug.org>
Date: 07/12/2022 11:40 AM
Subject: [EXTERNAL] [gpfsug-discuss] mass recall from on-prem COS using a
policy
Sent by: "gpfsug-discuss" <gpfsug-discuss-bounces at gpfsug.org>




Hi all, I need to recall from on-prem COS a folder with subfolders and
files, approximately 4600 files making up 656G. We have a policy that runs
every 30 mins, and I added this line to it: ‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.

ZjQcmQRYFpfptBannerEnd
Hi all,

I need to recall from on-prem COS a folder with subfolders and files,
approximately 4600 files making up 656G.
We have a policy that runs every 30 mins, and I added this line to it:

RULE 'migrate_iac-workspace_Chem-labs' MIGRATE FROM POOl 'migrate' TO POOL
'data' WHERE PATH_NAME LIKE
'/gpfs/nhmfsa/bulk/share/workspace/iac-workspace/Chem_Labs/%'

Migrate is an external pool
RULE EXTERNAL POOL 'migrate' EXEC '/usr/lpp/mmfs/bin/mmcloudgateway files'
OPTS '-F' ESCAPE '% -'

And data is the default placement pool
RULE 'Placement' SET POOL 'data'

When it runs it identifies matching files:
Rule#     Hit_Cnt               KB_Hit                 Chosen
KB_Chosen         KB_Ill    Rule
13          4846                     2491152              4846
2491152              7056      RULE      'migrate_iac-workspace_Chem-labs'
MIGRATE  FROM      POOL  'migrate'  TO  POOL  'data'     WHERE(.)

I can’t find what ‘KB_ Ill’ means but nothing is migrating.

Migrations in other policies work, but this is a ‘recall’ policy.
From this document
https://www.ibm.com/docs/en/spectrum-scale/5.1.3?topic=pools-migrate-recall-external

It suggests it should be invoked as a recall.

Any ideas?

Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.ward at nhm.ac.uk
A picture containing drawing

Description automatically generated
 _______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org


_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220719/3aeac75d/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220719/3aeac75d/attachment-0002.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 17368645.jpg
Type: image/jpeg
Size: 5356 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220719/3aeac75d/attachment-0002.jpg>


More information about the gpfsug-discuss mailing list