[gpfsug-discuss] mass recall from on-prem COS using a policy

[IBM Spectrum Scale]

 "KB_Ill" shows how much data are ill placed or ill replicated.  They can
be resolved by mmrestripefs or mmrestripefile.
Copying to AFM team regarding recall in AFM-COS environment.

Regards, The Spectrum Scale (GPFS) team

------------------------------------------------------------------------------------------------------------------

If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact
1-800-237-5511 in the United States or your local IBM Service Center in
other countries.



From:	"Paul Ward" <p.ward at nhm.ac.uk>
To:	"gpfsug-discuss at gpfsug.org" <gpfsug-discuss at gpfsug.org>
Date:	07/12/2022 11:40 AM
Subject:	[EXTERNAL] [gpfsug-discuss] mass recall from on-prem COS using
            a policy
Sent by:	"gpfsug-discuss" <gpfsug-discuss-bounces at gpfsug.org>



Hi all, I need to recall from on-prem COS a folder with subfolders and
files, approximately 4600 files making up 656G. We have a policy that runs
every 30 mins, and I added this line to it: ‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍‍
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.

ZjQcmQRYFpfptBannerEnd
Hi all,

I need to recall from on-prem COS a folder with subfolders and files,
approximately 4600 files making up 656G.
We have a policy that runs every 30 mins, and I added this line to it:

RULE 'migrate_iac-workspace_Chem-labs' MIGRATE FROM POOl 'migrate' TO POOL
'data' WHERE PATH_NAME LIKE
'/gpfs/nhmfsa/bulk/share/workspace/iac-workspace/Chem_Labs/%'

Migrate is an external pool
RULE EXTERNAL POOL 'migrate' EXEC '/usr/lpp/mmfs/bin/mmcloudgateway files'
OPTS '-F' ESCAPE '% -'

And data is the default placement pool
RULE 'Placement' SET POOL 'data'

When it runs it identifies matching files:
Rule#     Hit_Cnt               KB_Hit                 Chosen
KB_Chosen         KB_Ill    Rule
13          4846                     2491152              4846
2491152              7056      RULE      'migrate_iac-workspace_Chem-labs'
MIGRATE  FROM      POOL  'migrate'  TO  POOL  'data'     WHERE(.)

I can’t find what ‘KB_ Ill’ means but nothing is migrating.

Migrations in other policies work, but this is a ‘recall’ policy.
From this document
https://www.ibm.com/docs/en/spectrum-scale/5.1.3?topic=pools-migrate-recall-external
It suggests it should be invoked as a recall.

Any ideas?

Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.ward at nhm.ac.uk
A picture containing drawing

Description automatically generated
 _______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220718/bd95ec3b/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220718/bd95ec3b/attachment-0002.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 17893393.jpg
Type: image/jpeg
Size: 5356 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220718/bd95ec3b/attachment-0002.jpg>