<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=windows-1256">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
tt
{mso-style-priority:99;
font-family:"Courier New";}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1068384422;
mso-list-type:hybrid;
mso-list-template-ids:1077570456 -1117890574 1074331673 1074331675 1074331663 1074331673 1074331675 1074331663 1074331673 1074331675;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-IN" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">Paul Recall policy looks to be correct. I see that it is in line with /opt/ibm/MCStore/samples/recallFromCloud.template.
<o:p></o:p></span></p>
<ol style="margin-top:0cm" start="1" type="1">
<li class="MsoListParagraph" style="margin-left:0cm;mso-list:l0 level1 lfo1"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">At the end of policy run, what does the stats indicate, such as X Files migrated, Y skipped/error
etc? I assume the path you have specified, has the files in non-resident state, which you are trying to recall using the policy. Correct? Reason I ask this is because you mentioned around 650G data to be recalled, but policy seems to have chosen ~2.5G data
across 4812 files. So if this path is actively used by users, it is likely that the files may have been transparently recalled on access, and are in co-resident state already. Hence no data movement visible. <o:p></o:p></span></li><li class="MsoListParagraph" style="margin-left:0cm;mso-list:l0 level1 lfo1"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">In /var/MCStore/ras/logs/mcstore.log, do you see any recall specific errors, when you run
the policy?<o:p></o:p></span></li><li class="MsoListParagraph" style="margin-left:0cm;mso-list:l0 level1 lfo1"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">On our test setup, we are planning to run similar policy once, to see if error is reproducible.
I will share what we find.<o:p></o:p></span></li></ol>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-family:"Arial",sans-serif;color:#7C7C5F">AMEY GOKHALE</span></b><b><span style="font-family:"Arial",sans-serif"><o:p></o:p></span></b></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Senior Software Engineer Spectrum Scale<o:p></o:p></span></b></p>
<p class="MsoNormal"><b><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#336699">Phone:
</span></b><span style="font-size:8.0pt;font-family:"Arial",sans-serif">91-988 100 8675<o:p></o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:#336699">E-mail:
</span></b><span style="font-size:8.0pt;font-family:"Arial",sans-serif"><a href="mailto:amey.gokhale@in.ibm.com" target="_blank"><span style="color:#555555">amey.gokhale@in.ibm.com</span></a><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Huzefa H Pancha <hupancha@in.ibm.com>
<b>On Behalf Of </b>scale@us.ibm.com<br>
<b>Sent:</b> 19 July 2022 23:42<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@gpfsug.org>; Amey P Gokhale <amey.gokhale@in.ibm.com><br>
<b>Cc:</b> gpfsug-discuss <gpfsug-discuss-bounces@gpfsug.org><br>
<b>Subject:</b> Re: [EXTERNAL] Re: [gpfsug-discuss] mass recall from on-prem COS using a policy<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Hi Amey,</span><br>
<br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">Can you provide them guidance from TCT angle.</span><br>
<br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif">Regards, The Spectrum Scale (GPFS) team<br>
<br>
------------------------------------------------------------------------------------------------------------------<br>
If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at
<a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479">https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</a>.
<br>
<br>
If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries.
<br>
<br>
The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.</span><br>
<br>
<img border="0" width="16" height="16" style="width:.1666in;height:.1666in" id="Picture_x0020_1" src="cid:image001.gif@01D89C33.AA634FD0" alt="Inactive hide details for "Paul Ward" ---19-07-2022 09.34.33 PM---Thank you. Ill-placed on ESS or COS?"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#424282">"Paul
Ward" ---19-07-2022 09.34.33 PM---Thank you. Ill-placed on ESS or COS?</span><br>
<br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">From: </span>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif">"Paul Ward" <<a href="mailto:p.ward@nhm.ac.uk">p.ward@nhm.ac.uk</a>></span><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">To: </span>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif">"gpfsug main discussion list" <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>></span><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Date: </span>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif">19-07-2022 09.34 PM</span><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Subject:
</span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">[EXTERNAL] Re: [gpfsug-discuss] mass recall from on-prem COS using a policy</span><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Sent by:
</span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">"gpfsug-discuss" <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org">gpfsug-discuss-bounces@gpfsug.org</a>></span><o:p></o:p></p>
<div class="MsoNormal">
<hr size="1" width="100%" noshade="" style="color:#8091A5" align="left">
</div>
<p class="MsoNormal"><br>
<br>
<br>
<span style="font-size:7.5pt;color:white">Thank you. Ill-placed on ESS or COS? I understood restriping was for NSDs, so that would be on our ESS not COS? The direction I want to move the files is from COS to ESS. We do not have AFM enabled, we are using TCT.
</span><br>
<span style="font-size:7.5pt;color:white">ZjQcmQRYFpfptBannerStart</span><br>
<b><span style="font-size:10.0pt;font-family:"Arial",sans-serif">This Message Is From an External Sender
</span></b><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif">This message came from outside your organization.
</span><br>
<br>
<span style="font-size:7.5pt;color:white">ZjQcmQRYFpfptBannerEnd</span><br>
<span style="font-size:10.0pt;font-family:"Calibri",sans-serif">Thank you.</span><br>
<span style="font-size:10.0pt;font-family:"Calibri",sans-serif"> </span><br>
<span style="font-size:10.0pt;font-family:"Calibri",sans-serif">Ill-placed on ESS or COS?<br>
<br>
I understood restriping was for NSDs, so that would be on our ESS not COS?</span><br>
<span style="font-size:10.0pt;font-family:"Calibri",sans-serif">The direction I want to move the files is from COS to ESS.</span><br>
<span style="font-size:10.0pt;font-family:"Calibri",sans-serif"> </span><br>
<span style="font-size:10.0pt;font-family:"Calibri",sans-serif">We do not have AFM enabled, we are using TCT.</span><br>
<span style="font-size:10.0pt;font-family:"Calibri",sans-serif"> </span><br>
<b><span style="font-size:10.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:10.0pt;font-family:"Calibri",sans-serif"> gpfsug-discuss <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org">gpfsug-discuss-bounces@gpfsug.org</a>>
<b>On Behalf Of </b>IBM Spectrum Scale<b><br>
Sent:</b> 18 July 2022 20:35<b><br>
To:</b> gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>>; Venkateswara R Puvvada <<a href="mailto:vpuvvada@in.ibm.com">vpuvvada@in.ibm.com</a>><b><br>
Subject:</b> Re: [gpfsug-discuss] mass recall from on-prem COS using a policy</span><br>
<o:p></o:p></p>
<p><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> "KB_Ill" shows how much data are ill placed or ill replicated. They can be resolved by mmrestripefs or mmrestripefile.<span style="color:#2F2F2F"><br>
Copying to AFM team regarding recall in AFM-COS environment</span></span><span style="font-family:"Courier New";color:#2F2F2F">.</span><br>
<span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
Regards, The Spectrum Scale (GPFS) team<br>
<br>
------------------------------------------------------------------------------------------------------------------<br>
If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries.
</span><br>
<br>
<img border="0" width="16" height="16" style="width:.1666in;height:.1666in" id="Picture_x0020_3" src="cid:image001.gif@01D89C33.AA634FD0" alt="Inactive hide details for "Paul Ward" ---07/12/2022 11:40:52 AM---Hi all, I need to recall from on-prem COS a folder with subfo"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#424282">"Paul
Ward" ---07/12/2022 11:40:52 AM---Hi all, I need to recall from on-prem COS a folder with subfolders and files, approximately 4600 fil</span><br>
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F"><br>
From: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif">"Paul Ward" <</span><a href="mailto:p.ward@nhm.ac.uk"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">p.ward@nhm.ac.uk</span></a><span style="font-size:7.5pt;font-family:"Arial",sans-serif">><span style="color:#5F5F5F"><br>
To: </span>"</span><a href="mailto:gpfsug-discuss@gpfsug.org"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">gpfsug-discuss@gpfsug.org</span></a><span style="font-size:7.5pt;font-family:"Arial",sans-serif">" <</span><a href="mailto:gpfsug-discuss@gpfsug.org"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">gpfsug-discuss@gpfsug.org</span></a><span style="font-size:7.5pt;font-family:"Arial",sans-serif">><span style="color:#5F5F5F"><br>
Date: </span>07/12/2022 11:40 AM<span style="color:#5F5F5F"><br>
Subject: </span>[EXTERNAL] [gpfsug-discuss] mass recall from on-prem COS using a policy<span style="color:#5F5F5F"><br>
Sent by: </span>"gpfsug-discuss" <</span><a href="mailto:gpfsug-discuss-bounces@gpfsug.org"><span style="font-size:7.5pt;font-family:"Arial",sans-serif">gpfsug-discuss-bounces@gpfsug.org</span></a><span style="font-size:7.5pt;font-family:"Arial",sans-serif">></span><o:p></o:p></p>
<div class="MsoNormal">
<hr size="1" width="100%" noshade="" style="color:#A0A0A0" align="left">
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
<br>
<br>
<span style="font-size:7.5pt;color:white"><br>
Hi all, I need to recall from on-prem COS a folder with subfolders and files, approximately 4600 files making up 656G. We have a policy that runs every 30 mins, and I added this line to it: <br>
ZjQcmQRYFpfptBannerStart</span><b><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
This Message Is From an External Sender </span></b><span style="font-size:7.5pt;font-family:"Arial",sans-serif"><br>
This message came from outside your organization. </span><br>
<span style="font-size:7.5pt;color:white"><br>
ZjQcmQRYFpfptBannerEnd</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
Hi all,<br>
<br>
I need to recall from on-prem COS a folder with subfolders and files, approximately 4600 files making up 656G.<br>
We have a policy that runs every 30 mins, and I added this line to it:<br>
<br>
RULE 'migrate_iac-workspace_Chem-labs' MIGRATE FROM POOl 'migrate' TO POOL 'data' WHERE PATH_NAME LIKE '/gpfs/nhmfsa/bulk/share/workspace/iac-workspace/Chem_Labs/%'<br>
<br>
Migrate is an external pool<br>
RULE EXTERNAL POOL 'migrate' EXEC '/usr/lpp/mmfs/bin/mmcloudgateway files' OPTS '-F' ESCAPE '% -'<br>
<br>
And data is the default placement pool<br>
RULE 'Placement' SET POOL 'data'<br>
<br>
When it runs it identifies matching files:<br>
Rule# Hit_Cnt KB_Hit Chosen KB_Chosen KB_Ill Rule<br>
13 4846 2491152 4846 2491152 7056 RULE 'migrate_iac-workspace_Chem-labs' MIGRATE FROM POOL 'migrate' TO POOL 'data' WHERE(.)<br>
<br>
I cant find what KB_ Ill means but nothing is migrating.<br>
<br>
Migrations in other policies work, but this is a recall policy.<br>
>From this document </span><a href="https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fdocs%2Fen%2Fspectrum-scale%2F5.1.3%3Ftopic%3Dpools-migrate-recall-external&data=05%7C01%7Cp.ward%40nhm.ac.uk%7Ca34ce171bfa64681616808da68f543f1%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637937700273967446%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=WmkkYdeQwjIZwqSS3UjEJwBwrmmzA0XP6o8QhQ1JQOM%3D&reserved=0"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#0563C1">https://www.ibm.com/docs/en/spectrum-scale/5.1.3?topic=pools-migrate-recall-external</span></a><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
It suggests it should be invoked as a recall.<br>
<br>
Any ideas?<br>
<br>
Kindest regards,<br>
Paul<br>
<br>
Paul Ward<br>
TS Infrastructure Architect<br>
Natural History Museum<br>
T: 02079426450<br>
E: </span><a href="mailto:p.ward@nhm.ac.uk"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#0563C1">p.ward@nhm.ac.uk</span></a><br>
<img border="0" width="197" height="107" style="width:2.0486in;height:1.118in" id="Picture_x0020_5" src="cid:image002.jpg@01D89C33.AA634FD0" alt="A picture containing drawing
Description automatically generated"><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
</span><span style="font-size:10.0pt;font-family:"Courier New"">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at gpfsug.org<u><span style="color:blue"><br>
</span></u></span><a href="https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss_gpfsug.org&data=05%7C01%7Cp.ward%40nhm.ac.uk%7Ca34ce171bfa64681616808da68f543f1%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637937700273967446%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=4laoVLAiFUQWBj8aUcOpiuwJckP87X1uLG3UTVP1rN4%3D&reserved=0"><span style="font-size:10.0pt;font-family:"Courier New"">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</span></a><span style="font-size:10.0pt;font-family:"Courier New""> </span><br>
<br>
<br>
<tt><span style="font-size:10.0pt">_______________________________________________</span></tt><span style="font-size:10.0pt;font-family:"Courier New""><br>
<tt>gpfsug-discuss mailing list</tt><br>
<tt>gpfsug-discuss at gpfsug.org</tt><br>
<tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a> </tt><br>
<br>
</span><o:p></o:p></p>
</div>
</body>
</html>