<div dir="ltr">I'd like to offer a dissenting opinion... I believe this is a way to limit the number of actual bytes that any execution must work on.... As in only send 500gb worth of files to each invocation. Whereas the -B is the actual number of files to be passed to each invocation. I would think that size has no default limit as I've had a single invocation stuck with 30TB of data in its 100 file grouping, lol.<div><br></div><div>I however use a different mechanism to divy up my files because I need to worry about my backup streams getting choked up, and I want to take a cross section of each directory on different nights...</div><div><br></div><div>I call mmapplypolicy with -M shares=<someincrementingnumber>, so let's say I increase my number by 1 every day, starting at 0, over the course of a week...</div><div><br></div><div>In my policy I have this line:</div><div> WHERE MOD(INODE,6)<=shares</div><div><div><br></div></div><div>So then I work on 1/7th of the files in my file system and cumulatively pick up any INODES until I've hit all of the files... I could pick just the matching segment by saying = instead of <=.</div><div><br></div><div>This is happening at the file selection phase, so the application of -B is after this selection, as my files are quite huge, I tend to use -B 1.</div><div><br></div><div>Alec</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Mar 30, 2022 at 3:44 PM IBM Spectrum Scale <<a href="mailto:scale@us.ibm.com">scale@us.ibm.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><p><font size="2" face="sans-serif">Hi </font><font size="2" face="sans-serif">shao fen</font><font size="2" face="sans-serif">g,</font><br><br><font size="2" face="sans-serif">It is controlled by -B option.</font><font size="3" face="Courier-Bold"> </font><br><br><font size="3" face="Courier-Bold"><b>-B</b></font><tt><font size="3"> </font></tt><font size="3" face="Courier-Bold"><b>MaxFiles</b></font><br><tt><font size="3"> Specifies how many files are passed for each invocation</font></tt><br><tt><font size="3"> of the EXEC script. The default value is 100.</font></tt><br><br><tt><font size="3"> If the number of files exceeds the value specified for</font></tt><br><tt><font size="3"> MaxFiles, </font></tt><font size="3" face="Courier-Bold"><b>mmapplypolicy</b></font><tt><font size="3"> invokes the external</font></tt><br><tt><font size="3"> program multiple times.</font></tt><br><br><tt><font size="3"> For more information about file list records, refer to</font></tt><br><tt><font size="3"> the IBM Spectrum Scale: Administration Guide.</font></tt><br><br><font size="2" face="sans-serif">Regards, The Spectrum Scale (GPFS) team<br><br>------------------------------------------------------------------------------------------------------------------<br>If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. </font><br><br><img width="16" height="16" src="cid:17fdd293a29308fca931" border="0" alt="Inactive hide details for IBM Spectrum Scale---03/30/2022 09:53:51 AM---Hi Diane, Can you please look at the below policy relat"><font size="2" color="#424282" face="sans-serif">IBM Spectrum Scale---03/30/2022 09:53:51 AM---Hi Diane, Can you please look at the below policy related query.</font><br><br><font size="1" color="#5F5F5F" face="sans-serif">From: </font><font size="1" face="sans-serif">IBM Spectrum Scale/Poughkeepsie/IBM@IBMUS</font><br><font size="1" color="#5F5F5F" face="sans-serif">To: </font><font size="1" face="sans-serif">"gpfsug main discussion list" <<a href="mailto:gpfsug-discuss@gpfsug.org" target="_blank">gpfsug-discuss@gpfsug.org</a>>, Diane Chung/Poughkeepsie/IBM@IBMMail</font><br><font size="1" color="#5F5F5F" face="sans-serif">Cc: </font><font size="1" face="sans-serif">"gpfsug-discuss" <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org" target="_blank">gpfsug-discuss-bounces@gpfsug.org</a>></font><br><font size="1" color="#5F5F5F" face="sans-serif">Date: </font><font size="1" face="sans-serif">03/30/2022 09:53 AM</font><br><font size="1" color="#5F5F5F" face="sans-serif">Subject: </font><font size="1" face="sans-serif">[EXTERNAL] Re: [gpfsug-discuss] default value of SIZE in EXTERNAL POOL and EXTERNAL LIST rule</font><br><font size="1" color="#5F5F5F" face="sans-serif">Sent by: </font><font size="1" face="sans-serif">"gpfsug-discuss" <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org" target="_blank">gpfsug-discuss-bounces@gpfsug.org</a>></font><br></p><hr width="100%" size="2" align="left" noshade style="color:rgb(128,145,165)"><br><br><br><font size="2" face="sans-serif">Hi Diane,</font><font size="3" face="serif"><br></font><font size="2" face="sans-serif"><br>Can you please look at the below policy related query.</font><font size="3" face="serif"><br></font><font size="2" face="sans-serif"><br>Regards, The Spectrum Scale (GPFS) team<br><br>------------------------------------------------------------------------------------------------------------------<br>If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at </font><a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479" target="_blank"><font size="2" color="#0000FF" face="sans-serif"><u>https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</u></font></a><font size="2" face="sans-serif">. <br><br>If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. <br><br>The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.</font><font size="3" face="serif"><br><br></font><img src="cid:17fdd293a29308fca931" width="16" height="16" alt="Inactive hide details for "shao feng" ---28-03-2022 03.21.39 PM---Hello, What is the default value of SIZE in EXTERNAL POOL in"><font size="2" color="#424282" face="sans-serif">"shao feng" ---28-03-2022 03.21.39 PM---Hello, What is the default value of SIZE in EXTERNAL POOL in filesystem policy?</font><font size="3" face="serif"><br></font><font size="1" color="#5F5F5F" face="sans-serif"><br>From: </font><font size="1" face="sans-serif">"shao feng" <<a href="mailto:shaof777@gmail.com" target="_blank">shaof777@gmail.com</a>></font><font size="1" color="#5F5F5F" face="sans-serif"><br>To: </font><font size="1" face="sans-serif">"gpfsug main discussion list" <<a href="mailto:gpfsug-discuss@gpfsug.org" target="_blank">gpfsug-discuss@gpfsug.org</a>></font><font size="1" color="#5F5F5F" face="sans-serif"><br>Date: </font><font size="1" face="sans-serif">28-03-2022 03.21 PM</font><font size="1" color="#5F5F5F" face="sans-serif"><br>Subject: </font><font size="1" face="sans-serif">[EXTERNAL] [gpfsug-discuss] default value of SIZE in EXTERNAL POOL and EXTERNAL LIST rule</font><font size="1" color="#5F5F5F" face="sans-serif"><br>Sent by: </font><font size="1" face="sans-serif">"gpfsug-discuss" <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org" target="_blank">gpfsug-discuss-bounces@gpfsug.org</a>></font><font size="3" face="serif"><br></font><hr width="100%" size="2" align="left" noshade><font size="3" face="serif"><br><br></font><font size="3" color="#161616" face="IBM Plex Sans"><br>Hello,</font><font size="3" face="serif"><br></font><font size="3" color="#161616" face="IBM Plex Sans"><br>What is the default value of SIZE in EXTERNAL POOL in filesystem policy?</font><font size="3" face="serif"><br></font><font size="3" color="#161616" face="IBM Plex Sans"><br>The document did not mention that, but I found it is not infinity if not specified.</font><font size="3" face="serif"><br></font><font size="3" color="#161616" face="IBM Plex Sans"><br>Thank you!</font><font size="3" face="serif"><br></font><font size="3" color="#161616" face="IBM Plex Sans"><b><br>SIZE </b></font><font size="3" color="#161616" face="serif"><b><i>sum-number</i></b></font><br><font size="3" color="#161616" face="IBM Plex Sans">Is an optional clause of the </font><font size="3" color="#161616" face="serif"><b>EXTERNAL POOL</b></font><font size="3" color="#161616" face="IBM Plex Sans"> and </font><font size="3" color="#161616" face="serif"><b>EXTERNAL LIST</b></font><font size="3" color="#161616" face="IBM Plex Sans"> rules. </font><font size="3" color="#161616" face="serif"><i>sum-number</i></font><font size="3" color="#161616" face="IBM Plex Sans"> limits the total number of bytes in all of the files named in each list of files passed to your EXEC 'script'. If a single file is larger than </font><font size="3" color="#161616" face="serif"><i>sum-number</i></font><font size="3" color="#161616" face="IBM Plex Sans">, it is passed to your EXEC 'script' as the only entry in a </font><font size="3" color="#161616" face="serif">“</font><font size="3" color="#161616" face="IBM Plex Sans">singleton</font><font size="3" color="#161616" face="serif">”</font><font size="3" color="#161616" face="IBM Plex Sans"> file list.</font><p><font size="3" color="#161616" face="serif">Specify </font><font size="3" color="#161616" face="serif"><i>sum-number</i></font><font size="3" color="#161616" face="serif"> as a numeric constant or a floating-point value.</font></p><p></p><table border="0" cellspacing="0" cellpadding="0"><tbody><tr valign="top"><td width="1066" valign="middle"><font size="3" color="#161616" face="serif"><b>Note:</b></font><font size="3" color="#161616" face="serif"> The value of </font><font size="3" color="#161616" face="serif"><i>sum-number</i></font><font size="3" color="#161616" face="serif"> is in kilobytes.</font></td></tr></tbody></table><a href="https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=rules-policy-terms" target="_blank"><font size="3" color="#0000FF" face="serif"><u>https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=rules-policy-terms</u></font></a><tt><font size="2">_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at <a href="http://gpfsug.org" target="_blank">gpfsug.org</a></font></tt><tt><font size="2" color="#0000FF"><u><br></u></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" target="_blank"><tt><font size="2" color="#0000FF"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</u></font></tt></a><tt><font size="2"> </font></tt><font size="3" face="serif"><br><br></font><br><font size="3" face="serif"><br></font><tt><font size="2">_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at <a href="http://gpfsug.org" target="_blank">gpfsug.org</a><br></font></tt><tt><font size="2"><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a></font></tt><tt><font size="2"> <br></font></tt><br><br><br>
<br>
<p></p><p></p><p></p></div>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://gpfsug.org" rel="noreferrer" target="_blank">gpfsug.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a><br>
</blockquote></div>