<div><br></div><div dir="auto">Just guessing, but maybe some «where <span style="font-style:inherit;font-variant-caps:inherit;font-weight:bold;letter-spacing:0.1599999964237213px;font-family:"IBM Plex Sans","Helvetica Neue",Arial,sans-serif">SNAP_ID(</span><span style="font-style:inherit;font-variant-caps:inherit;font-weight:bold;letter-spacing:0.1599999964237213px;font-family:"IBM Plex Sans","Helvetica Neue",Arial,sans-serif">'</span><span class="ph synph" style="font-style:inherit;font-variant-caps:inherit;letter-spacing:0.1599999964237213px;box-sizing:border-box;padding:0px;border:0px rgb(236,236,236);margin:0px;font-stretch:inherit;line-height:inherit;vertical-align:baseline;font-family:"IBM Plex Sans","Helvetica Neue",Arial,sans-serif"><span class="ph var" style="box-sizing:border-box;padding:0px;border:0px rgb(47,49,52);margin:0px;font-style:italic;font-variant-caps:inherit;font-stretch:inherit;line-height:inherit;vertical-align:baseline;font-family:"IBM Plex Sans","Helvetica Neue",Arial,sans-serif">SnapshotName</span></span><span style="font-style:inherit;font-variant-caps:inherit;font-weight:bold;letter-spacing:0.1599999964237213px;font-family:"IBM Plex Sans","Helvetica Neue",Arial,sans-serif">')» is better than -S 20210104?</span></div><div dir="auto"><span style="font-style:inherit;font-variant-caps:inherit;font-weight:bold;letter-spacing:0.1599999964237213px;font-family:"IBM Plex Sans","Helvetica Neue",Arial,sans-serif"><br></span></div><div dir="auto"><span style="font-style:inherit;font-variant-caps:inherit;font-weight:bold;letter-spacing:0.1599999964237213px;font-family:"IBM Plex Sans","Helvetica Neue",Arial,sans-serif"><br></span></div><div dir="auto"><span style="font-style:inherit;font-variant-caps:inherit;font-weight:bold;letter-spacing:0.1599999964237213px;font-family:"IBM Plex Sans","Helvetica Neue",Arial,sans-serif">?</span></div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">tir. 3. aug. 2021 kl. 20:59 skrev Peeples, Heath <<a href="mailto:heathp@hpc.msstate.edu">heathp@hpc.msstate.edu</a>>:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)">





<div lang="EN-US" link="blue" vlink="purple">
<div class="m_-4992294717991483253WordSection1">
<p class="MsoNormal">Yes, that advertisement makes me smile <span style="font-family:"Segoe UI Emoji",sans-serif">
😊</span><u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I have tried both of those, and they do not seem to make any difference.  I have also played with the -A and -a parameters with no combination that I can find making it any better.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks for the feedback.<u></u><u></u></p></div></div><div lang="EN-US" link="blue" vlink="purple"><div class="m_-4992294717991483253WordSection1">
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b>From:</b> <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectrumscale.org</a> <<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectrumscale.org</a>>
<b>On Behalf Of </b>Jan-Frode Myklebust<br>
<b>Sent:</b> Tuesday, August 3, 2021 1:49 PM<br>
<b>To:</b> gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a>><br>
<b>Subject:</b> Re: [gpfsug-discuss] mmapplypolicy slow<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">So…. the advertisement ssys we should be able to do 1M files/s… <u></u><u></u></p>
<div>
<p class="MsoNormal"><a href="http://secure-web.cisco.com/1qQpvD9F4NtOuzGs8G_8PtFl-CwL-8JNJO1mx5gEbI7QwDLGI58rp5A1Zj3Q1nQoonzr0pdbS8-5R4oc5DLLmaBS6PQJ0HXdquIC5cLIlmasuY6rJfZ_dnC7zPJmBySjicZ0rFC-nrhKEnu-_J-arj4xmzx2VxDYJlbreMnsJfs8xW-c4B_Hnf7N9sPPXQ2b6C8jORSfUogYE0Lue9d2OEn-ITxLZdDzB34linSMOE1kYikuG5ewgP6p0nhcznywEWQr_aE1zvb_kgT9pW4ldt39RkTfGbH-O72Aa-sBxa9NilSUt8K-5wXh6KkXTvTln/http%3A%2F%2Ffiles.gpfsug.org%2Fpresentations%2F2018%2FUSA%2FSpectrumScalePolicyBP.pdf" target="_blank">http://files.gpfsug.org/presentations/2018/USA/SpectrumScalePolicyBP.pdf</a><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">First I  would try is if maybe limiting which nodes are used for the processing helps. Maybe limit to the NSD-servers (-N nodenames) ?<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Also,  --choice-algorithm fast might help..?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">  -jf<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">tir. 3. aug. 2021 kl. 20:18 skrev Peeples, Heath <<a href="mailto:heathp@hpc.msstate.edu" target="_blank">heathp@hpc.msstate.edu</a>>:<u></u><u></u></p>
</div>
<blockquote style="border-style:none none none solid;border-left-width:1pt;padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in;border-left-color:rgb(204,204,204)">
<div>
<div>
<p class="MsoNormal"><span style="font-family:"Courier New"">I am trying to use mmapplypolicy to determine what files are modified in a particular snapshop.  Below I have the policy and mmapplypolicy
 parameters I am using.  It is taking 3-4 hours to list these files. There are roughly 176M files.  This is running on a DDN Gridscaler 12K system.   Seems to me after seeing others posts we should be able to run this much quicker.  Any help would be appreciated.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New""> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New""> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">mmapplypolicy fs2 -S 20210104 -I defer -A 175 -a 72 -B 10000  -N all -g /fs1/tmp/heath -P /fs2/tmp/snaps/heath.pol -f /fs2/tmp/snaps/heath/output/20210104</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New""> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">RULE 'find_mods' list 'mods'</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">DIRECTORIES_PLUS</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">WEIGHT(0)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">SHOW( VARCHAR(USER_ID) || ' ' || varchar(FILE_SIZE) || ' ' || varchar(MODIFICATION_SNAPID) )</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New""> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New""> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">Heath</span><u></u><u></u></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://secure-web.cisco.com/13y0L5a_-UdTp06HAY-SQnbTVm8HkHswo4iplosUAzEBhW3s6Y6LnTuCvikd3KQuk_YPuAuKhDLAzBjCcmelrVS146XsPHgLLLSbAb3bAKY9dZ10sV8_ErYKn0OqyE8gPgh4kjWnswfL7oomTnhYj4D1Q2mY83UI82dAJAX-2n8NaxlfloOFS23DgFMEULXJgy-wNH_cLemLqseter9-Rj2yO3jsruIBj3_DcY_Z87ffxo0SQcYazbJvThTeqb5C1o6hepHZkalgmUvQE6K2CAV_sX4cWrNs5GNqPy7xifM9tlbvhwJvwSvZGlTO_da4e/http%3A%2F%2Fspectrumscale.org" target="_blank">
spectrumscale.org</a><br>
<a href="http://secure-web.cisco.com/1joeovhVrYzawY9kLy658LHgv3dW6Ta7uZzGAlu08q1o21Rw4o615cnGStXQ0NQeAYE2jCpJAzC7DKAzkxD_cgeRLlQkKVRPFm8QFIMXwGcESXOwOmKXVVD5fq8H0gBD6VasiBdUmWrijLwK0QFvEduBRSXIqQ-sWoxrR1onYwyJEPV--XMh-r1O-92mnjtaUNVuSS2KXElVq8rc2O33St8Ga2qd5QSTT2pUQcbr2IJUM4a2gu0ZrtVQgRBRTZU1ZuoPnFZY8AL4tubpqa6vK_x_dt-W6bkV1XKSre2XQMxCaNb9Bm2_bKJgfhamPC-Rf/http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><u></u><u></u></p>
</blockquote>
</div>
</div>
</div>
</div>

_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" rel="noreferrer" target="_blank">spectrumscale.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br>
</blockquote></div></div>