[gpfsug-discuss] mmapplypolicy slow

[Jan-Frode Myklebust]

So…. the advertisement ssys we should be able to do 1M files/s…
http://files.gpfsug.org/presentations/2018/USA/SpectrumScalePolicyBP.pdf

First I  would try is if maybe limiting which nodes are used for the
processing helps. Maybe limit to the NSD-servers (-N nodenames) ?

Also,  --choice-algorithm fast might help..?



  -jf


tir. 3. aug. 2021 kl. 20:18 skrev Peeples, Heath <heathp at hpc.msstate.edu>:

> I am trying to use mmapplypolicy to determine what files are modified in a
> particular snapshop.  Below I have the policy and mmapplypolicy parameters
> I am using.  It is taking 3-4 hours to list these files. There are roughly
> 176M files.  This is running on a DDN Gridscaler 12K system.   Seems to me
> after seeing others posts we should be able to run this much quicker.  Any
> help would be appreciated.
>
>
>
>
>
> mmapplypolicy fs2 -S 20210104 -I defer -A 175 -a 72 -B 10000  -N all -g
> /fs1/tmp/heath -P /fs2/tmp/snaps/heath.pol -f
> /fs2/tmp/snaps/heath/output/20210104
>
>
>
> RULE 'find_mods' list 'mods'
>
> DIRECTORIES_PLUS
>
> WEIGHT(0)
>
> SHOW( VARCHAR(USER_ID) || ' ' || varchar(FILE_SIZE) || ' ' ||
> varchar(MODIFICATION_SNAPID) )
>
>
>
>
>
> Heath
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20210803/72631f54/attachment-0002.htm>