<font size=2 face="sans-serif">Please try:</font><br><br><font size=2 face="sans-serif">mmfind --polFlags '-N a_node_list -g
/gpfs23/tmp' directory find-flags ...<br></font><br><font size=2 face="sans-serif">Where a_node_list is a node list of
your choice and /gpfs23/tmp is a temp directory of your choice...</font><br><br><font size=2 face="sans-serif">And let us know how that goes.</font><br><br><font size=2 face="sans-serif">Also, you have chosen a special case,
just looking for some inode numbers -- so find can skip stating the other
inodes...<br>whereas mmfind is not smart enough to do that -- but still with parallelism,
I'd guess mmapplypolicy might still beat find in elapsed time to complete,
even for this special case.</font><br><br><font size=2 face="sans-serif">-- Marc K of GPFS</font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">"Buterbaugh, Kevin
L" <Kevin.Buterbaugh@Vanderbilt.Edu></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">gpfsug main discussion
list <gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">03/06/2018 01:52 PM</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">[gpfsug-discuss]
mmfind performance</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=3>Hi All, </font><br><br><font size=3>In the README for the mmfind command it says:</font><br><br><font size=3>mmfind</font><br><font size=3> A highly efficient file system traversal tool,
designed to serve</font><br><font size=3> as a drop-in replacement for the 'find' command
as used against GPFS FSes.</font><br><br><font size=3>And:</font><br><br><font size=3>mmfind is expected to be slower than find on file systems
with relatively few inodes.</font><br><font size=3>This is due to the overhead of using mmapplypolicy.</font><br><font size=3>However, if you make use of the -exec flag to carry out
a relatively expensive operation </font><br><font size=3>on each file (e.g. compute a checksum), using mmfind should
yield a significant performance </font><br><font size=3>improvement, even on a file system with relatively few
inodes.</font><br><br><font size=3>I have a list of just shy of 50 inode numbers that I need
to figure out what file they correspond to, so I decided to give mmfind
a try:</font><br><br><font size=3>+ cd /usr/lpp/mmfs/samples/ilm</font><br><font size=3>+ ./mmfind /gpfs23 -inum 113769917 -o -inum 132539418
-o -inum 135584191 -o -inum 136471839 -o -inum 137009371 -o -inum 137314798
-o -inum 137939675 -o -inum 137997971 -o -inum 138013736 -o -inum 138029061
-o -inum 138029065 -o -inum 138029076 -o -inum 138029086 -o -inum 138029093
-o -inum 138029099 -o -inum 138029101 -o -inum 138029102 -o -inum 138029106
-o -inum 138029112 -o -inum 138029113 -o -inum 138029114 -o -inum 138029119
-o -inum 138029120 -o -inum 138029121 -o -inum 138029130 -o -inum 138029131
-o -inum 138029132 -o -inum 138029141 -o -inum 138029146 -o -inum 138029147
-o -inum 138029152 -o -inum 138029153 -o -inum 138029154 -o -inum 138029163
-o -inum 138029164 -o -inum 138029165 -o -inum 138029174 -o -inum 138029175
-o -inum 138029176 -o -inum 138083075 -o -inum 138083148 -o -inum 138083149
-o -inum 138083155 -o -inum 138216465 -o -inum 138216483 -o -inum 138216507
-o -inum 138216535 -o -inum 138235320 -ls</font><br><br><font size=3>I kicked that off last Friday and it is _still_ running.
By comparison, I have a Perl script that I have run in the past that
simple traverses the entire filesystem tree and stat’s each file and outputs
that to a log file. That script would “only” run ~24 hours.</font><br><br><font size=3>Clearly mmfind as I invoked it is much slower than the
corresponding Perl script, so what am I doing wrong? Thanks…</font><br><br><font size=3>Kevin</font><br><br><font size=3>—</font><br><font size=3>Kevin Buterbaugh - Senior System Administrator</font><br><font size=3>Vanderbilt University - Advanced Computing Center for
Research and Education</font><br><a href=mailto:Kevin.Buterbaugh@vanderbilt.edu><font size=3 color=blue><u>Kevin.Buterbaugh@vanderbilt.edu</u></font></a><font size=3>- (615)875-9633</font><br><br><br><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=cvpnBBH0j41aQy0RPiG2xRL_M8mTc1izuQD3_PmtjZ8&m=48WYhVkWI1kr_BM-Wg_VaXEOi7xfGusnZcJtkiA98zg&s=IXUhEC_thuGAVwGJ02oazCCnKEuAdGeg890fBelP4kE&e="><tt><font size=2>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=cvpnBBH0j41aQy0RPiG2xRL_M8mTc1izuQD3_PmtjZ8&m=48WYhVkWI1kr_BM-Wg_VaXEOi7xfGusnZcJtkiA98zg&s=IXUhEC_thuGAVwGJ02oazCCnKEuAdGeg890fBelP4kE&e=</font></tt></a><tt><font size=2><br></font></tt><br><br><BR>