<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
Hi Marc,
<div class=""><br class="">
</div>
<div class="">Thanks, I’m going to give this a try as the first mmfind finally finished overnight, but produced no output:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">/root</div>
<div class="">root@gpfsmgrb# bash -x ~/bin/klb.sh</div>
<div class="">+ cd /usr/lpp/mmfs/samples/ilm</div>
<div class="">+ ./mmfind /gpfs23 -inum 113769917 -o -inum 132539418 -o -inum 135584191 -o -inum 136471839 -o -inum 137009371 -o -inum 137314798 -o -inum 137939675 -o -inum 137997971 -o -inum 138013736 -o -inum 138029061 -o -inum 138029065 -o -inum 138029076
-o -inum 138029086 -o -inum 138029093 -o -inum 138029099 -o -inum 138029101 -o -inum 138029102 -o -inum 138029106 -o -inum 138029112 -o -inum 138029113 -o -inum 138029114 -o -inum 138029119 -o -inum 138029120 -o -inum 138029121 -o -inum 138029130 -o -inum
138029131 -o -inum 138029132 -o -inum 138029141 -o -inum 138029146 -o -inum 138029147 -o -inum 138029152 -o -inum 138029153 -o -inum 138029154 -o -inum 138029163 -o -inum 138029164 -o -inum 138029165 -o -inum 138029174 -o -inum 138029175 -o -inum 138029176
-o -inum 138083075 -o -inum 138083148 -o -inum 138083149 -o -inum 138083155 -o -inum 138216465 -o -inum 138216483 -o -inum 138216507 -o -inum 138216535 -o -inum 138235320 -ls</div>
<div class="">/root</div>
<div class="">root@gpfsmgrb# </div>
<div class=""><br class="">
</div>
<div class="">BTW, I had put that in a simple script simply because I had a list of those inodes and it was easier for me to get that in the format I wanted via a script that I was editing than trying to do that on the command line.</div>
<div class=""><br class="">
</div>
<div class="">However, in the log file it was producing it “hit” on 48 files:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[I] Inodes scan: 978275821 files, 99448202 directories, 37189547 other objects, 1967508 'skipped' files and/or errors.</div>
<div class="">[I] 2018-03-06@23:43:15.988 Policy evaluation. 1114913570 files scanned. </div>
<div class="">[I] 2018-03-06@23:43:16.016 Sorting 48 candidate file list records. </div>
<div class="">[I] 2018-03-06@23:43:16.040 Sorting 48 candidate file list records. </div>
<div class="">[I] 2018-03-06@23:43:16.065 Choosing candidate files. 0 records scanned. </div>
<div class="">[I] 2018-03-06@23:43:16.066 Choosing candidate files. 48 records scanned. </div>
<div class="">[I] Summary of Rule Applicability and File Choices:</div>
<div class=""> Rule#<span class="Apple-tab-span" style="white-space:pre"> </span>
Hit_Cnt<span class="Apple-tab-span" style="white-space:pre"> </span> KB_Hit<span class="Apple-tab-span" style="white-space:pre">
</span> Chosen<span class="Apple-tab-span" style="white-space:pre"> </span> KB_Chosen<span class="Apple-tab-span" style="white-space:pre">
</span> KB_Ill<span class="Apple-tab-span" style="white-space:pre"> </span>Rule</div>
<div class=""> 0<span class="Apple-tab-span" style="white-space:pre"> </span>
48<span class="Apple-tab-span" style="white-space:pre"> </span>1274453504<span class="Apple-tab-span" style="white-space:pre">
</span> 48<span class="Apple-tab-span" style="white-space:pre"> </span>1274453504<span class="Apple-tab-span" style="white-space:pre">
</span> 0<span class="Apple-tab-span" style="white-space:pre"> </span>RULE 'mmfind' LIST 'mmfindList' DIRECTORIES_PLUS SHOW(.) WHERE(.)</div>
<div class=""><br class="">
</div>
<div class="">[I] Filesystem objects with no applicable rules: 1112946014.</div>
<div class=""><br class="">
</div>
<div class="">[I] GPFS Policy Decisions and File Choice Totals:</div>
<div class=""> Chose to list 1274453504KB: 48 of 48 candidates;</div>
<div class="">Predicted Data Pool Utilization in KB and %:</div>
<div class="">Pool_Name <span class="Apple-tab-span" style="white-space:pre">
</span> KB_Occupied<span class="Apple-tab-span" style="white-space:pre"> </span>
KB_Total<span class="Apple-tab-span" style="white-space:pre"> </span>Percent_Occupied</div>
<div class="">gpfs23capacity <span class="Apple-tab-span" style="white-space:pre">
</span> 564722407424<span class="Apple-tab-span" style="white-space:pre"> </span>
624917749760<span class="Apple-tab-span" style="white-space:pre"> </span> 90.367477583%</div>
<div class="">gpfs23data <span class="Apple-tab-span" style="white-space:pre">
</span> 304797672448<span class="Apple-tab-span" style="white-space:pre"> </span>
531203506176<span class="Apple-tab-span" style="white-space:pre"> </span> 57.378701177%</div>
<div class="">system <span class="Apple-tab-span" style="white-space:pre">
</span> 0<span class="Apple-tab-span" style="white-space:pre"> </span>
0<span class="Apple-tab-span" style="white-space:pre"> </span> 0.000000000% (no user data)</div>
<div class="">[I] 2018-03-06@23:43:16.066 Policy execution. 0 files dispatched. </div>
<div class="">[I] 2018-03-06@23:43:16.102 Policy execution. 0 files dispatched. </div>
<div class="">[I] A total of 0 files have been migrated, deleted or processed by an EXTERNAL EXEC/script;</div>
<div class=""><span class="Apple-tab-span" style="white-space:pre"></span>0 'skipped' files and/or errors.</div>
</div>
<div class=""><br class="">
</div>
<div>While I’m going to follow your suggestion next, if you (or anyone else on the list) can explain why the “Hit_Cnt” is 48 but the “-ls” I passed to mmfind didn’t result in anything being listed, my curiosity is piqued.</div>
<div><br class="">
</div>
<div>And I’ll go ahead and say it before someone else does … I haven’t just chosen a special case, I AM a special case… ;-)</div>
<div><br class="">
</div>
<div>Kevin</div>
<div><br class="">
<blockquote type="cite" class="">
<div class="">On Mar 6, 2018, at 4:27 PM, Marc A Kaplan <<a href="mailto:makaplan@us.ibm.com" class="">makaplan@us.ibm.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class=""><font size="2" face="sans-serif" class="">Please try:</font><br class="">
<br class="">
<font size="2" face="sans-serif" class="">mmfind --polFlags '-N a_node_list -g /gpfs23/tmp' directory find-flags ...<br class="">
</font><br class="">
<font size="2" face="sans-serif" class="">Where a_node_list is a node list of your choice and /gpfs23/tmp is a temp directory of your choice...</font><br class="">
<br class="">
<font size="2" face="sans-serif" class="">And let us know how that goes.</font><br class="">
<br class="">
<font size="2" face="sans-serif" class="">Also, you have chosen a special case, just looking for some inode numbers -- so find can skip stating the other inodes...<br class="">
whereas mmfind is not smart enough to do that -- but still with parallelism, I'd guess mmapplypolicy might still beat find in elapsed time to complete, even for this special case.</font><br class="">
<br class="">
<font size="2" face="sans-serif" class="">-- Marc K of GPFS</font><br class="">
<br class="">
<br class="">
<br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">From: </font><font size="1" face="sans-serif" class="">"Buterbaugh, Kevin L" <<a href="mailto:Kevin.Buterbaugh@Vanderbilt.Edu" class="">Kevin.Buterbaugh@Vanderbilt.Edu</a>></font><br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">To: </font><font size="1" face="sans-serif" class="">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" class="">gpfsug-discuss@spectrumscale.org</a>></font><br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">Date: </font><font size="1" face="sans-serif" class="">03/06/2018 01:52 PM</font><br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">Subject: </font><font size="1" face="sans-serif" class="">[gpfsug-discuss] mmfind performance</font><br class="">
<font size="1" color="#5f5f5f" face="sans-serif" class="">Sent by: </font><font size="1" face="sans-serif" class=""><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" class="">gpfsug-discuss-bounces@spectrumscale.org</a></font><br class="">
<hr noshade="" class="">
<br class="">
<br class="">
<br class="">
<font size="3" class="">Hi All, </font><br class="">
<br class="">
<font size="3" class="">In the README for the mmfind command it says:</font><br class="">
<br class="">
<font size="3" class="">mmfind</font><br class="">
<font size="3" class=""> A highly efficient file system traversal tool, designed to serve</font><br class="">
<font size="3" class=""> as a drop-in replacement for the 'find' command as used against GPFS FSes.</font><br class="">
<br class="">
<font size="3" class="">And:</font><br class="">
<br class="">
<font size="3" class="">mmfind is expected to be slower than find on file systems with relatively few inodes.</font><br class="">
<font size="3" class="">This is due to the overhead of using mmapplypolicy.</font><br class="">
<font size="3" class="">However, if you make use of the -exec flag to carry out a relatively expensive operation
</font><br class="">
<font size="3" class="">on each file (e.g. compute a checksum), using mmfind should yield a significant performance
</font><br class="">
<font size="3" class="">improvement, even on a file system with relatively few inodes.</font><br class="">
<br class="">
<font size="3" class="">I have a list of just shy of 50 inode numbers that I need to figure out what file they correspond to, so I decided to give mmfind a try:</font><br class="">
<br class="">
<font size="3" class="">+ cd /usr/lpp/mmfs/samples/ilm</font><br class="">
<font size="3" class="">+ ./mmfind /gpfs23 -inum 113769917 -o -inum 132539418 -o -inum 135584191 -o -inum 136471839 -o -inum 137009371 -o -inum 137314798 -o -inum 137939675 -o -inum 137997971 -o -inum 138013736 -o -inum 138029061 -o -inum 138029065 -o -inum
138029076 -o -inum 138029086 -o -inum 138029093 -o -inum 138029099 -o -inum 138029101 -o -inum 138029102 -o -inum 138029106 -o -inum 138029112 -o -inum 138029113 -o -inum 138029114 -o -inum 138029119 -o -inum 138029120 -o -inum 138029121 -o -inum 138029130
-o -inum 138029131 -o -inum 138029132 -o -inum 138029141 -o -inum 138029146 -o -inum 138029147 -o -inum 138029152 -o -inum 138029153 -o -inum 138029154 -o -inum 138029163 -o -inum 138029164 -o -inum 138029165 -o -inum 138029174 -o -inum 138029175 -o -inum
138029176 -o -inum 138083075 -o -inum 138083148 -o -inum 138083149 -o -inum 138083155 -o -inum 138216465 -o -inum 138216483 -o -inum 138216507 -o -inum 138216535 -o -inum 138235320 -ls</font><br class="">
<br class="">
<font size="3" class="">I kicked that off last Friday and it is _still_ running. By comparison, I have a Perl script that I have run in the past that simple traverses the entire filesystem tree and stat’s each file and outputs that to a log file. That script
would “only” run ~24 hours.</font><br class="">
<br class="">
<font size="3" class="">Clearly mmfind as I invoked it is much slower than the corresponding Perl script, so what am I doing wrong? Thanks…</font><br class="">
<br class="">
<font size="3" class="">Kevin</font><br class="">
<br class="">
<font size="3" class="">—</font><br class="">
<font size="3" class="">Kevin Buterbaugh - Senior System Administrator</font><br class="">
<font size="3" class="">Vanderbilt University - Advanced Computing Center for Research and Education</font><br class="">
<a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" class=""><font size="3" color="blue" class=""><u class="">Kevin.Buterbaugh@vanderbilt.edu</u></font></a><font size="3" class="">- (615)875-9633</font><br class="">
<br class="">
<br class="">
<tt class=""><font size="2" class="">_______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class="">
</font></tt><a href="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Furldefense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttp-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss%26d%3DDwICAg%26c%3Djf_iaSHvJObTbx-siA1ZOg%26r%3DcvpnBBH0j41aQy0RPiG2xRL_M8mTc1izuQD3_PmtjZ8%26m%3D48WYhVkWI1kr_BM-Wg_VaXEOi7xfGusnZcJtkiA98zg%26s%3DIXUhEC_thuGAVwGJ02oazCCnKEuAdGeg890fBelP4kE%26e%3D&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C724521c8034241913d8508d58412dcf8%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C636560138922366489&sdata=qp%2FZwpYl77ThzYApt5VKMnPVfIc44BR6dOwTl62HpXM%3D&reserved=0" class=""><tt class=""><font size="2" class="">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=cvpnBBH0j41aQy0RPiG2xRL_M8mTc1izuQD3_PmtjZ8&m=48WYhVkWI1kr_BM-Wg_VaXEOi7xfGusnZcJtkiA98zg&s=IXUhEC_thuGAVwGJ02oazCCnKEuAdGeg890fBelP4kE&e=</font></tt></a><tt class=""><font size="2" class=""><br class="">
</font></tt><br class="">
<br class="">
<br class="">
_______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class="">
<a href="https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C724521c8034241913d8508d58412dcf8%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C636560138922366489&sdata=faXozQ%2FGGDf8nARmk52%2B2W5eIEBfnYwNapJyH%2FagqIQ%3D&reserved=0" class="">https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C724521c8034241913d8508d58412dcf8%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C636560138922366489&sdata=faXozQ%2FGGDf8nARmk52%2B2W5eIEBfnYwNapJyH%2FagqIQ%3D&reserved=0</a><br class="">
</div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>