<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Hi All,
<div class=""><br class="">
</div>
<div class="">First off, I can open a PMR for this if I need to. Second, I am far from an mmapplypolicy guru. With that out of the way … I have an mmapplypolicy job that didn’t migrate anywhere close to what it could / should have. From the log file I have
it create, here is the part where it shows the policies I told it to invoke:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[I] Qos 'maintenance' configured as inf</div>
<div class="">[I] GPFS Current Data Pool Utilization in KB and %</div>
<div class="">Pool_Name KB_Occupied KB_Total Percent_Occupied</div>
<div class="">gpfs23capacity 55365193728 124983549952 44.297984614%</div>
<div class="">gpfs23data 166747037696 343753326592 48.507759721%</div>
<div class="">system 0 0 0.000000000% (no user data)</div>
<div class="">[I] 75142046 of 209715200 inodes used: 35.830520%.</div>
<div class="">[I] Loaded policy rules from /root/gpfs/gpfs23_migration.policy.</div>
<div class="">Evaluating policy rules with CURRENT_TIMESTAMP = 2017-04-15@01:13:02 UTC</div>
<div class="">Parsed 2 policy rules.</div>
<div class=""><br class="">
</div>
<div class="">RULE 'OldStuff'</div>
<div class=""> MIGRATE FROM POOL 'gpfs23data'</div>
<div class=""> TO POOL 'gpfs23capacity'</div>
<div class=""> LIMIT(98)</div>
<div class=""> WHERE (((DAYS(CURRENT_TIMESTAMP) - DAYS(ACCESS_TIME)) > 14) AND (KB_ALLOCATED > 3584))</div>
<div class=""><br class="">
</div>
<div class="">RULE 'INeedThatAfterAll'</div>
<div class=""> MIGRATE FROM POOL 'gpfs23capacity'</div>
<div class=""> TO POOL 'gpfs23data'</div>
<div class=""> LIMIT(75)</div>
<div class=""> WHERE ((DAYS(CURRENT_TIMESTAMP) - DAYS(ACCESS_TIME)) < 14)</div>
</div>
<div class=""><br class="">
</div>
<div class="">And then the log shows it scanning all the directories and then says, "OK, here’s what I’m going to do":</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[I] Summary of Rule Applicability and File Choices:</div>
<div class=""> Rule# Hit_Cnt KB_Hit Chosen KB_Chosen KB_Ill Rule</div>
<div class=""> 0 5255960 237675081344 1868858 67355430720 0 RULE 'OldStuff' MIGRATE FROM POOL 'gpfs23data' TO POOL 'gpfs23capacity' LIMIT(98.000000) WHERE(.)</div>
<div class=""> 1 611 236745504 611 236745504 0 RULE 'INeedThatAfterAll' MIGRATE FROM POOL 'gpfs23capacity' TO POOL 'gpfs23data' LIMIT(75.000000) WHERE(.)</div>
<div class=""><br class="">
</div>
<div class="">[I] Filesystem objects with no applicable rules: 414911602.</div>
<div class=""><br class="">
</div>
<div class="">[I] GPFS Policy Decisions and File Choice Totals:</div>
<div class=""> Chose to migrate 67592176224KB: 1869469 of 5256571 candidates;</div>
<div class="">Predicted Data Pool Utilization in KB and %:</div>
<div class="">Pool_Name KB_Occupied KB_Total Percent_Occupied</div>
<div class="">gpfs23capacity 122483878944 124983549952 97.999999993%</div>
<div class="">gpfs23data 104742360032 343753326592 30.470209865%</div>
<div class="">system 0 0 0.000000000% (no user data)</div>
</div>
<div class=""><br class="">
</div>
<div class="">Notice that it says it’s only going to migrate less than 2 million of the 5.25 million candidate files!! And sure enough, that’s all it did:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">[I] A total of 1869469 files have been migrated, deleted or processed by an EXTERNAL EXEC/script;</div>
<div class=""> 0 'skipped' files and/or errors.</div>
</div>
<div class=""><br class="">
</div>
<div class="">And, not surprisingly, the gpfs23capacity pool on gpfs23 is nowhere near 98% full:</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">Disks in storage pool: gpfs23capacity (Maximum disk size allowed is 519 TB)</div>
<div class="">eon35Ansd 58.2T 35 No Yes 29.54T ( 51%) 63.93G ( 0%) </div>
<div class="">eon35Dnsd 58.2T 35 No Yes 29.54T ( 51%) 64.39G ( 0%) </div>
<div class=""> ------------- -------------------- -------------------</div>
<div class="">(pool total) 116.4T 59.08T ( 51%) 128.3G ( 0%)</div>
</div>
<div class=""><br class="">
</div>
<div class="">I don’t understand why it only migrated a small subset of what it could / should have?</div>
<div class=""><br class="">
</div>
<div class="">We are doing a migration from one filesystem (gpfs21) to gpfs23 and I really need to stuff my gpfs23capacity pool as full of data as I can to keep the migration going. Any ideas anyone? Thanks in advance…</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">
<div class="">—</div>
<div class="">Kevin Buterbaugh - Senior System Administrator</div>
<div class="">Vanderbilt University - Advanced Computing Center for Research and Education</div>
<div class=""><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" class="">Kevin.Buterbaugh@vanderbilt.edu</a> - (615)875-9633</div>
<div class=""><br class="">
</div>
<br class="Apple-interchange-newline">
</div>
<br class="">
</div>
</body>
</html>