<html><body><p><font size="2">The script in mmfs/bin/mmxargs handles mmapplypolicy EXTERNAL LIST file lists perfectly. No need to worry about whitespaces and so forth.</font><br><font size="2">Give it a look-see and a try<br></font><br><font size="2">-- marc of GPFS - </font><br><img width="16" height="16" src="cid:1__=0ABB0E4DDFFF329F8f9e8a93df938690918c0AB@" border="0" alt="Inactive hide details for Jonathan Buzzard ---12/28/2019 10:17:19 AM---On 27/12/2019 14:20, david_johnson@brown.edu wrote: > Yo"><font size="2" color="#424282">Jonathan Buzzard ---12/28/2019 10:17:19 AM---On 27/12/2019 14:20, david_johnson@brown.edu wrote: > You would want to look for examples of externa</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">Jonathan Buzzard <jonathan.buzzard@strath.ac.uk></font><br><font size="2" color="#5F5F5F">To: </font><font size="2">"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org></font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">12/28/2019 10:17 AM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">[EXTERNAL] Re: [gpfsug-discuss] Question about Policies</font><br><font size="2" color="#5F5F5F">Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><tt><font size="2">On 27/12/2019 14:20, david_johnson@brown.edu wrote:<br>> You would want to look for examples of external scripts that work on the <br>> result of running the policy engine in listing mode. The one issue that <br>> might need some attention is the way that gpfs quotes unprintable <br>> characters in the pathname. So the policy engine generates the list and <br>> your external script does the moving.<br>> <br><br>In my experience a good starting point would be to scan the list of <br>files from the policy engine and separate the files out into "normal"; <br>that is files using basic ASCII and no special characters and the rest <br>also known as the "wacky pile".<br><br>Given that you are UK based it is not unreasonable to expect all path <br>and file names to be in English. There might (and if not probably <br>should) be an institutional policy mandating it. Not much use if a <br>researcher saves everything in Greek then gets knocked over by a bus and <br>person picking up the work is Spanish for example.<br><br>Hopefully the "wacky pile" is small, however expect to find all sorts of <br>bizarre file and path names in it. We are talking wildcards, back ticks, <br>even newline characters to name but a few.<br><br>Depending on the amount of data in the "wacky" pile you might just want <br>to forget about moving them, as they are orders of magnitude more <br>difficult to deal with than files with "sane" path and file names and <br>can rapidly soak up large chunks of time trying to deal with them in <br>scripts.<br><br>JAB.<br><br>-- <br>Jonathan A. Buzzard Tel: +44141-5483420<br>HPC System Administrator, ARCHIE-WeSt.<br>University of Strathclyde, John Anderson Building, Glasgow. G4 0NG<br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><tt><font size="2"><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></font></tt><tt><font size="2"> <br><br></font></tt><br><br><BR>
</body></html>