<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="WordSection1">
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Sadly the ESCAPE only works for EXTERNAL LISTs, correct? <span style="">
</span><span style=""> </span>Not sure that I can easily modify an EXERNAL LIST to do what I want, which is a LIST policy using MISC_ATTRIBUTES and find all files without X, etc.</span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">And using <span class="SpellE">mmlsattr</span> on hundreds of millions of files will take until the next millennium, so I really would like to stick with the policy engine.<span style="">
</span>Perhaps I can do some RULE 1 feeds RULE 2 type thing?</span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Sort of thing I’m looking at:</span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">define( <span class="SpellE">immut</span>, MISC_ATTRIBUTES LIKE '%X%')</span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">RULE '<span class="SpellE">listimmut</span>' LIST 'not-<span class="SpellE">immut</span>' WHERE NOT (<span class="SpellE">exclude_list</span>) and NOT (<span class="SpellE">immut</span>)</span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">Ed Wahl</span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style="">OSC</span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<a name="_MailOriginal"><b><span style="">From:</span></b></a><span style=""><span style=""> gpfsug-discuss-bounces@spectrumscale.org <gpfsug-discuss-bounces@spectrumscale.org>
<b>On Behalf Of </b>Olaf Weiser<br>
<b>Sent:</b> Tuesday, October 5, 2021 2:10 AM<br>
<b>To:</b> gpfsug-discuss@spectrumscale.org<br>
<b>Cc:</b> gpfsug-discuss@spectrumscale.org<br>
<b>Subject:</b> Re: [gpfsug-discuss] Handling bad file names in policies?</span></span></p>
</div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""> </span></p>
<div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">Hi Ed,</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">not a ready to run for "everything".. but just to remind, there is an ESCAPE statement</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">by this you can</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> cat policy2 <br>
RULE EXTERNAL LIST 'allfiles' EXEC '/var/mmfs/etc/list.exe' ESCAPE '%/#'</span></span></p>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">and turn a file name into smth , what a policy can use</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">I haven't used it for a while , but here is an example from a while ago .. ;-)</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">[root@c25m4n03 stupid_files]# ll<br>
total 0<br>
-rw-r--r-- 1 root root 21 Mar 22 03:44 dämlicher filename<br>
-rw-r--r-- 1 root root 2 Mar 22 03:59 üöä???ßß spacefilen<br>
[root@c25m4n03 stupid_files]#</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">policy:</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">101378 247907919 0 -- /gpfs/fpofs/files/stupid_files/d%C3%A4mlicher%20filename<br>
101381 1945364096 0 -- /gpfs/fpofs/files/stupid_files/%C3%BC%C3%BC%C3%BC%C3%B6%C3%B6%C3%A4%C3%A4%3F%3F%3F%C3%9F%C3%9F%20spacefilename<br>
[I]</span></span><a href="mailto:2013-03-22@13:12:58.687"><span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">2013-03-22@13:12:58.687</span></span><span style=""></span></a><span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">
Policy execution. 2 files dispatched. </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> verify with policy (ESCAPE '%/ä ')</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">101378 247907919 0 -- /gpfs/fpofs/files/stupid_files/dämlicher filename<br>
[...] </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">hope this helps..</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">cheers</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
<blockquote style="border:none; border-left:solid #AAAAAA 1.5pt; padding:0in 0in 0in 4.0pt; margin-left:3.75pt; margin-top:5.0pt; margin-right:0in; margin-bottom:5.0pt">
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">----- Ursprüngliche Nachricht -----<br>
Von: "Jonathan Buzzard" <</span></span><a href="mailto:jonathan.buzzard@strath.ac.uk"><span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">jonathan.buzzard@strath.ac.uk</span></span><span style=""></span></a><span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">><br>
Gesendet von: </span></span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">gpfsug-discuss-bounces@spectrumscale.org</span></span><span style=""></span></a><span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"><br>
An: </span></span><a href="mailto:gpfsug-discuss@spectrumscale.org"><span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif">gpfsug-discuss@spectrumscale.org</span></span><span style=""></span></a><span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"><br>
CC:<br>
Betreff: [EXTERNAL] Re: [gpfsug-discuss] Handling bad file names in policies?<br>
Datum: Di, 5. Okt 2021 01:29<br>
</span></span></p>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Courier New"">On 04/10/2021 23:23, Wahl, Edward wrote:<br>
<br>
> I know I've run into this before way back, but my notes on how I solved<br>
> this aren't getting the job done in Scale 5.0.5.8 and my notes are from<br>
> 3.5. </span></span><span style=""><span style="font-size:10.0pt; font-family:"Segoe UI Emoji",sans-serif">😉</span></span><span style=""><span style="font-size:10.0pt; font-family:"Courier New""><br>
> Anyone know a way to get a LIST policy to properly feed bad filenames<br>
> into the output or an external script?<br>
><br>
> When I say bad I mean things like control characters, spaces, etc. Not<br>
> concerned about the dreaded 'newline' as we force users to fix those or<br>
> the files do not get backed up in Tivoli.<br>
><br>
<br>
Since when? Last time I checked which was admittedly circa 2008, TSM<br>
would backup files with newlines in them no problem. mmbackup on the<br>
other hand in that time frame would simply die and backup nothing if<br>
there was a single file on the file system with a newline in it.<br>
<br>
I would take a look at the mmbackup scripts which can handle such stuff<br>
(least ways in >4.2) which would also suggest dsmc can handle it.<br>
<br>
As an aside I now think I know how you end up with newlines in file<br>
names. Basically you cut and paste the file name complete with newlines<br>
(most likely at the end) into a text field when saving the file.<br>
Personally I think any program should baulk at that point but what do I<br>
know.<br>
<br>
<br>
JAB.<br>
<br>
--<br>
Jonathan A. Buzzard Tel: +44141-5483420<br>
HPC System Administrator, ARCHIE-WeSt.<br>
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
</span></span><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!KGKeukY!gbBLWYl7S7BX4mw1st0Uqn0jAON438v_xU5im5y1VOf3admLYLebW4C0k2nP$" target="_blank"><span style=""><span style="font-size:10.0pt; font-family:"Courier New"">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></span><span style=""></span></a><span style=""><span style="font-size:10.0pt; font-family:"Courier New""> </span></span><span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"></span></span></p>
</div>
</blockquote>
<div>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;">
<span style=""><span style="font-size:10.0pt; font-family:"Arial",sans-serif"> </span></span></p>
</div>
</div>
<span style=""></span>
<p class="MsoNormal" style="margin: 0in; font-size: 11pt; font-family: Calibri, sans-serif;margin-bottom:12.0pt">
</p>
</div>
</body>
</html>