<div dir="auto">Well....<div dir="auto"><br></div><div dir="auto">How about:</div><div dir="auto"><br></div><div dir="auto">define(DISPLAY_NEWLINE,[CASE WHEN ($1) *HAS NEWLINE* THEN *REPLACE NEWLINE WITH ALTERNATE CHARACTER* ELSE varchar(1) END])</div><div dir="auto"><br></div><div dir="auto">Define your show to have the DISPLAY_NEWLINE in place of the file name?</div><div dir="auto"><br></div><div dir="auto"><br></div><div dir="auto">Sorry I don't know offhand how to do the find newline and replace newline sql string code, I don't have gpfs at home sadly.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Oct 8, 2021, 1:42 PM Wahl, Edward <<a href="mailto:ewahl@osc.edu">ewahl@osc.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span>Sadly the ESCAPE only works for EXTERNAL LISTs, correct? <span>
</span><span> </span>Not sure that I can easily modify an EXERNAL LIST to do what I want, which is a LIST policy using MISC_ATTRIBUTES and find all files without X, etc.</span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span>And using <span>mmlsattr</span> on hundreds of millions of files will take until the next millennium, so I really would like to stick with the policy engine.<span>
</span>Perhaps I can do some RULE 1 feeds RULE 2 type thing?</span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span> </span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span>Sort of thing I’m looking at:</span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span> </span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span>define( <span>immut</span>, MISC_ATTRIBUTES LIKE '%X%')</span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span>RULE '<span>listimmut</span>' LIST 'not-<span>immut</span>' WHERE NOT (<span>exclude_list</span>) and NOT (<span>immut</span>)</span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span> </span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span> </span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span>Ed Wahl</span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span>OSC</span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span> </span></p>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span> </span></p>
<div style="border:none;border-top:solid #e1e1e1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<a name="m_-6849975201406844092__MailOriginal" rel="noreferrer"><b><span>From:</span></b></a><span><span> <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank" rel="noreferrer">gpfsug-discuss-bounces@spectrumscale.org</a> <<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank" rel="noreferrer">gpfsug-discuss-bounces@spectrumscale.org</a>>
<b>On Behalf Of </b>Olaf Weiser<br>
<b>Sent:</b> Tuesday, October 5, 2021 2:10 AM<br>
<b>To:</b> <a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank" rel="noreferrer">gpfsug-discuss@spectrumscale.org</a><br>
<b>Cc:</b> <a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank" rel="noreferrer">gpfsug-discuss@spectrumscale.org</a><br>
<b>Subject:</b> Re: [gpfsug-discuss] Handling bad file names in policies?</span></span></p>
</div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span> </span></p>
<div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">Hi Ed,</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">not a ready to run for "everything".. but just to remind, there is an ESCAPE statement</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">by this you can</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> cat policy2 <br>
RULE EXTERNAL LIST 'allfiles' EXEC '/var/mmfs/etc/list.exe' ESCAPE '%/#'</span></span></p>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">and turn a file name into smth , what a policy can use</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">I haven't used it for a while , but here is an example from a while ago .. ;-)</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">[root@c25m4n03 stupid_files]# ll<br>
total 0<br>
-rw-r--r-- 1 root root 21 Mar 22 03:44 dämlicher filename<br>
-rw-r--r-- 1 root root 2 Mar 22 03:59 üöä???ßß spacefilen<br>
[root@c25m4n03 stupid_files]#</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">policy:</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">101378 247907919 0 -- /gpfs/fpofs/files/stupid_files/d%C3%A4mlicher%20filename<br>
101381 1945364096 0 -- /gpfs/fpofs/files/stupid_files/%C3%BC%C3%BC%C3%BC%C3%B6%C3%B6%C3%A4%C3%A4%3F%3F%3F%C3%9F%C3%9F%20spacefilename<br>
[I]</span></span><a href="mailto:2013-03-22@13:12:58.687" target="_blank" rel="noreferrer"><span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">2013-03-22@13:12:58.687</span></span><span></span></a><span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">
Policy execution. 2 files dispatched. </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> verify with policy (ESCAPE '%/ä ')</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">101378 247907919 0 -- /gpfs/fpofs/files/stupid_files/dämlicher filename<br>
[...] </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">hope this helps..</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">cheers</span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
<blockquote style="border:none;border-left:solid #aaaaaa 1.5pt;padding:0in 0in 0in 4.0pt;margin-left:3.75pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">----- Ursprüngliche Nachricht -----<br>
Von: "Jonathan Buzzard" <</span></span><a href="mailto:jonathan.buzzard@strath.ac.uk" target="_blank" rel="noreferrer"><span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">jonathan.buzzard@strath.ac.uk</span></span><span></span></a><span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">><br>
Gesendet von: </span></span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank" rel="noreferrer"><span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">gpfsug-discuss-bounces@spectrumscale.org</span></span><span></span></a><span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
An: </span></span><a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank" rel="noreferrer"><span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">gpfsug-discuss@spectrumscale.org</span></span><span></span></a><span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"><br>
CC:<br>
Betreff: [EXTERNAL] Re: [gpfsug-discuss] Handling bad file names in policies?<br>
Datum: Di, 5. Okt 2021 01:29<br>
</span></span></p>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Courier New"">On 04/10/2021 23:23, Wahl, Edward wrote:<br>
<br>
> I know I've run into this before way back, but my notes on how I solved<br>
> this aren't getting the job done in Scale 5.0.5.8 and my notes are from<br>
> 3.5. </span></span><span><span style="font-size:10.0pt;font-family:"Segoe UI Emoji",sans-serif">😉</span></span><span><span style="font-size:10.0pt;font-family:"Courier New""><br>
> Anyone know a way to get a LIST policy to properly feed bad filenames<br>
> into the output or an external script?<br>
><br>
> When I say bad I mean things like control characters, spaces, etc. Not<br>
> concerned about the dreaded 'newline' as we force users to fix those or<br>
> the files do not get backed up in Tivoli.<br>
><br>
<br>
Since when? Last time I checked which was admittedly circa 2008, TSM<br>
would backup files with newlines in them no problem. mmbackup on the<br>
other hand in that time frame would simply die and backup nothing if<br>
there was a single file on the file system with a newline in it.<br>
<br>
I would take a look at the mmbackup scripts which can handle such stuff<br>
(least ways in >4.2) which would also suggest dsmc can handle it.<br>
<br>
As an aside I now think I know how you end up with newlines in file<br>
names. Basically you cut and paste the file name complete with newlines<br>
(most likely at the end) into a text field when saving the file.<br>
Personally I think any program should baulk at that point but what do I<br>
know.<br>
<br>
<br>
JAB.<br>
<br>
--<br>
Jonathan A. Buzzard Tel: +44141-5483420<br>
HPC System Administrator, ARCHIE-WeSt.<br>
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" target="_blank" rel="noreferrer">spectrumscale.org</a><br>
</span></span><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!KGKeukY!gbBLWYl7S7BX4mw1st0Uqn0jAON438v_xU5im5y1VOf3admLYLebW4C0k2nP$" target="_blank" rel="noreferrer"><span><span style="font-size:10.0pt;font-family:"Courier New"">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></span><span></span></a><span><span style="font-size:10.0pt;font-family:"Courier New""> </span></span><span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"></span></span></p>
</div>
</blockquote>
<div>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif">
<span><span style="font-size:10.0pt;font-family:"Arial",sans-serif"> </span></span></p>
</div>
</div>
<span></span>
<p class="MsoNormal" style="margin:0in;font-size:11pt;font-family:Calibri,sans-serif;margin-bottom:12.0pt">
</p>
</div>
</div>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" rel="noreferrer noreferrer" target="_blank">spectrumscale.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" rel="noreferrer noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br>
</blockquote></div>