<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: "Times New Roman", Times, serif; font-size: 12pt; color: rgb(0, 0, 0);">
This is an interesting idea, but not at all what I was working towards, and is getting me off track. (and I'm known to get distracted and explore interesting Rabbit Holes, red herrings, et al) I've next to no issues with the filenames in day to day operations.</div>
<div style="font-family: "Times New Roman", Times, serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: "Times New Roman", Times, serif; font-size: 12pt; color: rgb(0, 0, 0);">
On the positive side, this is a one off. What I need is a LIST policy, and the return leaves off the entire filename. </div>
<div style="font-family: "Times New Roman", Times, serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: "Times New Roman", Times, serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: "Times New Roman", Times, serif; font-size: 12pt; color: rgb(0, 0, 0);">
Ed Wahl</div>
<div style="font-family: "Times New Roman", Times, serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> gpfsug-discuss-bounces@spectrumscale.org <gpfsug-discuss-bounces@spectrumscale.org> on behalf of Alec <anacreo@gmail.com><br>
<b>Sent:</b> Friday, October 8, 2021 3:36 PM<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject:</b> Re: [gpfsug-discuss] Handling bad file names in policies?</font>
<div> </div>
</div>
<div>
<div dir="auto">Why not just configure a file placement policy using a non existent pool or a bad encryption key to prevent files with non-printables characters from even being created in the first place.
<div dir="auto"><br>
</div>
<div dir="auto">Alec</div>
</div>
<br>
<div class="x_gmail_quote">
<div dir="ltr" class="x_gmail_attr">On Fri, Oct 8, 2021, 11:49 AM Wahl, Edward <<a href="mailto:ewahl@osc.edu">ewahl@osc.edu</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
This goes back as far as I can recall to <=GPFS 3.5 days. And no, I cannot recall what version of TSM-EE that was. But newline has been the only stopping point, for what seems like forever.
<br>
Having filed many an mmbackup bug, I don't recall ever crashing on filenames. (tons of OTHER reasons, but not character set) We even generate an error report from this and email users to fix it.
<br>
We accept basically almost everything else, and I have to say, we see some really crazy things sometimes. I think my current favorite is the full windows paths as a filename.
<br>
(eg: "Y:\Temp\temp\290\work\0\Material_ERTi-5.in" )<br>
<br>
<br>
Current IBM documentation doesn't go backwards past 4.2 but it says:<br>
<br>
"For IBM Spectrum Scale™ file systems with special characters frequently used in the names of files or directories, backup failures might occur. Known special characters that require special handling include: *, ?, ", ’, carriage return, and the new line character.<br>
<br>
In such cases, enable the Tivoli Storage Manager client options WILDCARDSARELITERAL and QUOTESARELITERAL on all nodes that are used in backup activities and make sure that the mmbackup option --noquote is used when invoking mmbackup."<br>
<br>
So maybe we could handle newlines somehow. But my lazy searches didn't show what TSM doesn't accept.
<br>
<br>
Ed Wahl<br>
OSC<br>
<br>
-----Original Message-----<br>
From: <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank" rel="noreferrer">
gpfsug-discuss-bounces@spectrumscale.org</a> <<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank" rel="noreferrer">gpfsug-discuss-bounces@spectrumscale.org</a>> On Behalf Of Jonathan Buzzard<br>
Sent: Monday, October 4, 2021 7:29 PM<br>
To: <a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank" rel="noreferrer">
gpfsug-discuss@spectrumscale.org</a><br>
Subject: Re: [gpfsug-discuss] Handling bad file names in policies?<br>
<br>
On 04/10/2021 23:23, Wahl, Edward wrote:<br>
<br>
> I know I've run into this before way back, but my notes on how I <br>
> solved this aren't getting the job done in Scale 5.0.5.8 and my notes <br>
> are from 3.5. 😉<br>
> Anyone know a way to get a LIST policy to properly feed bad filenames <br>
> into the output or an external script?<br>
> <br>
> When I say bad I mean things like control characters, spaces, etc. <br>
> Not concerned about the dreaded 'newline' as we force users to fix <br>
> those or the files do not get backed up in Tivoli.<br>
> <br>
<br>
Since when? Last time I checked which was admittedly circa 2008, TSM would backup files with newlines in them no problem. mmbackup on the other hand in that time frame would simply die and backup nothing if there was a single file on the file system with a
newline in it.<br>
<br>
I would take a look at the mmbackup scripts which can handle such stuff (least ways in >4.2) which would also suggest dsmc can handle it.<br>
<br>
As an aside I now think I know how you end up with newlines in file names. Basically you cut and paste the file name complete with newlines (most likely at the end) into a text field when saving the file.
<br>
Personally I think any program should baulk at that point but what do I know.<br>
<br>
<br>
JAB.<br>
<br>
-- <br>
Jonathan A. Buzzard Tel: +44141-5483420<br>
HPC System Administrator, ARCHIE-WeSt.<br>
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG _______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="https://urldefense.com/v3/__http://spectrumscale.org__;!!KGKeukY!jPEGEXlh4N27v0ev7VeN2w8CsqZiWAWqEtQpQ7eHaetmvPuD0-JVJrZx0hAA$" rel="noreferrer noreferrer" target="_blank">
spectrumscale.org</a><br>
<a href="https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!KGKeukY!nVH69Xr88S0X5DmO8QbaI7eozd9pDvmtMN40tZU8vWuduEF4J01ZTfnypvOy$" rel="noreferrer noreferrer" target="_blank">https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!KGKeukY!nVH69Xr88S0X5DmO8QbaI7eozd9pDvmtMN40tZU8vWuduEF4J01ZTfnypvOy$</a>
<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="https://urldefense.com/v3/__http://spectrumscale.org__;!!KGKeukY!jPEGEXlh4N27v0ev7VeN2w8CsqZiWAWqEtQpQ7eHaetmvPuD0-JVJrZx0hAA$" rel="noreferrer noreferrer" target="_blank">
spectrumscale.org</a><br>
<a href="https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!KGKeukY!jPEGEXlh4N27v0ev7VeN2w8CsqZiWAWqEtQpQ7eHaetmvPuD0-JVJuNfee8K$" rel="noreferrer noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br>
</blockquote>
</div>
</div>
</body>
</html>