<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Yes, independent snapshotting would be an issue. However at the moment we have 570 dependent filesets in our<div class="">main filesystem, which is not all that far from the limit of 1000 independent filesets per filesystem. </div><div class="">There was a thread concerning fileset issues back in February, wondering if the limits had changed </div><div class="">between 4.x to 5.0.0 releases, but it went unanswered. </div><div class=""><br class=""><div>We would love to be able to use the features independent filesets (quicker traversal by policy engine,</div><div>snapshots as you mention, etc), but the thought that we could run out of them as our user base grows killed that idea.</div><div><br class=""><blockquote type="cite" class=""><div class="">On Apr 25, 2018, at 8:35 AM, Sobey, Richard A <<a href="mailto:r.sobey@imperial.ac.uk" class="">r.sobey@imperial.ac.uk</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="WordSection1" style="page: WordSection1; caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span class="">You can apply fileset quotas to independent filesets to you know. Sorry if that sounds passive aggressive, not meant to be!<o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span class=""><o:p class=""> </o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span class="">Main reason for us NOT to use dependent filesets is lack of snapshotting.<o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span class=""><o:p class=""> </o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span class="">Richard<o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span class=""><o:p class=""> </o:p></span></div><div class=""><div style="border-style: solid none none; border-top-width: 1pt; border-top-color: rgb(225, 225, 225); padding: 3pt 0cm 0cm;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><b class=""><span lang="EN-US" class="">From:</span></b><span lang="EN-US" class=""><span class="Apple-converted-space"> </span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a><span class="Apple-converted-space"> </span><<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a>><span class="Apple-converted-space"> </span><b class="">On Behalf Of<span class="Apple-converted-space"> </span></b><a href="mailto:david_johnson@brown.edu" style="color: purple; text-decoration: underline;" class="">david_johnson@brown.edu</a><br class=""><b class="">Sent:</b><span class="Apple-converted-space"> </span>25 April 2018 13:14<br class=""><b class="">To:</b><span class="Apple-converted-space"> </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><br class=""><b class="">Subject:</b><span class="Apple-converted-space"> </span>Re: [gpfsug-discuss] Converting a dependent fileset to independent<o:p class=""></o:p></span></div></div></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">We use a dependent fileset for each research group / investigator. We do this mainly so we can apply fileset quotas. We tried independent filesets but they were quite inconvenient:<o:p class=""></o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">1) limited number independent filesets could be created compared to dependent<o:p class=""></o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">2) requirement to manage number of inodes allocated to each and every independent fileset<o:p class=""></o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><o:p class=""> </o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">There may have been other issues but we create a new dependent fileset whenever a new researcher joins our cluster. <o:p class=""></o:p></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""> -- ddj<o:p class=""></o:p></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">Dave Johnson<o:p class=""></o:p></div></div></div><div class=""><p class="MsoNormal" style="margin: 0cm 0cm 12pt; font-size: 11pt; font-family: Calibri, sans-serif;"><br class="">On Apr 25, 2018, at 5:42 AM, Daniel Kidger <<a href="mailto:daniel.kidger@uk.ibm.com" style="color: purple; text-decoration: underline;" class="">daniel.kidger@uk.ibm.com</a>> wrote:<o:p class=""></o:p></p></div><blockquote style="margin-top: 5pt; margin-bottom: 5pt;" class=""><div class=""><div class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class="">It would though be a nice to have feature: to leave the file data where it was and just move the metadata into its own inode space?<o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""> <o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class="">A related question though:<o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class="">In what case do people create new *dependant* filesets ? I can't see many cases where an independent fileset would be just as valid.<o:p class=""></o:p></span></div></div><div class=""><div class=""><div class=""><div class=""><div class=""><div class=""><div class=""><div class=""><div class=""><div class=""><div class=""><div class=""><div style="margin-top: 15pt;" class=""><div style="margin-top: 7.5pt;" class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: Verdana, sans-serif;" class="">Daniel</span><span style="font-size: 8pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 8pt; font-family: Arial, sans-serif;" class=""><br class=""> <o:p class=""></o:p></span></div></div><table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="left"><tbody class=""><tr class=""><td width="130" style="width: 97.5pt; padding: 0cm;" class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><a href="https://www.youracclaim.com/user/danel-kidger" target="_blank" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><img border="0" width="32" height="32" id="_x0000_i1025" src="cid:" alt="IBM Storage Professional Badge" style="width: 0.3333in; height: 0.3333in;" class=""></span></a><o:p class=""></o:p></div></div></td><td width="140" style="width: 105pt; padding: 0cm;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><a href="https://www.youracclaim.com/user/danel-kidger" style="color: purple; text-decoration: underline;" class=""><span style="border: 1pt solid windowtext; padding: 0cm; text-decoration: none;" class=""><span id="cid:~WRD000.jpg"><~WRD000.jpg></span></span></a><o:p class=""></o:p></div></td><td width="0" style="width: 0.3pt; padding: 0cm;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""> <o:p class=""></o:p></div></td><td width="0" style="width: 0.3pt; padding: 0cm;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""> <o:p class=""></o:p></div></td><td width="0" style="width: 0.3pt; padding: 0cm;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""> <o:p class=""></o:p></div></td><td width="240" style="width: 180pt; padding: 0cm;" class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><strong class=""><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">Dr Daniel Kidger</span></strong><br class=""><span style="font-size: 7.5pt; font-family: Arial, sans-serif;" class="">IBM Technical Sales Specialist<br class="">Software Defined Solution Sales<br class=""><br class="">+</span><span style="font-size: 10pt; font-family: Verdana, sans-serif; color: rgb(95, 95, 95);" class="">44-(0)7818 522 266<span class="Apple-converted-space"> </span></span><br class=""><span style="font-size: 8pt; font-family: Arial, sans-serif; color: rgb(95, 95, 95);" class=""><a href="mailto:daniel.kidger@uk.ibm.com" style="color: purple; text-decoration: underline;" class="">daniel.kidger@uk.ibm.com</a></span><o:p class=""></o:p></div></div></td></tr></tbody></table><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10pt; font-family: Verdana, sans-serif;" class=""> </span><span style="font-size: 8pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""> <o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""> <o:p class=""></o:p></span></div></div><blockquote style="border-style: none none none solid; border-left-width: 1.5pt; border-left-color: rgb(170, 170, 170); padding: 0cm 0cm 0cm 4pt; margin: 5pt 0cm 5pt 3.75pt;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class="">----- Original message -----<br class="">From: "Sobey, Richard A" <<a href="mailto:r.sobey@imperial.ac.uk" style="color: purple; text-decoration: underline;" class="">r.sobey@imperial.ac.uk</a>><br class="">Sent by:<span class="Apple-converted-space"> </span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a><br class="">To: gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><br class="">Cc:<br class="">Subject: Re: [gpfsug-discuss] Converting a dependent fileset to independent<br class="">Date: Wed, Apr 25, 2018 10:01 AM<br class=""> <br class=""><br class=""><o:p class=""></o:p></span></div><div class=""><p class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class="">Hi Marc</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></p><p class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""> </span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></p><p class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class="">Yes, copying the data to a freshly created fileset and unlinking/renaming/relinking is our solution; it was always a long shot expecting to be able to convert it<span class="Apple-converted-space"> </span></span><span style="font-size: 10.5pt; font-family: "Segoe UI Emoji", sans-serif;" class="">๐</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></p><p class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""> </span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></p><p class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class="">Richard</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></p><p class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""> </span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></p><p class=""><b class=""><span lang="EN-US" style="font-size: 10.5pt; font-family: Arial, sans-serif;" class="">From:</span></b><span lang="EN-US" style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><span class="Apple-converted-space"> </span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a><span class="Apple-converted-space"> </span><<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a>><span class="Apple-converted-space"> </span><b class="">On Behalf Of<span class="Apple-converted-space"> </span></b>Marc A Kaplan<br class=""><b class="">Sent:</b><span class="Apple-converted-space"> </span>24 April 2018 13:49<br class=""><b class="">To:</b><span class="Apple-converted-space"> </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><br class=""><b class="">Subject:</b><span class="Apple-converted-space"> </span>Re: [gpfsug-discuss] Converting a dependent fileset to independent</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></p><p class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""> <o:p class=""></o:p></span></p><p class=""><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">To help make sense of this, one has to understand that "independent" means a different range of inode numbers.</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">If you have a set of files within one range of inode numbers, say 3000-5000 and now you want to move some of them to a new range of inode numbers, say 7000-8000, you're going to have to create that new range as a new independent fileset, and then move (copy!) the files to the new fileset. And then rename directories so that you can once again refer to the files by the pathnames that they "used to" have.</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">During the copying and renaming, you would have to make sure there are no applications trying to access those files and directories.</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""><br class=""><br class=""><br class=""></span><span style="font-size: 7.5pt; font-family: Arial, sans-serif; color: rgb(95, 95, 95);" class="">From: </span><span style="font-size: 7.5pt; font-family: Arial, sans-serif;" class="">"Sobey, Richard A" <<a href="mailto:r.sobey@imperial.ac.uk" target="_blank" style="color: purple; text-decoration: underline;" class="">r.sobey@imperial.ac.uk</a>></span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 7.5pt; font-family: Arial, sans-serif; color: rgb(95, 95, 95);" class="">To: </span><span style="font-size: 7.5pt; font-family: Arial, sans-serif;" class="">"'<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>'" <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>></span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 7.5pt; font-family: Arial, sans-serif; color: rgb(95, 95, 95);" class="">Date: </span><span style="font-size: 7.5pt; font-family: Arial, sans-serif;" class="">04/24/2018 05:20 AM</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 7.5pt; font-family: Arial, sans-serif; color: rgb(95, 95, 95);" class="">Subject: </span><span style="font-size: 7.5pt; font-family: Arial, sans-serif;" class="">[gpfsug-discuss] Converting a dependent fileset to independent</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 7.5pt; font-family: Arial, sans-serif; color: rgb(95, 95, 95);" class="">Sent by: </span><span style="font-size: 7.5pt; font-family: Arial, sans-serif;" class=""><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a></span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></p><div class="MsoNormal" align="center" style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif; text-align: center;"><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><hr size="2" width="100%" noshade="" align="center" style="color: rgb(160, 160, 160);" class=""></span></div><p style="margin-bottom: 12pt;" class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""><br class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">Hi all,</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class=""> </span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">Is there any way, without starting over, to convert a dependent fileset to independent?</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class=""> </span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">My gut says no but in the spirit of not making unnecessary work I wanted to ask.</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class=""> </span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">Also, the documentation states that I should see a โdpndโ next to a dependent fileset when I run mmlsfileset with -L; this is not the case even though the parent fileset is root in this case.</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class=""> </span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: "Courier New";" class="">[root@nsd bin]# mmlsfileset gpfs studentrecruitmentandoutreach -L</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: "Courier New";" class="">Filesets in file system 'gpfs':</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: "Courier New";" class="">Name Id RootInode ParentId Created InodeSpace MaxInodes AllocInodes Comment</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: "Courier New";" class="">studentrecruitmentandoutreach 241 8700824 0 Wed Feb 14 14:25:49 2018 0 0 0</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class=""> </span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">Thanks</span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><span style="font-size: 10pt; font-family: Arial, sans-serif;" class="">Richard</span><tt style="font-family: "Courier New";" class=""><span style="font-size: 10pt;" class="">_______________________________________________</span></tt><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""></span><tt style="font-family: "Courier New";" class=""><span style="font-size: 10pt;" class="">gpfsug-discuss mailing list</span></tt><span style="font-size: 10pt; font-family: "Courier New";" class=""><br class=""><tt style="font-family: "Courier New";" class="">gpfsug-discuss at<span class="Apple-converted-space"> </span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class="">spectrumscale.org</a></tt></span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><br class=""><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=cvpnBBH0j41aQy0RPiG2xRL_M8mTc1izuQD3_PmtjZ8&m=W9WH1n93tRRhW5npPGd73Dqgcp4d0oAYKt4yOI02PWU&s=MnsN-hjjhZirIDfK1k-awRB9hodsX2Ylh1Z1IzoJij0&e=" target="_blank" style="color: purple; text-decoration: underline;" class=""><tt style="font-family: "Courier New";" class=""><span style="font-size: 10pt;" class="">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=cvpnBBH0j41aQy0RPiG2xRL_M8mTc1izuQD3_PmtjZ8&m=W9WH1n93tRRhW5npPGd73Dqgcp4d0oAYKt4yOI02PWU&s=MnsN-hjjhZirIDfK1k-awRB9hodsX2Ylh1Z1IzoJij0&e=</span></tt></a><br class=""><br class=""><br class=""><br class=""><o:p class=""></o:p></span></p></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10pt; font-family: "Courier New";" class="">_______________________________________________<br class="">gpfsug-discuss mailing list<br class="">gpfsug-discuss at<span class="Apple-converted-space"> </span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class="">spectrumscale.org</a><br class=""><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HlQDuUjgJx4p54QzcXd0_zTwf4Cr2t3NINalNhLTA2E&m=q3YHYji1-ohlnu_yLuOGmxLnmk9znaxUJdg04aGLU_U&s=Axp36hWpcuKZbTMbdVde_ifZreMvOlR5sHUYX3A79hQ&e=" target="_blank" style="color: purple; text-decoration: underline;" class="">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HlQDuUjgJx4p54QzcXd0_zTwf4Cr2t3NINalNhLTA2E&m=q3YHYji1-ohlnu_yLuOGmxLnmk9znaxUJdg04aGLU_U&s=Axp36hWpcuKZbTMbdVde_ifZreMvOlR5sHUYX3A79hQ&e=</a></span><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""><o:p class=""></o:p></span></div></div></blockquote><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span style="font-size: 10.5pt; font-family: Arial, sans-serif;" class=""> <o:p class=""></o:p></span></div></div></div><p class="MsoNormal" style="margin: 0cm 0cm 12pt; font-size: 11pt; font-family: Calibri, sans-serif;">Unless stated otherwise above:<br class="">IBM United Kingdom Limited - Registered in England and Wales with number 741598.<span class="Apple-converted-space"> </span><br class="">Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU<o:p class=""></o:p></p></div></blockquote><blockquote style="margin-top: 5pt; margin-bottom: 5pt;" class=""><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">_______________________________________________<br class="">gpfsug-discuss mailing list<br class="">gpfsug-discuss at<span class="Apple-converted-space"> </span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class="">spectrumscale.org</a><br class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline;" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><o:p class=""></o:p></div></div></blockquote></div></div><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">_______________________________________________</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">gpfsug-discuss mailing list</span><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class="">gpfsug-discuss at<span class="Apple-converted-space"> </span></span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">spectrumscale.org</a><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class=""></div></blockquote></div><br class=""></div></body></html>