<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">I think that the OP was asking why not expand the existing cluster with the new hardware, and just make a new FS?<div class=""><br class=""></div><div class="">I’ve not tried to make a cluster talk AFM to itself yet. If that’s impossible, then there’s one good reason to make a new cluster (to use AFM for migration).</div><div class=""><br class=""></div><div class="">Liberty,<br class=""><div class=""><br class=""><div class="">
-- <br class="">Stephen<br class=""><br class=""><br class="">
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">On Oct 11, 2016, at 8:40 PM, <a href="mailto:Mark.Bush@siriuscom.com" class="">Mark.Bush@siriuscom.com</a> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="WordSection1" style="page: WordSection1; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);"><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">Only compelling reason for new cluster would be old hardware is EOL or no longer want to pay maintenance on it.<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="border-style: solid none none; border-top-color: rgb(181, 196, 223); border-top-width: 1pt; padding: 3pt 0in 0in;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><b class=""><span style="font-family: Calibri;" class="">From:<span class="Apple-converted-space"> </span></span></b><span style="font-family: Calibri;" class=""><<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a>> on behalf of Marc A Kaplan <<a href="mailto:makaplan@us.ibm.com" style="color: purple; text-decoration: underline;" class="">makaplan@us.ibm.com</a>><br class=""><b class="">Reply-To:<span class="Apple-converted-space"> </span></b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><br class=""><b class="">Date:<span class="Apple-converted-space"> </span></b>Tuesday, October 11, 2016 at 2:58 PM<br class=""><b class="">To:<span class="Apple-converted-space"> </span></b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><br class=""><b class="">Subject:<span class="Apple-converted-space"> </span></b>Re: [gpfsug-discuss] Hardware refresh<o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><o:p class=""> </o:p></div></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class="">New FS? Yes there are some good reasons. </span><br class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class="">New cluster? I did not see a compelling argument either way.</span><br class=""><br class=""><br class=""><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">From: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class="">"<a href="mailto:Mark.Bush@siriuscom.com" style="color: purple; text-decoration: underline;" class="">Mark.Bush@siriuscom.com</a>" <<a href="mailto:Mark.Bush@siriuscom.com" style="color: purple; text-decoration: underline;" class="">Mark.Bush@siriuscom.com</a>></span><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">To: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class="">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>></span><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">Date: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class="">10/11/2016 03:34 PM</span><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">Subject: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class="">Re: [gpfsug-discuss] Hardware refresh</span><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">Sent by: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class=""><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a></span><o:p class=""></o:p></div><div class="MsoNormal" align="center" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman'; text-align: center;"><hr size="2" width="100%" noshade="" align="center" style="color: rgb(170, 170, 170);" class=""></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><br class=""><br class=""><br class=""><span style="font-size: 10pt; font-family: Calibri;" class="">Ok. I think I am hearing that a new cluster with a new FS and copying data from old to new cluster is the best way forward. Thanks everyone for your input. </span><br class=""><span style="font-size: 10pt; font-family: Calibri;" class=""> </span><br class=""><b class=""><span style="font-family: Calibri;" class="">From:<span class="Apple-converted-space"> </span></span></b><span style="font-family: Calibri;" class=""><<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a>> on behalf of Yuri L Volobuev <<a href="mailto:volobuev@us.ibm.com" style="color: purple; text-decoration: underline;" class="">volobuev@us.ibm.com</a>><b class=""><br class="">Reply-To:<span class="Apple-converted-space"> </span></b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><b class=""><br class="">Date:<span class="Apple-converted-space"> </span></b>Tuesday, October 11, 2016 at 12:22 PM<b class=""><br class="">To:<span class="Apple-converted-space"> </span></b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><b class=""><br class="">Subject:<span class="Apple-converted-space"> </span></b>Re: [gpfsug-discuss] Hardware refresh</span><br class=""> <span class="Apple-converted-space"> </span><o:p class=""></o:p></div><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class="">This depends on the committed cluster version level (minReleaseLevel) and file system format. Since NFSv2 is an on-disk format change, older code wouldn't be able to understand what it is, and thus if there's a possibility of a downlevel node looking at the NSD, the NFSv1 format is going to be used. The code does NSDv1<->NSDv2 conversions under the covers as needed when adding an empty NSD to a file system.<br class=""><br class="">I'd strongly recommend getting a fresh start by formatting a new file system. Many things have changed over the course of the last few years. In particular, having a 4K-aligned file system can be a pretty big deal, depending on what hardware one is going to deploy in the future, and this is something that can't be bolted onto an existing file system. Having 4K inodes is very handy for many reasons. New directory format and NSD format changes are attractive, too. And disks generally tend to get larger with time, and at some point you may want to add a disk to an existing storage pool that's larger than the existing allocation map format allows. Obviously, it's more hassle to migrate data to a new file system, as opposed to extending an existing one. In a perfect world, GPFS would offer a conversion tool that seamlessly and robustly converts old file systems, making them as good as new, but in the real world such a tool doesn't exist. Getting a clean slate by formatting a new file system every few years is a good long-term investment of time, although it comes front-loaded with extra work.<br class=""><br class="">yuri<br class=""><br class=""><span id="cid:image001.gif@01D223E2.68011C50"><image001.gif></span><span style="color: rgb(66, 66, 130);" class="">Aaron Knister ---10/10/2016 04:45:31 PM---Can one format NSDv2 NSDs and put them in a filesystem with NSDv1 NSD's? -Aaron</span><br class=""><span style="font-size: 10pt; color: rgb(95, 95, 95);" class=""><br class="">From:<span class="Apple-converted-space"> </span></span><span style="font-size: 10pt;" class="">Aaron Knister <<a href="mailto:aaron.s.knister@nasa.gov" style="color: purple; text-decoration: underline;" class="">aaron.s.knister@nasa.gov</a>><span style="color: rgb(95, 95, 95);" class=""><br class="">To:<span class="Apple-converted-space"> </span></span><<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>>,<span class="Apple-converted-space"> </span><span style="color: rgb(95, 95, 95);" class=""><br class="">Date:<span class="Apple-converted-space"> </span></span>10/10/2016 04:45 PM<span style="color: rgb(95, 95, 95);" class=""><br class="">Subject:<span class="Apple-converted-space"> </span></span>Re: [gpfsug-discuss] Hardware refresh<span style="color: rgb(95, 95, 95);" class=""><br class="">Sent by:<span class="Apple-converted-space"> </span></span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a></span><o:p class=""></o:p></p><div class="MsoNormal" align="center" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman'; text-align: center;"><hr size="2" width="100%" noshade="" align="center" style="color: rgb(170, 170, 170);" class=""></div><p class="MsoNormal" style="margin: 0in 0in 12pt; font-size: 12pt; font-family: 'Times New Roman';"><br class=""><br class=""><br class=""><span style="font-size: 10pt; font-family: 'Courier New';" class=""><br class="">Can one format NSDv2 NSDs and put them in a filesystem with NSDv1 NSD's?<br class=""><br class="">-Aaron<br class=""><br class="">On 10/10/16 7:40 PM, Luis Bolinches wrote:<br class="">> Hi<br class="">><br class="">> Creating a new FS sounds like a best way to go. NSDv2 being a very good<br class="">> reason to do so.<br class="">><br class="">> AFM for migrations is quite good, latest versions allows to use NSD<br class="">> protocol for mounts as well. Olaf did a great job explaining this<br class="">> scenario on the redbook chapter 6<br class="">><br class="">><span class="Apple-converted-space"> </span></span><a href="http://www.redbooks.ibm.com/abstracts/sg248254.html?Open" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">http://www.redbooks.ibm.com/abstracts/sg248254.html?Open</span></a><span style="font-size: 10pt; font-family: 'Courier New';" class=""><br class="">><br class="">> --<br class="">> Cheers<br class="">><br class="">> On 10 Oct 2016, at 23.05, Buterbaugh, Kevin L<br class="">> <<a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" style="color: purple; text-decoration: underline;" class="">Kevin.Buterbaugh@Vanderbilt.Edu</a><br class="">> <</span><a href="mailto:Kevin.Buterbaugh@Vanderbilt.Edu" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">mailto:Kevin.Buterbaugh@Vanderbilt.Edu</span></a><span style="font-size: 10pt; font-family: 'Courier New';" class="">>> wrote:<br class="">><br class="">>> Hi Mark,<br class="">>><br class="">>> The last time we did something like this was 2010 (we’re doing rolling<br class="">>> refreshes now), so there are probably lots of better ways to do this<br class="">>> than what we did, but we:<br class="">>><br class="">>> 1) set up the new hardware<br class="">>> 2) created new filesystems (so that we could make adjustments we<br class="">>> wanted to make that can only be made at FS creation time)<br class="">>> 3) used rsync to make a 1st pass copy of everything<br class="">>> 4) coordinated a time with users / groups to do a 2nd rsync when they<br class="">>> weren’t active<br class="">>> 5) used symbolic links during the transition (i.e. rm -rvf<br class="">>> /gpfs0/home/joeuser; ln -s /gpfs2/home/joeuser /gpfs0/home/joeuser)<br class="">>> 6) once everybody was migrated, updated the symlinks (i.e. /home<br class="">>> became a symlink to /gpfs2/home)<br class="">>><br class="">>> HTHAL…<br class="">>><br class="">>> Kevin<br class="">>><br class="">>>> On Oct 10, 2016, at 2:56 PM,<span class="Apple-converted-space"> </span><a href="mailto:Mark.Bush@siriuscom.com" style="color: purple; text-decoration: underline;" class="">Mark.Bush@siriuscom.com</a><br class="">>>> <</span><a href="mailto:Mark.Bush@siriuscom.com" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">mailto:Mark.Bush@siriuscom.com</span></a><span style="font-size: 10pt; font-family: 'Courier New';" class="">> wrote:<br class="">>>><br class="">>>> Have a very old cluster built on IBM X3650’s and DS3500. Need to<br class="">>>> refresh hardware. Any lessons learned in this process? Is it<br class="">>>> easiest to just build new cluster and then use AFM? Add to existing<br class="">>>> cluster then decommission nodes? What is the recommended process for<br class="">>>> this?<br class="">>>><br class="">>>><br class="">>>> Mark<br class="">>>><br class="">>>> This message (including any attachments) is intended only for the use<br class="">>>> of the individual or entity to which it is addressed and may contain<br class="">>>> information that is non-public, proprietary, privileged,<br class="">>>> confidential, and exempt from disclosure under applicable law. If you<br class="">>>> are not the intended recipient, you are hereby notified that any use,<br class="">>>> dissemination, distribution, or copying of this communication is<br class="">>>> strictly prohibited. This message may be viewed by parties at Sirius<br class="">>>> Computer Solutions other than those named in the message header. This<br class="">>>> message does not contain an official representation of Sirius<br class="">>>> Computer Solutions. If you have received this communication in error,<br class="">>>> notify Sirius Computer Solutions immediately and (i) destroy this<br class="">>>> message if a facsimile or (ii) delete this message immediately if<br class="">>>> this is an electronic communication. Thank you.<br class="">>>><br class="">>>> Sirius Computer Solutions <</span><a href="http://www.siriuscom.com/" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">http://www.siriuscom.com/</span></a><span style="font-size: 10pt; font-family: 'Courier New';" class="">><br class="">>>> _______________________________________________<br class="">>>> gpfsug-discuss mailing list<br class="">>>> gpfsug-discuss at<span class="Apple-converted-space"> </span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class="">spectrumscale.org</a><span class="Apple-converted-space"> </span><</span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">http://spectrumscale.org/</span></a><span style="font-size: 10pt; font-family: 'Courier New';" class="">><br class="">>>><span class="Apple-converted-space"> </span></span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></a><span style="font-size: 10pt; font-family: 'Courier New';" class=""><br class="">>><br class="">>> —<br class="">>> Kevin Buterbaugh - Senior System Administrator<br class="">>> Vanderbilt University - Advanced Computing Center for Research and<br class="">>> Education<br class="">>><span class="Apple-converted-space"> </span><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" style="color: purple; text-decoration: underline;" class="">Kevin.Buterbaugh@vanderbilt.edu</a><br class="">>> <</span><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">mailto:Kevin.Buterbaugh@vanderbilt.edu</span></a><span style="font-size: 10pt; font-family: 'Courier New';" class="">> - (615)875-9633<br class="">>><br class="">>><br class="">>><br class="">><br class="">> Ellei edellä ole toisin mainittu: / Unless stated otherwise above:<br class="">> Oy IBM Finland Ab<br class="">> PL 265, 00101 Helsinki, Finland<br class="">> Business ID, Y-tunnus: 0195876-3<br class="">> Registered in Finland<br class="">><br class="">><br class="">><br class="">> _______________________________________________<br class="">> gpfsug-discuss mailing list<br class="">> gpfsug-discuss at<span class="Apple-converted-space"> </span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class="">spectrumscale.org</a><br class="">><span class="Apple-converted-space"> </span></span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></a><span style="font-size: 10pt; font-family: 'Courier New';" class=""><br class="">><br class="">_______________________________________________<br class="">gpfsug-discuss mailing list<br class="">gpfsug-discuss at<span class="Apple-converted-space"> </span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class="">spectrumscale.org</a><u class=""><span style="color: blue;" class=""><br class=""></span></u></span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></a><span style="font-size: 10pt; font-family: 'Courier New';" class=""><br class=""></span><br class=""><br class=""><o:p class=""></o:p></p><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 7.5pt; font-family: Cambria;" class="">This message (including any attachments) is intended only for the use of the individual or entity to which it is addressed and may contain information that is non-public, proprietary, privileged, confidential, and exempt from disclosure under applicable law. If you are not the intended recipient, you are hereby notified that any use, dissemination, distribution, or copying of this communication is strictly prohibited. This message may be viewed by parties at Sirius Computer Solutions other than those named in the message header. This message does not contain an official representation of Sirius Computer Solutions. If you have received this communication in error, notify Sirius Computer Solutions immediately and (i) destroy this message if a facsimile or (ii) delete this message immediately if this is an electronic communication. Thank you.</span><o:p class=""></o:p></p><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class=""><a href="http://www.siriuscom.com/" style="color: purple; text-decoration: underline;" class=""><b class=""><span style="font-size: 10pt; font-family: Calibri;" class="">Sirius Computer Solutions</span></b></a><span class="Apple-converted-space"> </span><tt style="font-family: 'Courier New';" class=""><span style="font-size: 10pt;" class="">_______________________________________________</span></tt><span style="font-size: 10pt; font-family: 'Courier New';" class=""><br class=""><tt style="font-family: 'Courier New';" class="">gpfsug-discuss mailing list</tt><br class=""><tt style="font-family: 'Courier New';" class="">gpfsug-discuss at<span class="Apple-converted-space"> </span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class="">spectrumscale.org</a></tt><br class=""></span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline;" class=""><tt style="font-family: 'Courier New';" class=""><span style="font-size: 10pt;" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><o:p class=""></o:p></p><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class=""><o:p class=""> </o:p></p></div><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); float: none; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); float: none; display: inline !important;" class="">gpfsug-discuss mailing list</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); float: none; display: inline !important;" class="">gpfsug-discuss at<span class="Apple-converted-space"> </span></span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class="">spectrumscale.org</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class=""></div></blockquote></div><br class=""></div></div></body></html>