<font size=2 face="sans-serif">Richard,</font><br><br><font size=2 face="sans-serif">I see that 4.2.3-4 efix2 has two defects,
1032655 (IV99796) and 1020461 (IV99675), and both these fixes are included
in 4.2.3.5 .</font><br><br><font size=2 face="sans-serif">Regards,</font><br><br><font size=2 face="sans-serif"> Felipe</font><br><br><font size=2 face="sans-serif">----<br>Felipe Knop
knop@us.ibm.com<br>GPFS Development and Security<br>IBM Systems<br>IBM Building 008<br>2455 South Rd, Poughkeepsie, NY 12601<br>(845) 433-9314 T/L 293-9314<br><br></font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">"Sobey, Richard
A" <r.sobey@imperial.ac.uk></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">gpfsug main discussion
list <gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Cc:
</font><font size=1 face="sans-serif">"gpfsug-discuss-bounces@spectrumscale.org"
<gpfsug-discuss-bounces@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">10/25/2017 09:34 AM</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">Re: [gpfsug-discuss]
FW: [EXTERNAL] FLASH: IBM Spectrum Scale (GPFS) V4.1 and 4.2 levels: network
reconnect function may result in file system corruption or undetected file
data corruption (2017.10.09)</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=2 face="Calibri">Hi Felipe</font><br><font size=2 face="Calibri"> </font><br><font size=2 face="Calibri">On a related note, would everything in
4.2.3-4 efix2 be included in 4.2.3-5? In particular the previously discussed
around defect 1020461? There was no APAR for this defect when I last looked
on 30<sup>th</sup> August.</font><br><font size=2 face="Calibri"> </font><br><font size=2 face="Calibri">Thanks</font><br><font size=2 face="Calibri">Richard</font><br><font size=2 face="Calibri"> </font><br><font size=2 face="Calibri"><b>From:</b> gpfsug-discuss-bounces@spectrumscale.org
[</font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=2 face="Calibri">mailto:gpfsug-discuss-bounces@spectrumscale.org</font></a><font size=2 face="Calibri">]
<b>On Behalf Of </b>Felipe Knop<b><br>Sent:</b> 25 October 2017 14:09<b><br>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Cc:</b> gpfsug-discuss-bounces@spectrumscale.org<b><br>Subject:</b> Re: [gpfsug-discuss] FW: [EXTERNAL] FLASH: IBM Spectrum Scale
(GPFS) V4.1 and 4.2 levels: network reconnect function may result in file
system corruption or undetected file data corruption (2017.10.09)</font><br><font size=2 face="Calibri"> </font><br><font size=2 face="Arial">Tomasz,</font><font size=2 face="Calibri"><br></font><font size=2 face="Arial"><br>The fix (APAR 1IJ00398) has been included in 4.2.3.5, despite the APAR
number having been omitted from the list of fixes in the PTF.</font><font size=2 face="Calibri"><br></font><font size=2 face="Arial"><br>Regards,</font><font size=2 face="Calibri"><br></font><font size=2 face="Arial"><br> Felipe</font><font size=2 face="Calibri"><br></font><font size=2 face="Arial"><br>----<br>Felipe Knop
knop@us.ibm.com<br>GPFS Development and Security<br>IBM Systems<br>IBM Building 008<br>2455 South Rd, Poughkeepsie, NY 12601<br>(845) 433-9314 T/L 293-9314<br></font><font size=2 face="Calibri"><br><br><br><br></font><font size=1 color=#5f5f5f face="Arial"><br>From: </font><font size=1 face="Arial">"Tomasz.Wolski@ts.fujitsu.com"
<Tomasz.Wolski@ts.fujitsu.com></font><font size=1 color=#5f5f5f face="Arial"><br>To: </font><font size=1 face="Arial">IBM Spectrum
Scale <scale@us.ibm.com>, gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><font size=1 color=#5f5f5f face="Arial"><br>Cc: </font><font size=1 face="Arial">"gpfsug-discuss-bounces@spectrumscale.org"
<gpfsug-discuss-bounces@spectrumscale.org></font><font size=1 color=#5f5f5f face="Arial"><br>Date: </font><font size=1 face="Arial">10/25/2017
05:42 AM</font><font size=1 color=#5f5f5f face="Arial"><br>Subject: </font><font size=1 face="Arial">Re:
[gpfsug-discuss] FW: [EXTERNAL] FLASH: IBM Spectrum Scale (GPFS) V4.1 and
4.2 levels: network reconnect function may result in file system corruption
or undetected file data corruption (2017.10.09)</font><font size=1 color=#5f5f5f face="Arial"><br>Sent by: </font><font size=1 face="Arial">gpfsug-discuss-bounces@spectrumscale.org</font><div align=center><hr noshade></div><br><font size=2 face="Calibri"><br><br></font><font size=2 color=#004080 face="Calibri"><br>Thank you for the information. I was checking changelog for GPFS 4.2.3.5
standard edition, but it does not mention APAR IJ00398:<br> </font><font size=2 color=blue face="Calibri"><u><br></u></font><a href="https://www-01.ibm.com/support/docview.wss?rs=0&uid=isg400003555"><font size=2 color=blue face="Calibri"><u>https://www-01.ibm.com/support/docview.wss?rs=0&uid=isg400003555</u></font></a><font size=2 color=#004080 face="Calibri"><br>This update addresses the following APARs: IJ00031 IJ00094 IJ00397 IV99611
IV99675 IV99676 IV99677 IV99678 IV99679 IV99680 IV99709 IV99796.<br> <br>On the other hand Flash Notification advices upgrading to GPFS 4.2.3.5:</font><font size=2 color=blue face="Calibri"><u><br></u></font><a href="http://www-01.ibm.com/support/docview.wss?uid=ssg1S1010668&myns=s033&mynp=OCSTXKQY&mynp=OCSWJ00&mync=E&cm_sp=s033-_-OCSTXKQY-OCSWJ00-_-E"><font size=2 color=blue face="Calibri"><u>http://www-01.ibm.com/support/docview.wss?uid=ssg1S1010668&myns=s033&mynp=OCSTXKQY&mynp=OCSWJ00&mync=E&cm_sp=s033-_-OCSTXKQY-OCSWJ00-_-E</u></font></a><font size=2 color=#004080 face="Calibri"><br> <br>Could you please verify if that version contains the fix?<br> <br>Best regards,<br>Tomasz Wolski</font><font size=3 face="Times New Roman"><br> </font><font size=2 face="Tahoma"><b><br>From:</b> Felipe Knop [</font><a href=mailto:knop@us.ibm.com><font size=2 color=blue face="Tahoma"><u>mailto:knop@us.ibm.com</u></font></a><font size=2 face="Tahoma">]
<b>On Behalf Of </b>IBM Spectrum Scale<b><br>Sent:</b> Wednesday, October 11, 2017 2:31 PM<b><br>To:</b> gpfsug main discussion list<b><br>Cc:</b> gpfsug-discuss-bounces@spectrumscale.org; Wolski, Tomasz<b><br>Subject:</b> Re: [gpfsug-discuss] FW: [EXTERNAL] FLASH: IBM Spectrum Scale
(GPFS) V4.1 and 4.2 levels: network reconnect function may result in file
system corruption or undetected file data corruption (2017.10.09)</font><font size=3 face="Times New Roman"><br> </font><font size=2 face="Arial"><br>Tomasz,<br><br>Though the error in the NSD RPC has been the most visible manifestation
of the problem, this issue could end up affecting other RPCs as well, so
the fix should be applied even for SAN configurations.</font><font size=3 face="Times New Roman"><br><br></font><font size=2 face="Arial"><br><br>Regards, The Spectrum Scale (GPFS) team<br><br>------------------------------------------------------------------------------------------------------------------<br>If you feel that your question can benefit other users of Spectrum
Scale (GPFS), then please post it to the public IBM developerWroks Forum
at </font><a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479"><font size=2 color=blue face="Arial"><u>https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</u></font></a><font size=2 face="Arial">.
<br><br>If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact 1-800-237-5511
in the United States or your local IBM Service Center in other countries.
<br><br>The forum is informally monitored as time permits and should not be used
for priority messages to the Spectrum Scale (GPFS) team.</font><font size=3 face="Times New Roman"><br><br></font><font size=1 color=#5f5f5f face="Arial"><br><br>From: </font><font size=1 face="Arial">"</font><a href=mailto:Tomasz.Wolski@ts.fujitsu.com><font size=1 color=blue face="Arial"><u>Tomasz.Wolski@ts.fujitsu.com</u></font></a><font size=1 face="Arial">"
<</font><a href=mailto:Tomasz.Wolski@ts.fujitsu.com><font size=1 color=blue face="Arial"><u>Tomasz.Wolski@ts.fujitsu.com</u></font></a><font size=1 face="Arial">></font><font size=1 color=#5f5f5f face="Arial"><br>To: </font><font size=1 face="Arial">gpfsug
main discussion list <</font><a href="mailto:gpfsug-discuss@spectrumscale.org"><font size=1 color=blue face="Arial"><u>gpfsug-discuss@spectrumscale.org</u></font></a><font size=1 face="Arial">></font><font size=1 color=#5f5f5f face="Arial"><br>Date: </font><font size=1 face="Arial">10/11/2017
02:09 AM</font><font size=1 color=#5f5f5f face="Arial"><br>Subject: </font><font size=1 face="Arial">Re:
[gpfsug-discuss] FW: [EXTERNAL] FLASH: IBM Spectrum Scale (GPFS) V4.1 and
4.2 levels: network reconnect function may result in file system corruption
or undetected file data corruption (2017.10.09)</font><font size=1 color=#5f5f5f face="Arial"><br>Sent by: </font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=1 color=blue face="Arial"><u>gpfsug-discuss-bounces@spectrumscale.org</u></font></a><div align=center><hr noshade></div><br><font size=3 face="Times New Roman"><br><br><br><br>Hi, From what I understand this does not affect FC SAN cluster configuration,
but mostly NSD IO communication?<br><br>Best regards,<br>Tomasz Wolski</font><font size=2 face="Tahoma"><b><br><br>From:</b> </font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=2 color=blue face="Tahoma"><u>gpfsug-discuss-bounces@spectrumscale.org</u></font></a><font size=2 face="Tahoma">[</font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=2 color=blue face="Tahoma"><u>mailto:gpfsug-discuss-bounces@spectrumscale.org</u></font></a><font size=2 face="Tahoma">]
<b>On Behalf Of </b>Ben De Luca<b><br>Sent:</b> Wednesday, October 11, 2017 6:40 AM<b><br>To:</b> gpfsug main discussion list<b><br>Subject:</b> Re: [gpfsug-discuss] FW: [EXTERNAL] FLASH: IBM Spectrum Scale
(GPFS) V4.1 and 4.2 levels: network reconnect function may result in file
system corruption or undetected file data corruption (2017.10.09)</font><font size=3 face="Times New Roman"><br><br>Lyle thanks for the update, has this issue always existed, or just in v4.1
and 4.2?<br><br>It seems that the likely hood of this event is very low but of course you
encourage people to update asap. <br><br><br><br>On 11 October 2017 at 00:15, Uwe Falke <</font><a href=mailto:UWEFALKE@de.ibm.com target=_blank><font size=3 color=blue face="Times New Roman"><u>UWEFALKE@de.ibm.com</u></font></a><font size=3 face="Times New Roman">>
wrote:<br>Hi, I understood the failure to occur requires that the RPC payload
of<br>the RPC resent without actual header can be mistaken for a valid RPC<br>header. The resend mechanism is probably not considering what the actual<br>content/target the RPC has.<br>So, in principle, the RPC could be to update a data block, or a metadata<br>block - so it may hit just a single data file or corrupt your entire file<br>system.<br>However, I think the likelihood that the RPC content can go as valid RPC<br>header is very low.<br><br><br>Mit freundlichen Grüßen / Kind regards<br><br><br>Dr. Uwe Falke<br><br>IT Specialist<br>High Performance Computing Services / Integrated Technology Services /<br>Data Center Services<br>-------------------------------------------------------------------------------------------------------------------------------------------<br>IBM Deutschland<br>Rathausstr. 7<br>09111 Chemnitz<br>Phone: </font><a href=tel:%2B49%20371%206978%202165><font size=3 color=blue face="Times New Roman"><u>+49
371 6978 2165</u></font></a><font size=3 face="Times New Roman"><br>Mobile: </font><a href=tel:%2B49%20175%20575%202877><font size=3 color=blue face="Times New Roman"><u>+49
175 575 2877</u></font></a><font size=3 face="Times New Roman"><br>E-Mail: </font><a href=mailto:uwefalke@de.ibm.com><font size=3 color=blue face="Times New Roman"><u>uwefalke@de.ibm.com</u></font></a><font size=3 face="Times New Roman"><br>-------------------------------------------------------------------------------------------------------------------------------------------<br>IBM Deutschland Business & Technology Services GmbH / Geschäftsführung:<br>Thomas Wolter, Sven Schooß<br>Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart,<br>HRB 17122<br><br><br><br><br>From: Ben De Luca <</font><a href=mailto:bdeluca@gmail.com><font size=3 color=blue face="Times New Roman"><u>bdeluca@gmail.com</u></font></a><font size=3 face="Times New Roman">><br>To: gpfsug main discussion list <</font><a href="mailto:gpfsug-discuss@spectrumscale.org"><font size=3 color=blue face="Times New Roman"><u>gpfsug-discuss@spectrumscale.org</u></font></a><font size=3 face="Times New Roman">><br>Cc: </font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=3 color=blue face="Times New Roman"><u>gpfsug-discuss-bounces@spectrumscale.org</u></font></a><font size=3 face="Times New Roman"><br>Date: 10/10/2017 08:52 PM<br>Subject: Re: [gpfsug-discuss] FW: [EXTERNAL]
FLASH: IBM Spectrum<br>Scale (GPFS) V4.1 and 4.2 levels: network reconnect function may result
in<br>file system corruption or undetected file data corruption (2017.10.09)<br>Sent by: </font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=3 color=blue face="Times New Roman"><u>gpfsug-discuss-bounces@spectrumscale.org</u></font></a><font size=3 face="Times New Roman"><br><br><br>does this corrupt the entire filesystem or just the open files that are<br>being written too?<br><br>One is horrific and the other is just mildly bad.<br><br>On 10 October 2017 at 17:09, IBM Spectrum Scale <</font><a href=mailto:scale@us.ibm.com><font size=3 color=blue face="Times New Roman"><u>scale@us.ibm.com</u></font></a><font size=3 face="Times New Roman">>
wrote:<br>Bob,<br><br>The problem may occur when the TCP connection is broken between two nodes.<br>While in the vast majority of the cases when data stops flowing through<br>the connection, the result is one of the nodes getting expelled, there
are<br>cases where the TCP connection simply breaks -- that is relatively rare<br>but happens on occasion. There is logic in the mmfsd daemon to detect the<br>disconnection and attempt to reconnect to the destination in question.
If<br>the reconnect is successful then steps are taken to recover the state kept<br>by the daemons, and that includes resending some RPCs that were in flight<br>when the disconnection took place.<br><br>As the flash describes, a problem in the logic to resend some RPCs was<br>causing one of the RPC headers to be omitted, resulting in the RPC data
to<br>be interpreted as the (missing) header. Normally the result is an assert<br>on the receiving end, like the "logAssertFailed: !"Request and
queue size<br>mismatch" assert described in the flash. However, it's at least<br>conceivable (though expected to very rare) that the content of the RPC<br>data could be interpreted as a valid RPC header. In the case of an RPC<br>which involves data transfer between an NSD client and NSD server, that<br>might result in incorrect data being written to some NSD device.<br><br>Disconnect/reconnect scenarios appear to be uncommon. An entry like<br><br>[N] Reconnected to xxx.xxx.xxx.xxx nodename <c0n0><br><br>in mmfs.log would be an indication that a reconnect has occurred. By<br>itself, the reconnect will not imply that data or the file system was<br>corrupted, since that will depend on what RPCs were pending when the<br>connection happened. In the case the assert above is hit, no corruption
is<br>expected, since the daemon will go down before incorrect data gets<br>written.<br><br>Reconnects involving an NSD server are those which present the highest<br>risk, given that NSD-related RPCs are used to write data into NSDs<br><br>Even on clusters that have not been subjected to disconnects/reconnects<br>before, such events might still happen in the future in case of network<br>glitches. It's then recommended that an efix for the problem be applied
in<br>a timely fashion.<br><br><br>Reference: </font><a href="http://www-01.ibm.com/support/docview.wss?uid=ssg1S1010668" target=_blank><font size=3 color=blue face="Times New Roman"><u>http://www-01.ibm.com/support/docview.wss?uid=ssg1S1010668</u></font></a><font size=3 face="Times New Roman"><br><br><br><br>Regards, The Spectrum Scale (GPFS) team<br><br>------------------------------------------------------------------------------------------------------------------<br>If you feel that your question can benefit other users of Spectrum
Scale<br>(GPFS), then please post it to the public IBM developerWroks Forum at</font><font size=2 color=blue face="Calibri"><u><br></u></font><a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479" target=_blank><font size=3 color=blue face="Times New Roman"><u>https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</u></font></a><font size=3 face="Times New Roman"><br>.<br><br>If your query concerns a potential software error in Spectrum Scale (GPFS)<br>and you have an IBM software maintenance contract please contact</font><font size=2 color=blue face="Calibri"><u><br></u></font><a href="tel:1-800-237-5511"><font size=3 color=blue face="Times New Roman"><u>1-800-237-5511</u></font></a><font size=3 face="Times New Roman">in
the United States or your local IBM Service Center in<br>other countries.<br><br>The forum is informally monitored as time permits and should not be used<br>for priority messages to the Spectrum Scale (GPFS) team.<br><br><br><br>From: "Oesterlin, Robert" <</font><a href=mailto:Robert.Oesterlin@nuance.com><font size=3 color=blue face="Times New Roman"><u>Robert.Oesterlin@nuance.com</u></font></a><font size=3 face="Times New Roman">><br>To: gpfsug main discussion list <</font><a href="mailto:gpfsug-discuss@spectrumscale.org"><font size=3 color=blue face="Times New Roman"><u>gpfsug-discuss@spectrumscale.org</u></font></a><font size=3 face="Times New Roman">><br>Date: 10/09/2017 10:38 AM<br>Subject: [gpfsug-discuss] FW: [EXTERNAL] FLASH:
IBM Spectrum Scale<br>(GPFS) V4.1 and 4.2 levels: network reconnect function may result in file<br>system corruption or undetected file data corruption (2017.10.09)<br>Sent by: </font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=3 color=blue face="Times New Roman"><u>gpfsug-discuss-bounces@spectrumscale.org</u></font></a><font size=3 face="Times New Roman"><br><br><br><br>Can anyone from the Scale team comment?<br><br>Anytime I see ?may result in file system corruption or undetected file<br>data corruption? it gets my attention.<br><br>Bob Oesterlin<br>Sr Principal Storage Engineer, Nuance<br><br><br><br><br><br><br><br><br><br><br><br><br><br><br>Storage<br>IBM My Notifications<br>Check out the IBM Electronic Support<br><br><br><br><br><br><br><br>IBM Spectrum Scale<br><br><br><br>: IBM Spectrum Scale (GPFS) V4.1 and 4.2 levels: network reconnect<br>function may result in file system corruption or undetected file data<br>corruption<br><br><br><br>IBM has identified a problem with IBM Spectrum Scale (GPFS) V4.1 and V4.2<br>levels, in which resending an NSD RPC after a network reconnect function<br>may result in file system corruption or undetected file data corruption.<br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__spectrumscale.org&d=DwMGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=sYR0tp1p1aSwQn0RM9QP4zPQxUppP2L6GbiIIiozJUI&s=MdcLR4NOSYoR7HLQgDdVYZge98oH4rMDZaeGbWGJem0&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>spectrumscale.org</u></font></a><font size=2 color=blue face="Calibri"><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=xzMAvLVkhyTD1vOuTRa4PJfiWgFQ6VHBQgr1Gj9LPDw&s=-AQv2Qlt2IRW2q9kNgnj331p8D631Zp0fHnxOuVR0pA&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=xzMAvLVkhyTD1vOuTRa4PJfiWgFQ6VHBQgr1Gj9LPDw&s=-AQv2Qlt2IRW2q9kNgnj331p8D631Zp0fHnxOuVR0pA&e=</u></font></a><font size=3 face="Times New Roman"><br><br><br><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__spectrumscale.org&d=DwMGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=sYR0tp1p1aSwQn0RM9QP4zPQxUppP2L6GbiIIiozJUI&s=MdcLR4NOSYoR7HLQgDdVYZge98oH4rMDZaeGbWGJem0&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>spectrumscale.org</u></font></a><font size=2 color=blue face="Calibri"><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwMGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=sYR0tp1p1aSwQn0RM9QP4zPQxUppP2L6GbiIIiozJUI&s=3ZjFj8wR05Z0PLErKreAAKH50vaxxvbM1H-NngJWJwI&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></a><font size=3 face="Times New Roman"><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__spectrumscale.org&d=DwMGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=sYR0tp1p1aSwQn0RM9QP4zPQxUppP2L6GbiIIiozJUI&s=MdcLR4NOSYoR7HLQgDdVYZge98oH4rMDZaeGbWGJem0&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>spectrumscale.org</u></font></a><font size=2 color=blue face="Calibri"><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwMGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=sYR0tp1p1aSwQn0RM9QP4zPQxUppP2L6GbiIIiozJUI&s=3ZjFj8wR05Z0PLErKreAAKH50vaxxvbM1H-NngJWJwI&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></a><font size=3 face="Times New Roman"><br><br><br><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__spectrumscale.org&d=DwMGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=sYR0tp1p1aSwQn0RM9QP4zPQxUppP2L6GbiIIiozJUI&s=MdcLR4NOSYoR7HLQgDdVYZge98oH4rMDZaeGbWGJem0&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>spectrumscale.org</u></font></a><font size=2 color=blue face="Calibri"><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwMGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=sYR0tp1p1aSwQn0RM9QP4zPQxUppP2L6GbiIIiozJUI&s=3ZjFj8wR05Z0PLErKreAAKH50vaxxvbM1H-NngJWJwI&e=" target=_blank><font size=3 color=blue face="Times New Roman"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></a><font size=2 face="Courier New"><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font><font size=2 color=blue face="Calibri"><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=sYR0tp1p1aSwQn0RM9QP4zPQxUppP2L6GbiIIiozJUI&s=3ZjFj8wR05Z0PLErKreAAKH50vaxxvbM1H-NngJWJwI&e="><font size=2 color=blue face="Courier New"><u>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=sYR0tp1p1aSwQn0RM9QP4zPQxUppP2L6GbiIIiozJUI&s=3ZjFj8wR05Z0PLErKreAAKH50vaxxvbM1H-NngJWJwI&e=</u></font></a><font size=2 face="Courier New"><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font><font size=2 color=blue face="Calibri"><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=oNT2koCZX0xmWlSlLblR9Q&m=6Cn5SWezFnXqdilAZWuwqHSTl02jHaLfB0EAjtCdj08&s=k9ELfnZlXmHnLuRR0_ltTav1nm-VsmcC6nhgggynBEo&e="><font size=2 color=blue face="Courier New"><u>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=oNT2koCZX0xmWlSlLblR9Q&m=6Cn5SWezFnXqdilAZWuwqHSTl02jHaLfB0EAjtCdj08&s=k9ELfnZlXmHnLuRR0_ltTav1nm-VsmcC6nhgggynBEo&e=</u></font></a><font size=2 face="Courier New"><br></font><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=oNT2koCZX0xmWlSlLblR9Q&m=dhKhKiNBptpaDmggHSa8diP48O90VK2uzr-xo9C44uI&s=SCeTu6NeyjHm9D8S4VZVUnrALgCvNksAYTF9rfwD50g&e="><tt><font size=2>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=oNT2koCZX0xmWlSlLblR9Q&m=dhKhKiNBptpaDmggHSa8diP48O90VK2uzr-xo9C44uI&s=SCeTu6NeyjHm9D8S4VZVUnrALgCvNksAYTF9rfwD50g&e=</font></tt></a><tt><font size=2><br></font></tt><br><BR>