<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div>Thanks Stephen, </div>
<div><br>
</div>
<div>for clarifying, i misread the initial question, and thanks Stefan for raising that IDEA.<br>
The new address for raising RFEs/IDEAs on GPFS now is : <a href="https://ibm-sys-storage.ideas.ibm.com/ideas?project=GPFS">https://ibm-sys-storage.ideas.ibm.com/ideas?project=GPFS</a></div>
<div><br>
</div>
<div><span>
<pre>-- <br></pre>
<div data-evo-paragraph="" class="" style="width: 71ch;" data-evo-signature-plain-text-mode="">
Mit freundlichen Grüßen / Kind regards</div>
<div data-evo-paragraph="" class="" style="width: 71ch;"><br>
</div>
<div data-evo-paragraph="" class="" style="width: 71ch;">Achim Rehor</div>
<div data-evo-paragraph="" class="" style="width: 71ch;"><br>
</div>
<div data-evo-paragraph="" class="" style="width: 71ch;">-----Original Message-----</div>
</span></div>
<div><b>From</b>: Stephen Ulmer <<a href="mailto:Stephen%20Ulmer%20%3culmer@ulmer.org%3e">ulmer@ulmer.org</a>></div>
<div><b>Reply-To</b>: gpfsug main discussion list <<a href="mailto:gpfsug%20main%20discussion%20list%20%3cgpfsug-discuss@gpfsug.org%3e">gpfsug-discuss@gpfsug.org</a>></div>
<div><b>To</b>: gpfsug main discussion list <<a href="mailto:gpfsug%20main%20discussion%20list%20%3cgpfsug-discuss@gpfsug.org%3e">gpfsug-discuss@gpfsug.org</a>></div>
<div><b>Subject</b>: [EXTERNAL] Re: [gpfsug-discuss] Protection against silent data corruption</div>
<div><b>Date</b>: Thu, 09 Jun 2022 15:47:07 -0400</div>
<div><br>
</div>
<!-- text/html --><!-- BaNnErBlUrFlE-BoDy-start --><!-- Preheader Text : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
Just to be clear: any follow-up should be directed to Stephan, who is requesting the feature. I am well aware that Scale does not provide this feature, and was just clarifying Stephan’s question for Achim, who answered the question with an</div>
<!-- Preheader Text : END --><!-- Email Banner : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
ZjQcmQRYFpfptBannerStart</div>
<!--[if ((ie)|(mso))]>
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="padding: 16px 0px 16px 0px; direction: ltr" lang="en"><tr><td>
<table border="0" cellspacing="0" cellpadding="0" style="padding: 0px 10px 5px 6px; width: 100%; border-radius:4px; border-top:4px solid #90a4ae;background-color:#D0D8DC;"><tr><td valign="top">
<table align="left" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 8px 4px 8px">
<tr><td style="color:#000000; font-family: 'Arial', sans-serif; font-weight:bold; font-size:14px; direction: ltr">
This Message Is From an External Sender
</td></tr>
<tr><td style="color:#000000; font-weight:normal; font-family: 'Arial', sans-serif; font-size:12px; direction: ltr">
This message came from outside your organization.
</td></tr>
</table>
</td></tr></table>
</td></tr></table>
<![endif]--><!--[if !((ie)|(mso))]-->
<div dir="ltr" lang="en" id="pfptBanneryhn0xcb" style="all: revert !important; display:block !important; text-align: left !important; margin:16px 0px 16px 0px !important; padding:8px 16px 8px 16px !important; border-radius: 4px !important; min-width: 200px !important; background-color: #D0D8DC !important; background-color: #D0D8DC; border-top: 4px solid #90a4ae !important; border-top: 4px solid #90a4ae;">
<div id="pfptBanneryhn0xcb" style="all: unset !important; float:left !important; display:block !important; margin: 0px 0px 1px 0px !important; max-width: 600px !important;">
<div id="pfptBanneryhn0xcb" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-weight:bold !important; font-weight:bold; font-size:14px !important; line-height:18px !important; line-height:18px">
This Message Is From an External Sender </div>
<div id="pfptBanneryhn0xcb" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-weight:normal; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size:12px !important; line-height:18px !important; line-height:18px; margin-top:2px !important;">
This message came from outside your organization. </div>
</div>
<div style="clear: both !important; display: block !important; visibility: hidden !important; line-height: 0 !important; font-size: 0.01px !important; height: 0px">
</div>
</div>
<!--[endif]-->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
ZjQcmQRYFpfptBannerEnd</div>
<!-- Email Banner : END --><!-- BaNnErBlUrFlE-BoDy-end --><!-- BaNnErBlUrFlE-HeAdEr-start --><style> #pfptBanneryhn0xcb { all: revert !important; display: block !important; visibility: visible !important; opacity: 1 !important; background-color: #D0D8DC !important; max-width: none !important; max-height: none !important } .pfptPrimaryButtonyhn0xcb:hover, .pfptPrimaryButtonyhn0xcb:focus { background-color: #b4c1c7 !important; } .pfptPrimaryButtonyhn0xcb:active { background-color: #90a4ae !important; }</style><!-- BaNnErBlUrFlE-HeAdEr-end -->Just
to be clear: any follow-up should be directed to Stephan, who is requesting the feature.
<div class=""><br class="">
</div>
<div class="">I am well aware that Scale does not provide this feature, and was just clarifying Stephan’s question for Achim, who answered the question with an unrelated reference after which Scale support replied to me.
<div class=""><br class="">
</div>
<div class="">This is also where I notice that for all that is holy, the generated IDEA links point to DeveloperWorks and don’t even get you to the correct forum thread. Sigh.</div>
<div class=""><br class="">
<div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
-- <br class="">
Stephen<br class="">
<br class="">
<br class="">
</div>
</div>
<div><br class="">
<blockquote type="cite" style="margin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex">
<div class="">On Jun 9, 2022, at 2:45 PM, IBM Spectrum Scale <<a href="mailto:scale@us.ibm.com" class="">scale@us.ibm.com</a>> wrote:</div>
<div><br class="Apple-interchange-newline">
</div>
<div class="">
<div class="">
<p class=""><font size="2" face="sans-serif" class="">Thanks Stephan.</font><br class="">
<font size="2" face="sans-serif" class="">This will be looked into and accordingly prioritized by the offering manager team. Incase the IBM team has any further questions on this then we will get back to you.</font><br class="">
<br class="">
<font size="2" face="sans-serif" class="">Regards, The Spectrum Scale (GPFS) team<br class="">
<br class="">
------------------------------------------------------------------------------------------------------------------<br class="">
If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at
<a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479" class="">https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</a>.
<br class="">
<br class="">
If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries.
<br class="">
<br class="">
The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.</font><br class="">
<br class="">
<span id="cid:1__=0ABB02CFDFF542A98f9e8a93df938690@ibm.com"><graycol.gif></span><font size="2" color="#424282" face="sans-serif" class="">"Stephan Graf" ---09-06-2022 11.31.01 AM---Hi, I have create an IDEA for it:</font><br class="">
<br class="">
<font size="1" color="#5F5F5F" face="sans-serif" class="">From: </font><font size="1" face="sans-serif" class="">"Stephan Graf" <<a href="mailto:st.graf@fz-juelich.de" class="">st.graf@fz-juelich.de</a>></font><br class="">
<font size="1" color="#5F5F5F" face="sans-serif" class="">To: </font><font size="1" face="sans-serif" class=""><<a href="mailto:gpfsug-discuss@gpfsug.org" class="">gpfsug-discuss@gpfsug.org</a>></font><br class="">
<font size="1" color="#5F5F5F" face="sans-serif" class="">Date: </font><font size="1" face="sans-serif" class="">09-06-2022 11.31 AM</font><br class="">
<font size="1" color="#5F5F5F" face="sans-serif" class="">Subject: </font><font size="1" face="sans-serif" class="">[EXTERNAL] Re: [gpfsug-discuss] Protection against silent data corruption</font><br class="">
<font size="1" color="#5F5F5F" face="sans-serif" class="">Sent by: </font><font size="1" face="sans-serif" class="">"gpfsug-discuss" <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org" class="">gpfsug-discuss-bounces@gpfsug.org</a>></font><br class="">
</p>
<hr width="100%" size="2" align="left" noshade="" style="color:#8091A5; " class="">
<br class="">
<br class="">
<br class="">
<tt class=""><font size="2" class="">Hi,<br class="">
<br class="">
I have create an IDEA for it: <br class="">
</font></tt><tt class=""><font size="2" class=""><a href="https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-851" class="">https://ibm-sys-storage.ideas.ibm.com/ideas/GPFS-I-851</a></font></tt><tt class=""><font size="2" class=""><br class="">
<br class="">
Stephan<br class="">
<br class="">
<br class="">
Am 08.06.2022 um 20:35 schrieb IBM Spectrum Scale:<br class="">
> Hi Stephen,<br class="">
> <br class="">
> Currently such a feature is not available in Spectrum Scale product.<br class="">
> <br class="">
> <br class="">
> Regards, The Spectrum Scale (GPFS) team<br class="">
> <br class="">
> ------------------------------------------------------------------------------------------------------------------<br class="">
> If you feel that your question can benefit other users of Spectrum <br class="">
> Scale (GPFS), then please post it to the public IBM developerWroks Forum <br class="">
> at <br class="">
> </font></tt><tt class=""><font size="2" class=""><a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479" class="">https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</a></font></tt><tt class=""><font size="2" class=""> <br class="">
> <</font></tt><tt class=""><font size="2" class=""><a href="https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479" class="">https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</a></font></tt><tt class=""><font size="2" class="">>.
<br class="">
> <br class="">
> <br class="">
> If your query concerns a potential software error in Spectrum Scale <br class="">
> (GPFS) and you have an IBM software maintenance contract please contact <br class="">
> 1-800-237-5511 in the United States or your local IBM Service Center <br class="">
> in other countries.<br class="">
> <br class="">
> The forum is informally monitored as time permits and should not be used <br class="">
> for priority messages to the Spectrum Scale (GPFS) team.<br class="">
> <br class="">
> Inactive hide details for "Stephen Ulmer" ---02-06-2022 11.32.27 <br class="">
> PM---This only adds a checksum to the NSD wire protocol. The q"Stephen <br class="">
> Ulmer" ---02-06-2022 11.32.27 PM---This only adds a checksum to the NSD <br class="">
> wire protocol. The question was about detecting data corruption<br class="">
> <br class="">
> From: "Stephen Ulmer" <<a href="mailto:ulmer@ulmer.org" class="">ulmer@ulmer.org</a>><br class="">
> To: "gpfsug main discussion list" <<a href="mailto:gpfsug-discuss@gpfsug.org" class="">gpfsug-discuss@gpfsug.org</a>><br class="">
> Date: 02-06-2022 11.32 PM<br class="">
> Subject: [EXTERNAL] Re: [gpfsug-discuss] Protection against silent data <br class="">
> corruption<br class="">
> Sent by: "gpfsug-discuss" <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org" class="">gpfsug-discuss-bounces@gpfsug.org</a>><br class="">
> <br class="">
> ------------------------------------------------------------------------<br class="">
> <br class="">
> <br class="">
> <br class="">
> This only adds a checksum to the NSD wire protocol. The question was <br class="">
> about detecting data corruption at rest. -- Stephen On Jun 2, 2022, at <br class="">
> 1:01 PM, Achim Rehor <<a href="mailto:Achim.Rehor@de.ibm.com" class="">Achim.Rehor@de.ibm.com</a>> wrote: hi Stephan,
<br class="">
> <br class="">
> <br class="">
> This only adds a checksum to the NSD wire protocol. The question was <br class="">
> about detecting data corruption at rest.<br class="">
> <br class="">
> -- <br class="">
> Stephen<br class="">
> <br class="">
> <br class="">
> On Jun 2, 2022, at 1:01 PM, Achim Rehor <_Achim.Rehor@de.ibm.com_<br class="">
> <</font></tt><tt class=""><font size="2" class=""><a href="mailto:Achim.Rehor@de.ibm.com" class="">mailto:Achim.Rehor@de.ibm.com</a></font></tt><tt class=""><font size="2" class="">>> wrote:<br class="">
> <br class="">
> hi Stephan,<br class="">
> <br class="">
> there is, see mmchconfig man page :<br class="">
> <br class="">
> nsdCksumTraditional<br class="">
> This attribute enables checksum data-integrity checking between a<br class="">
> traditional NSD client node and its NSD server. Valid values are yes<br class="">
> and no. The default value is no.<br class="">
> (Traditional in this context means that the NSD client and server<br class="">
> are configured with IBM Spectrum Scale rather than with IBM Spectrum<br class="">
> Scale RAID.<br class="">
> The latter is a component of IBM Elastic Storage Server (ESS) and of<br class="">
> IBM GPFS Storage Server (GSS).)<br class="">
> <br class="">
> The checksum procedure detects any corruption by the network of the<br class="">
> data in the NSD RPCs that are exchanged between the NSD client and the<br class="">
> server. A checksum error triggers a request to retransmit the message.<br class="">
> <br class="">
> When this attribute is enabled on a client node, the client<br class="">
> indicates in each of its requests to the server that it is using<br class="">
> checksums. The server uses checksums only in<br class="">
> response to client requests in which the indicator is set. A client<br class="">
> node that accesses a file system that belongs to another cluster can<br class="">
> use checksums in the same way.<br class="">
> <br class="">
> You can change the value of the this attribute for an entire cluster<br class="">
> without shutting down the mmfsd daemon, or for one or more nodes<br class="">
> without restarting the nodes.<br class="">
> <br class="">
> Note:<br class="">
> * Enabling this feature can result in significant I/O performance<br class="">
> degradation and a considerable increase in CPU usage.<br class="">
> <br class="">
> * To enable checksums for a subset of the nodes in a cluster, issue<br class="">
> a command like the following one:<br class="">
> mmchconfig nsdCksumTraditional=yes -i -N <subset-of-nodes><br class="">
> <br class="">
> The -N flag is valid for this attribute.<br class="">
> <br class="">
> -- <br class="">
> Mit freundlichen Grüßen / Kind regards<br class="">
> <br class="">
> Achim Rehor<br class="">
> <br class="">
> Technical Support Specialist Spectrum Scale and ESS (SME)<br class="">
> Advisory Product Services Professional<br class="">
> IBM Systems Storage Support - EMEA<br class="">
> <br class="">
> _Achim.Rehor@de.ibm.com_<br class="">
> <</font></tt><tt class=""><font size="2" class=""><a href="mailto:Achim.Rehor@de.ibm.com" class="">mailto:Achim.Rehor@de.ibm.com</a></font></tt><tt class=""><font size="2" class="">> +49-170-4521194<br class="">
> IBM Deutschland GmbH<br class="">
> Vorsitzender des Aufsichtsrats: Sebastian Krause<br class="">
> Geschäftsführung: Gregor Pillen (Vorsitzender), Nicole Reimer,<br class="">
> Gabriele Schwarenthorer, Christine Rupp, Frank Theisen<br class="">
> Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht<br class="">
> Stuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940<br class="">
> <br class="">
> <br class="">
> -----Original Message-----<br class="">
> *From*: Stephan Graf <_st.graf@fz-juelich.de_<br class="">
> <</font></tt><tt class=""><font size="2" class=""><a href="mailto:Stephan%20Graf%20%3cst.graf@fz-juelich.de%3e" class="">mailto:Stephan%20Graf%20%3cst.graf@fz-juelich.de%3e</a></font></tt><tt class=""><font size="2" class="">>><br class="">
> *Reply-To*: gpfsug main discussion list <_gpfsug-discuss@gpfsug.org_<br class="">
> <</font></tt><tt class=""><font size="2" class=""><a href="mailto:gpfsug%20main%20discussion%20list%20%3cgpfsug-discuss@gpfsug.org%3e" class="">mailto:gpfsug%20main%20discussion%20list%20%3cgpfsug-discuss@gpfsug.org%3e</a></font></tt><tt class=""><font size="2" class="">>><br class="">
> *To*: gpfsug-discuss <_gpfsug-discuss@gpfsug.org_<br class="">
> <</font></tt><tt class=""><font size="2" class=""><a href="mailto:gpfsug-discuss%20%3cgpfsug-discuss@gpfsug.org%3e" class="">mailto:gpfsug-discuss%20%3cgpfsug-discuss@gpfsug.org%3e</a></font></tt><tt class=""><font size="2" class="">>><br class="">
> *Subject*: [EXTERNAL] [gpfsug-discuss] Protection against silent<br class="">
> data corruption<br class="">
> *Date*: Thu, 02 Jun 2022 16:31:43 +0200<br class="">
> <br class="">
> Hi,<br class="">
> <br class="">
> I am wondering if there is an option in SS to enable some checking to<br class="">
> detect silent data corruption.<br class="">
> <br class="">
> Form GNR I know that there is End-to-End integrity. So a checksum is<br class="">
> stored in addition.<br class="">
> <br class="">
> The background is that we are facing an issue where in some files<br class="">
> (which<br class="">
> have data replication = 2) the mmrestripefile is reporting, that one<br class="">
> block is mismatching it's copy (the storage cluster is running SS<br class="">
> without GNR).<br class="">
> We have validated that the copied block is fine, but the original<br class="">
> one is<br class="">
> broken (and this is what is returned on read access).<br class="">
> SS right now in our installation is unable to determine which is the<br class="">
> correct one.<br class="">
> Is there any option to enable this kind of feature in SS? If not, does<br class="">
> it make sense to create an "IDEA" for it?<br class="">
> <br class="">
> Stephan<br class="">
> <br class="">
> _______________________________________________<br class="">
> gpfsug-discuss mailing list<br class="">
> gpfsug-discuss at _gpfsug.org_ <</font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/" class="">http://gpfsug.org</a></font></tt><tt class=""><font size="2" class="">><br class="">
> _</font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org_" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org_</a></font></tt><tt class=""><font size="2" class=""><br class="">
> <</font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a></font></tt><tt class=""><font size="2" class="">><br class="">
> _______________________________________________<br class="">
> gpfsug-discuss mailing list<br class="">
> gpfsug-discuss at _gpfsug.org_ <</font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/" class="">http://gpfsug.org</a></font></tt><tt class=""><font size="2" class="">>_<br class="">
> __</font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org_" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org_</a></font></tt><tt class=""><font size="2" class=""><br class="">
> <</font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a></font></tt><tt class=""><font size="2" class="">><br class="">
> <br class="">
> _______________________________________________<br class="">
> gpfsug-discuss mailing list<br class="">
> gpfsug-discuss at <a href="http://gpfsug.org" class="">gpfsug.org</a><br class="">
> </font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a></font></tt><tt class=""><font size="2" class=""> <br class="">
> <</font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a></font></tt><tt class=""><font size="2" class="">><br class="">
> <br class="">
> <br class="">
> <br class="">
> <br class="">
> <br class="">
> _______________________________________________<br class="">
> gpfsug-discuss mailing list<br class="">
> gpfsug-discuss at <a href="http://gpfsug.org" class="">gpfsug.org</a><br class="">
> </font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a></font></tt><tt class=""><font size="2" class=""><br class="">
<br class="">
-- <br class="">
Stephan Graf<br class="">
Juelich Supercomputing Centre<br class="">
<br class="">
Phone: +49-2461-61-6578<br class="">
Fax: +49-2461-61-6656<br class="">
<a href="mailto:st.graf@fz-juelich.de" class="">E-mail: st.graf@fz-juelich.de</a><br class="">
WWW: </font></tt><tt class=""><font size="2" class=""><a href="http://www.fz-juelich.de/jsc/" class="">http://www.fz-juelich.de/jsc/</a></font></tt><tt class=""><font size="2" class=""><br class="">
---------------------------------------------------------------------------------------------<br class="">
---------------------------------------------------------------------------------------------<br class="">
Forschungszentrum Juelich GmbH<br class="">
52425 Juelich<br class="">
Sitz der Gesellschaft: Juelich<br class="">
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498<br class="">
Vorsitzender des Aufsichtsrats: MinDir Volker Rieke<br class="">
Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),<br class="">
Karsten Beneke (stellv. Vorsitzender), Dr. Astrid Lambrecht,<br class="">
Prof. Dr. Frauke Melchior<br class="">
---------------------------------------------------------------------------------------------<br class="">
---------------------------------------------------------------------------------------------<br class="">
[attachment "smime.p7s" deleted by Huzefa H Pancha/India/IBM] _______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://gpfsug.org" class="">gpfsug.org</a><br class="">
</font></tt><tt class=""><font size="2" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a></font></tt><tt class=""><font size="2" class=""><br class="">
</font></tt><br class="">
<br class="">
<br class="">
<br class="">
</div>
_______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://gpfsug.org" class="">gpfsug.org</a><br class="">
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a><br class="">
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
<div>_______________________________________________<br>
</div>
<div>gpfsug-discuss mailing list<br>
</div>
<div>gpfsug-discuss at gpfsug.org<br>
</div>
<div><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a> <br>
</div>
</body>
</html>