<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
h3
{mso-style-priority:9;
mso-style-link:"Heading 3 Char";
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:13.5pt;
font-family:"Calibri",sans-serif;
font-weight:bold;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
font-size:10.0pt;
font-family:"Courier New";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.Heading3Char
{mso-style-name:"Heading 3 Char";
mso-style-priority:9;
mso-style-link:"Heading 3";
font-family:"Calibri Light",sans-serif;
color:#1F3763;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">I’ll just chime in here that we export multiple file systems on a singular FileSystem_ID (666.666, the default) but with different Export_id’s, and have no stale file handle issues on the nfs clients.
<o:p></o:p></p>
<p class="MsoNormal">I’d recommend opening up a case if you do have issues.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Ed Wahl<o:p></o:p></p>
<p class="MsoNormal">OSC<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Christof Schmitt <christof.schmitt@us.ibm.com> <br>
<b>Sent:</b> Wednesday, June 28, 2023 10:48 AM<br>
<b>To:</b> gpfsug-discuss@gpfsug.org; leonardo.sala@psi.ch; gpfsug-discuss@spectrumscale.org; Wahl, Edward <ewahl@osc.edu><br>
<b>Subject:</b> RE: [gpfsug-discuss] CES, Ganesha, and Filesystem_id<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">Apologies for the back and forth. Please keep the parameter for now. It should be ok for most cases. If there is a problem, please open a support ticket for further
debugging. Regards, Christof On Wed, 2023-06-28 at 14: 20 +0000, Christof Schmitt
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal">Apologies for the back and forth. Please keep the parameter for now. It should be ok for most cases. If there is a problem, please open a support ticket for further debugging.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Regards,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Christof<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On Wed, 2023-06-28 at 14:20 +0000, Christof Schmitt wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">Is the parameter set in your config? If so, then yes, remove it. Regards, Christof On Wed, 2023-06-28 at 15: 49 +0200, Leonardo Sala wrote: Hi Christof, thanks!
So the preferred way should be not to have Filesystem_Id. If I have understood correctly,
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal">Is the parameter set in your config? If so, then yes, remove it.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Regards,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Christof<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On Wed, 2023-06-28 at 15:49 +0200, Leonardo Sala wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">Hi Christof, thanks! So the preferred way should be not to have Filesystem_Id. If I have understood correctly, this is anyhow set up by default in CES to 666. 666,
so the suggested procedure during the CES setup should be to manually modify <o:p>
</o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white"><o:p></o:p></span></p>
</div>
<p><span style="font-family:"Courier New"">Hi Christof,</span><o:p></o:p></p>
<p><span style="font-family:"Courier New"">thanks! So the preferred way should be not to have Filesystem_Id. If I have understood correctly, this is anyhow set up by default in CES to 666.666, so the suggested procedure during the CES setup should be to manually
modify gpfs.ganesha.exports.conf and remove this parameter from all the exports, is that correct? Is there an easier way, or is there a plan to remove the 666.666 default value?</span><o:p></o:p></p>
<p><span style="font-family:"Courier New"">In our case, we do rely on two separated CES clusters (one in prod and one in stand by, so that we can perform upgrades with no downtime by migrating the IPs from one to the other), so it might be safer to explicilty
set Filesystem_Id, to ensure consistency among the cluster - would that make sense?</span><o:p></o:p></p>
<p><span style="font-family:"Courier New"">Thanks again!</span><o:p></o:p></p>
<p><span style="font-family:"Courier New"">Regards</span><o:p></o:p></p>
<p><span style="font-family:"Courier New"">leo</span><o:p></o:p></p>
<pre>Paul Scherrer Institut<o:p></o:p></pre>
<pre>Dr. Leonardo Sala<o:p></o:p></pre>
<pre>Group Leader Data Analysis and Research Infrastructure<o:p></o:p></pre>
<pre>Deputy Department Head a.i Science IT Infrastructure and Services department<o:p></o:p></pre>
<pre>Science IT Infrastructure and Services department (AWI)<o:p></o:p></pre>
<pre>WHGA/036<o:p></o:p></pre>
<pre>Forschungstrasse 111<o:p></o:p></pre>
<pre>5232 Villigen PSI<o:p></o:p></pre>
<pre>Switzerland<o:p></o:p></pre>
<p class="MsoNormal"><o:p> </o:p></p>
<pre>Phone: +41 56 310 3369<o:p></o:p></pre>
<p class="MsoNormal"><a href="mailto:leonardo.sala@psi.ch"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="mailto:leonardo.sala@psi.ch">leonardo.sala@psi.ch<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><br>
<a href="https://urldefense.com/v3/__http:/www.psi.ch__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7eWHimBU$"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="https://urldefense.com/v3/__http:/www.psi.ch__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7eWHimBU$">www.psi.ch<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On 6/28/23 15:22, Christof Schmitt wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">After another discussion it turns out that this parameter is not required. While my previous comment is correct, that there is the need to have unique handles across file systems, GPFS already provides that information and Ganesha handles
that correctly. So there is no need to set the parameter in the Ganesha config.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Regards,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Christof<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On Wed, 2023-06-28 at 14:33 +0200, Leonardo Sala wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">Hi Christof, thanks a lot! In our case we are exporting multiple filesets from 2 filesystems, I guess we should fix unique Fileset_IDs for each fileset? What would happen in case we just remove the Fileset_id parameter, as suggested by
the <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p></o:p></p>
</div>
<p>Hi Christof,<o:p></o:p></p>
<p>thanks a lot! In our case we are exporting multiple filesets from 2 filesystems, I guess we should fix unique Fileset_IDs for each fileset? What would happen in case we just remove the Fileset_id parameter, as suggested by the ganesha docs?<o:p></o:p></p>
<p>Regards<o:p></o:p></p>
<p>leo<o:p></o:p></p>
<pre>Paul Scherrer Institut<o:p></o:p></pre>
<pre>Dr. Leonardo Sala<o:p></o:p></pre>
<pre>Group Leader Data Analysis and Research Infrastructure<o:p></o:p></pre>
<pre>Deputy Department Head a.i Science IT Infrastructure and Services department<o:p></o:p></pre>
<pre>Science IT Infrastructure and Services department (AWI)<o:p></o:p></pre>
<pre>WHGA/036<o:p></o:p></pre>
<pre>Forschungstrasse 111<o:p></o:p></pre>
<pre>5232 Villigen PSI<o:p></o:p></pre>
<pre>Switzerland<o:p></o:p></pre>
<pre>Phone: +41 56 310 3369<o:p></o:p></pre>
<p class="MsoNormal"><a href="mailto:leonardo.sala@psi.ch"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="mailto:leonardo.sala@psi.ch">leonardo.sala@psi.ch<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__http:/www.psi.ch__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7eWHimBU$"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="https://urldefense.com/v3/__http:/www.psi.ch__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7eWHimBU$">www.psi.ch<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On 6/28/23 14:22, Christof Schmitt wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">The "FileSystem_Id" is a unique identifier for the file system. The technical background is that Ganesha asks the file system for a file handle, but that is only unique within the file system. If there are NFS exports on different file
systems, there needs to be a way to make the file handles unique across multiple file systems. So if there are NFS exports on different file systems, this parameter should be set with a unique value for each file system. If there is only one file system with
NFS exports, then this should not be necessary.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Regards,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Christof<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">On Wed, 2023-06-28 at 08:53 +0200, Leonardo Sala wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">Hi Ed, thanks! In our case we do have unique export ids, but the same fsid, and this seems to create issues. Also, reading Ganesha docs, I can see [*]: FileSystem_ID EXPORT Option There is an EXPORT config option, FileSystem_ID. This really
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p></o:p></p>
</div>
<p>Hi Ed,<o:p></o:p></p>
<p>thanks! In our case we do have unique export ids, but the same fsid, and this seems to create issues. Also, reading Ganesha docs, I can see [*]:<o:p></o:p></p>
<h3>FileSystem_ID EXPORT Option<o:p></o:p></h3>
<p>There is an EXPORT config option, FileSystem_ID. This really should not be used, all it does it designate an fsid to be used with the attributes of all objects in the export. It will be folded to fit into NFSv3. Because it applies to the entire export, it
prevents exporting multiple file systems since there will likely be issues with collision of inode numbers on the client.<o:p></o:p></p>
<p>so before touching the defaults in GPFS CES configuration I would like some guidance or experiences from this mlist :)<o:p></o:p></p>
<p>cheers<o:p></o:p></p>
<p>leo<o:p></o:p></p>
<p>[*] <a href="https://urldefense.com/v3/__https:/github.com/nfs-ganesha/nfs-ganesha/wiki/File-Systems*FileSystem_ID_EXPORT_Option__;Iw!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7Ztdj-Cm$">
https://github.com/nfs-ganesha/nfs-ganesha/wiki/File-Systems#FileSystem_ID_EXPORT_Option</a><o:p></o:p></p>
<p><o:p> </o:p></p>
<pre>Paul Scherrer Institut<o:p></o:p></pre>
<pre>Dr. Leonardo Sala<o:p></o:p></pre>
<pre>Group Leader Data Analysis and Research Infrastructure<o:p></o:p></pre>
<pre>Deputy Department Head a.i Science IT Infrastructure and Services department<o:p></o:p></pre>
<pre>Science IT Infrastructure and Services department (AWI)<o:p></o:p></pre>
<pre>WHGA/036<o:p></o:p></pre>
<pre>Forschungstrasse 111<o:p></o:p></pre>
<pre>5232 Villigen PSI<o:p></o:p></pre>
<pre>Switzerland<o:p></o:p></pre>
<pre>Phone: +41 56 310 3369<o:p></o:p></pre>
<p class="MsoNormal"><a href="mailto:leonardo.sala@psi.ch"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="mailto:leonardo.sala@psi.ch">leonardo.sala@psi.ch<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__http:/www.psi.ch__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7eWHimBU$"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="https://urldefense.com/v3/__http:/www.psi.ch__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7eWHimBU$">www.psi.ch<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On 6/27/23 19:41, Wahl, Edward wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #729FCF 1.5pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I vaguely recall seeing this and testing it. My notes to myself say: ‘As long as the export_id is unique, you are fine.’ See the manuals, ganesha loves Camel Case so it’s more
than likely actually “Export_Id” or some such. <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Ed Wahl<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Ohio Supercomputer Center<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b>From:</b> gpfsug-discuss
<a href="mailto:gpfsug-discuss-bounces@gpfsug.org"><gpfsug-discuss-bounces@gpfsug.org></a>
<b>On Behalf Of </b>Leonardo Sala<br>
<b>Sent:</b> Tuesday, June 27, 2023 10:18 AM<br>
<b>To:</b> <a href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a><br>
<b>Subject:</b> [gpfsug-discuss] CES, Ganesha, and Filesystem_id<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hallo, we are checking our current CES configuration, and we noticed that by default GPFS puts always Filesystem_Id=666. 666 [*], no matter which Export_Id value the export has.
To my understanding (which is poor!), this means that all clients <o:p></o:p></p>
</div>
<p>Hallo,<o:p></o:p></p>
<p>we are checking our current CES configuration, and we noticed that by default GPFS puts always Filesystem_Id=666.666 [*], no matter which Export_Id value the export has. To my understanding (which is poor!), this means that all clients will see all our exports
(~20) with the same device number, creating various possible issues (e.g. file state handles). Questions:<o:p></o:p></p>
<p>* is there a reason for such default value? If we change it, are there unpleasant effects we could see?<o:p></o:p></p>
<p>* what would be a reasonable value? Looking around I saw that Filesystem_Id = Export_Id.Export_Id is quite common, with the possible issue of using the forbidden 152.152 [**]<o:p></o:p></p>
<p>* what happens if we actually remove the Filesytem_Id parameter from gpfs.ganesha.exports.conf?<o:p></o:p></p>
<p>* is there a way to modify Filesystem_Id in gpfs.ganesha.exports.conf without editing the file, eg using mmnfs commands (seems not, but I might be mistaken)?<o:p></o:p></p>
<p>Thanks a lot!<o:p></o:p></p>
<p>cheers<o:p></o:p></p>
<p>leo<o:p></o:p></p>
<p> <o:p></o:p></p>
<p>[*] <a href="https://urldefense.com/v3/__https:/www.ibm.com/docs/en/storage-scale/5.0.4?topic=exports-making-bulk-changes-nfs__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7QX2Pj9P$">
https://www.ibm.com/docs/en/storage-scale/5.0.4?topic=exports-making-bulk-changes-nfs</a><o:p></o:p></p>
<p>[**] <a href="https://urldefense.com/v3/__https:/github.com/nfs-ganesha/nfs-ganesha/issues/615__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7fU1vZ7u$">
https://github.com/nfs-ganesha/nfs-ganesha/issues/615</a><o:p></o:p></p>
<pre>-- <o:p></o:p></pre>
<pre>Paul Scherrer Institut<o:p></o:p></pre>
<pre>Dr. Leonardo Sala<o:p></o:p></pre>
<pre>Group Leader Data Analysis and Research Infrastructure<o:p></o:p></pre>
<pre>Deputy Department Head a.i Science IT Infrastructure and Services department<o:p></o:p></pre>
<pre>Science IT Infrastructure and Services department (AWI)<o:p></o:p></pre>
<pre>WHGA/036<o:p></o:p></pre>
<pre>Forschungstrasse 111<o:p></o:p></pre>
<pre>5232 Villigen PSI<o:p></o:p></pre>
<pre>Switzerland<o:p></o:p></pre>
<pre> <o:p></o:p></pre>
<pre>Phone: +41 56 310 3369<o:p></o:p></pre>
<p class="MsoNormal"><a href="mailto:leonardo.sala@psi.ch"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="mailto:leonardo.sala@psi.ch">leonardo.sala@psi.ch<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__http:/www.psi.ch__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7eWHimBU$"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="https://urldefense.com/v3/__http:/www.psi.ch__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7eWHimBU$">www.psi.ch<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>gpfsug-discuss mailing list<o:p></o:p></pre>
<pre>gpfsug-discuss at gpfsug.org<o:p></o:p></pre>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7Q3O-NLi$"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7Q3O-NLi$">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
</blockquote>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>gpfsug-discuss mailing list<o:p></o:p></pre>
<pre>gpfsug-discuss at gpfsug.org<o:p></o:p></pre>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7Q3O-NLi$"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7Q3O-NLi$">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
<pre> <o:p></o:p></pre>
</blockquote>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>gpfsug-discuss mailing list<o:p></o:p></pre>
<pre>gpfsug-discuss at gpfsug.org<o:p></o:p></pre>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7Q3O-NLi$"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7Q3O-NLi$">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
</blockquote>
</blockquote>
</blockquote>
</blockquote>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>gpfsug-discuss mailing list<o:p></o:p></pre>
<pre>gpfsug-discuss at gpfsug.org<o:p></o:p></pre>
<p class="MsoNormal"><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7Q3O-NLi$"><o:p></o:p></a></p>
<pre><u><span style="color:blue"><a href="https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!KGKeukY!2v_48Xi2__5tabAU_vlEqdeIscyzT3vSH4NR8FdXf0IyE8xwFzV2cBPgK5LCxE4r-aZDR1k0Ff2bpRLr7Q3O-NLi$">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org<span style="color:windowtext;text-decoration:none"><o:p></o:p></span></a></span></u></pre>
<p class="MsoNormal"><o:p> </o:p></p>
<pre> <o:p></o:p></pre>
</blockquote>
</div>
</body>
</html>