<div dir="auto">mmvdisk rg change —active is a very common operation. It should be perfectly safe.</div><div dir="auto"><br></div><div dir="auto">mmvdisk rg change —restart is an option I didn’t know about, so likely not something that’s commonly used.</div><div dir="auto"><br></div><div dir="auto">I wouldn’t be too worried about losing the RGs. I don’t think that’s something that can happen without support being able to help getting it back online. Once I’ve had a situation similar to your RG not wanting to become active again during an upgrade (around 5 years ago), and I believe we solved it by rebooting the io-nodes — must have been some stuck process I was unable to understand… or was it a CCR issue caused by some nodes being way back-level..? Don’t remember.</div><div dir="auto"><br></div><div dir="auto"><br></div><div dir="auto"><br></div><div dir="auto"> -jf</div><div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">tor. 24. aug. 2023 kl. 20:22 skrev Walter Sklenka <<a href="mailto:Walter.Sklenka@edv-design.at">Walter.Sklenka@edv-design.at</a>>:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)">
<div lang="DE-AT" link="blue" vlink="purple" style="overflow-wrap: break-word;">
<div class="m_-7112034804007769686WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi Jan-Frode!<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">We did the “switch” with mmvdisk rg change –rg
</span><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">ess3500_ess_n1_hs_ess_n2_hs –active ess-n2-hs “<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Both nodes were up and we did not see any anomalies. And the rg was successfully created with the log groups
<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Maybe the method to switch the rg (with –active) is a bad idea? (because manuals says:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><a href="https://www.ibm.com/docs/en/ess/6.1.6_lts?topic=command-mmvdisk-recoverygroup" target="_blank">https://www.ibm.com/docs/en/ess/6.1.6_lts?topic=command-mmvdisk-recoverygroup</a><u></u><u></u></span></p>
<p class="MsoNormal"><i><span lang="EN-US">For a shared recovery group, the <strong>
<span style="font-family:Calibri,sans-serif">mmvdisk recoverygroup change --active
</span></strong></span></i><em><b><span lang="EN-US" style="font-family:Calibri,sans-serif;font-style:normal">Node</span></b></em><i><span lang="EN-US"> command means to make the specified node the server for all four user log groups and the root log group.
The specified node therefore temporarily becomes the sole active server for the entire shared recovery group, leaving the other server idle. This should only be done in unusual maintenance situations, since it is normally considered an error condition for
one of the servers of a shared recovery group to be idle. If the keyword <strong>
<span style="font-family:Calibri,sans-serif">DEFAULT</span></strong> is used instead of a server name, it restores the normal default balance of log groups, making each of the two servers responsible for two user log groups.</span></i><i><span lang="EN-US"><u></u><u></u></span></i></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><br>
this was the state before we tried to restart , no log are seen, we got “unable to reset server list”</span><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"><u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">~]$ sudo mmvdisk server list --rg ess3500_ess_n1_hs_ess_n2_hs<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"><u style="font-family:"Courier New""></u> <u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"><u style="font-family:"Courier New""></u> <u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">node
<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">number server active remarks<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">------ -------------------------------- ------- -------<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"> 98 ess-n1-hs yes configured<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"> 99 ess-n2-hs yes configured<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"><u style="font-family:"Courier New""></u> <u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"><u style="font-family:"Courier New""></u> <u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">~]$ sudo mmvdisk recoverygroup list --rg ess3500_ess_n1_hs_ess_n2_hs
<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"><u style="font-family:"Courier New""></u> <u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"><u style="font-family:"Courier New""></u> <u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"> needs user
<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">recovery group node class active current or master server
service vdisks remarks<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">----------------------------------- ---------- ------- -------------------------------- ------- ------ -------<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">ess3500_ess_n1_hs_ess_n2_hs ess3500_mmvdisk_ess_n1_hs_ess_n2_hs no - unknown
0 <u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"><u style="font-family:"Courier New""></u> <u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)"><u style="font-family:"Courier New""></u> <u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">~]$ ^C<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">~]$ sudo mmvdisk rg change --rg ess3500_ess_n1_hs_ess_n2_hs --restart<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">mmvdisk:
<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">mmvdisk:
<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">mmvdisk: Unable to reset server list for recovery group 'ess3500_ess_n1_hs_ess_n2_hs'.<u style="font-family:"Courier New""></u><u style="font-family:"Courier New""></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">mmvdisk: Command failed. Examine previous error messages to determine cause.</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Well, in the logs we did not find anything<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">And finally we had to delete the rg , because we urgently needed new space<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">With the new one we tested again and we did mmshutdown -startup , and also with --active flag, and all went ok. And now we have data on the rg<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">But we are in concern that this might happen sometimes again and we might not be able to reenable the rg leading to a disaster
<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">So if you have any idea I would appreciate very much
</span><span lang="EN-US" style="font-family:"Segoe UI Emoji",sans-serif">😊</span><span lang="EN-US"><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10pt;font-family:Arial,sans-serif;color:black">Best regards</span></p></div></div><div lang="DE-AT" link="blue" vlink="purple" style="overflow-wrap: break-word;"><div class="m_-7112034804007769686WordSection1"><p class="MsoNormal"><span lang="EN-US" style="font-size:10pt;font-family:Arial,sans-serif;color:black"><u style="font-family:Arial,sans-serif"></u><u style="font-family:Arial,sans-serif"></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Walter
<u></u><u></u></span></p>
<div style="border-width:1pt medium medium;border-style:solid none none;padding:3pt 0cm 0cm;border-color:rgb(225,225,225) currentcolor currentcolor">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> gpfsug-discuss <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org" target="_blank">gpfsug-discuss-bounces@gpfsug.org</a>>
<b>On Behalf Of </b>Jan-Frode Myklebust<br>
<b>Sent:</b> Donnerstag, 24. August 2023 14:51<br>
<b>To:</b> gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org" target="_blank">gpfsug-discuss@gpfsug.org</a>><br>
<b>Subject:</b> Re: [gpfsug-discuss] FW: ESS 3500-C5 : rg has resigned permanently<u></u><u></u></span></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">It does sound like "mmvdisk rg change --restart" is the "varyon" command you're looking for.. but it's not clear why it's failing. I would start by looking at if there are any lower level issues with your cluster. Are your nodes healthy
on a GPFS-level? "mmnetverify -N all" says network is OK ? "mmhealth node show -N all" not indicating any issues ? Check mmfs.log.latest ?<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Thu, Aug 24, 2023 at 1:41 PM Walter Sklenka <<a href="mailto:Walter.Sklenka@edv-design.at" target="_blank">Walter.Sklenka@edv-design.at</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-width:medium medium medium 1pt;border-style:none none none solid;padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm;border-color:currentcolor currentcolor currentcolor rgb(204,204,204)">
<div>
<div>
<div>
<p class="MsoNormal" style="margin-left:11.55pt">
<u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Hi !</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Does someone eventually have experience with ESS 3500 ( no hybrid config, only NLSAS with 5 enclosures )
</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">We have issues with a shared recoverygroup. After creating it we made a test of setting only one node active (mybe not an optimal idea)</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">But since then the recoverygroup is down</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">We have created a PMR but do not get any response until now.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">The rg has no vdisks of any filesystem
</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">[gpfsadmin@hgess02-m ~]$ ^C</span><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;color:rgb(22,22,22)"><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">[gpfsadmin@hgess02-m ~]$ sudo mmvdisk rg change --rg ess3500_hgess02_n1_hs_hgess02_n2_hs --restart</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">mmvdisk: </span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">mmvdisk: </span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">mmvdisk: Unable to reset server list for recovery group 'ess3500_hgess02_n1_hs_hgess02_n2_hs'.</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">mmvdisk: Command failed. </span></span><span style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">Examine previous error messages to determine cause.</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">We also tried
</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;background:repeat rgb(243,242,242);color:rgb(22,22,22)">2023-08-21_16:57:26.174+0200: [I] Command: tsrecgroupserver
ess3500_hgess02_n1_hs_hgess02_n2_hs -f -l root hgess02-n2-hs.invalid</span><span lang="EN-US" style="font-size:9pt;font-family:"Courier New";letter-spacing:0.1pt;color:rgb(22,22,22)"><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">2023-08-21_16:57:26.201+0200: [I] Recovery group ess3500_hgess02_n1_hs_hgess02_n2_hs has resigned permanently</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">2023-08-21_16:57:26.201+0200: [E] Command: err 2: tsrecgroupserver ess3500_hgess02_n1_hs_hgess02_n2_hs -f -l root hgess02-n2-hs.invalid</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">2023-08-21_16:57:26.201+0200: Specified entity, such as a disk or file system, does not exist.</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">2023-08-21_16:57:26.207+0200: [I] Command: tsrecgroupserver ess3500_hgess02_n1_hs_hgess02_n2_hs -f -l LG001 hgess02-n2-hs.invalid.</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">2023-08-21_16:57:26.207+0200: [E] Command: err 212: tsrecgroupserver ess3500_hgess02_n1_hs_hgess02_n2_hs -f -l LG001 hgess02-n2-hs.invalid</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">2023-08-21_16:57:26.207+0200: The current file system manager failed and no new manager will be appointed. This may cause nodes mounting the file system to experience mount failures.</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">2023-08-21_16:57:26.213+0200: [I] Command: tsrecgroupserver ess3500_hgess02_n1_hs_hgess02_n2_hs -f -l LG002 hgess02-n2-hs.invalid</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">2023-08-21_16:57:26.213+0200: [E] Command: err 212: tsrecgroupserver ess3500_hgess02_n1_hs_hgess02_n2_hs -f -l LG002 hgess02-n2-hs.invalid</span><br>
<span style="background:repeat rgb(243,242,242);font-family:"Courier New"">2023-08-21_16:57:26.213+0200: The current file system manager failed and no new manager will be appointed. This may cause nodes mounting the file system to experience mount failures.</span></span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">For us it is crucial to know what we can do if theis happens again ( it has no vdisks yet so it is not critical ).</span><span lang="EN-US" style="font-size:12pt;font-family:"IBM Plex Sans",sans-serif;border:1pt windowtext;padding:0cm;background:repeat white;color:rgb(22,22,22)">
</span><span lang="EN-US" style="font-size:12pt;font-family:"IBM Plex Sans",sans-serif;border:1pt windowtext;padding:0cm;background:repeat white;color:black"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Do you know: is there a non documented way to “vary on”, or activate a recoverygroup again?</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">The doc :</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"><a href="https://www.ibm.com/docs/en/ess/6.1.6_lts?topic=rgi-recovery-group-issues-shared-recovery-groups-in-ess" target="_blank">https://www.ibm.com/docs/en/ess/6.1.6_lts?topic=rgi-recovery-group-issues-shared-recovery-groups-in-ess</a></span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">tells to mmshutdown and mmstartup, but the RGCM does say nothing</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">When trying to execute any vdisk command it only says “rg down”, no idea how we could recover from that without deleting the rg ( I hope it will never happen,
when we have vdisks on it</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Have a nice day</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US">Walter
</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:10pt;font-family:Arial,sans-serif;color:black">Mit freundlichen Grüßen<br>
<b style="font-family:Arial,sans-serif"><i style="font-family:Arial,sans-serif">Walter Sklenka</i></b><br>
</span><b><i><span style="font-size:8pt;font-family:Arial,sans-serif;color:gray">Technical Consultant</span></i></b><span style="color:black">
</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:black"> </span><u></u><u></u></p>
<p class="MsoNormal" style="margin-bottom:12pt"><span style="font-size:8pt;font-family:Arial,sans-serif;color:black">EDV-Design Informationstechnologie GmbH<br>
<a href="https://www.google.com/maps/search/Giefinggasse+6?entry=gmail&source=g" style="font-family:Arial,sans-serif">Giefinggasse 6</a>/1/2, A-1210 Wien<br>
Tel: +43 1 29 22 165-31<br>
Fax: +43 1 29 22 165-90<br>
E-Mail: </span><a href="mailto:sklenka@edv-design.at" target="_blank"><span style="font-size:8pt;font-family:Arial,sans-serif">sklenka@edv-design.at</span></a><span style="font-size:8pt;color:black"><br>
</span><span style="font-size:8pt;font-family:Arial,sans-serif;color:black">Internet:
</span><a href="http://www.edv-design.at/" target="_blank"><span style="font-size:8pt;font-family:Arial,sans-serif">www.edv-design.at</span></a><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://gpfsug.org" target="_blank">gpfsug.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a><u></u><u></u></p>
</div>
</blockquote>
</div>
</div>
</div>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://gpfsug.org" rel="noreferrer" target="_blank">gpfsug.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a><br>
</blockquote></div></div>