<html><body><p><font size="2">Razvan,</font><br><br><font size="2">You are right, the command below yields to an error (as it interprets fs9:fset7 as a user name). Apologies for the confusion.<br></font><br><font size="2">This is what I see in my system:</font><br><font size="2"><br></font><font face="Menlo-Regular"># mmedquota -d -u pfs004 fs9:fset7</font><br><font face="Menlo-Regular">fs1 USR default quota is off</font><br><b><font face="Menlo-Regular">fs9:fset7 is not valid user</font></b><br><font size="2"># <br></font><br><font size="2">I must have confused the command names in the previous note. Instead of "mmedquota -d" command I meant "mmlsquota -d" (??)</font><br><br>
<ul><font face="Menlo-Regular"># mmlsquota -d fs9:fset7</font><br><font face="Menlo-Regular"> Default Block Limits(KB) | Default File Limits</font><br><font face="Menlo-Regular">Filesystem Fileset type quota limit | quota limit entryType</font><br><font face="Menlo-Regular">fs9 fset7 USR 102400 1048576 | 10000 0 default on</font><br><font face="Menlo-Regular">fs9 fset7 GRP 0 0 | 0 0 i </font><br><font face="Menlo-Regular"># mmlsquota -d fs9:fset9</font><br><font face="Menlo-Regular"> Default Block Limits(KB) | Default File Limits</font><br><font face="Menlo-Regular">Filesystem Fileset type quota limit | quota limit entryType</font><br><font face="Menlo-Regular">fs9 fset9 USR 102400 1048576 | 10000 22222 default on</font><br><font face="Menlo-Regular">fs9 fset9 GRP 0 0 | 0 0 default off</font><br><font face="Menlo-Regular">#mmlsquota -d -u fs9</font><br><font face="Menlo-Regular"> Default Block Limits(KB) | Default File Limits</font><br><font face="Menlo-Regular">Filesystem type quota limit | quota limit Remarks</font><br><font face="Menlo-Regular">fs9 USR 102400 1048576 | 10000 0 </font><br><font face="Menlo-Regular"># </font></ul><br><font size="2">Upon further investigation, the current behavior of 'mmedquota -d -u <username>' is restore the default quotas for the particular user on all filesystems and filesets. The ability to restore the default limits of a user for selected filesets and filesystems is not available at the moment.</font><br><br><font size="2">Kuei</font><br><font size="2"><br>------------------------------------<br>Kuei-Yu Wang-Knop <br>IBM Scalable I/O development<br>(845) 433-9333 T/L 293-9333, E-mail: kywang@us.ibm.com<br></font><br><br><img width="16" height="16" src="cid:1__=8FBB0E7BDFF4A05E8f9e8a93df938690918c8FB@" border="0" alt="Inactive hide details for "Popescu, Razvan" ---01/07/2020 12:23:47 PM---Kuei, Thanks for replying. I did open a ticket before"><font size="2" color="#424282">"Popescu, Razvan" ---01/07/2020 12:23:47 PM---Kuei, Thanks for replying. I did open a ticket before the holidays, but it didn’t yield a solution</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">"Popescu, Razvan" <rp2927@gsb.columbia.edu></font><br><font size="2" color="#5F5F5F">To: </font><font size="2">Kuei-Yu Wang-Knop <kywang@us.ibm.com>, gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">01/07/2020 12:23 PM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">[EXTERNAL] Re: [gpfsug-discuss] Quota: revert user quota to FILESET default</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><font face="Calibri">Kuei,</font><br><font face="Calibri"> </font><br><font face="Calibri">Thanks for replying. I did open a ticket before the holidays, but it didn’t yield a solution. I just opened another one… </font><br><font face="Calibri"> </font><br><font face="Calibri">My very specific question to you is: “Where have you seen this particular syntax work?” The 5.0.3 & 5.0.4 mmedquota man pages do not mention the availability of a filesystem:fileset parameter (as in your example: “fs9:fset7”) and my testing rejected such a parameter. What made you think this would work? </font><font face="Apple Color Emoji">?</font><font face="Calibri"> </font><br><font face="Calibri"> </font><br><b><font face="Courier New"># mmedquota -d -u pfs004 </font></b><b><u><font size="4" face="Courier New">fs9:fset7</font></u></b><br><font face="Calibri"> ^^^^^^^^^^^^^</font><br><font face="Calibri"> </font><br><font face="Calibri">Many thanks!</font><br><font face="Calibri">Razvan</font><br><font face="Calibri"> </font><br><font face="Calibri">-- </font><br><font face="Calibri"> </font><br><font face="Calibri"> </font><br><b><font face="Calibri">From: </font></b><font face="Calibri">Kuei-Yu Wang-Knop <kywang@us.ibm.com></font><b><font face="Calibri"><br>Date: </font></b><font face="Calibri">Tuesday, January 7, 2020 at 12:11 PM</font><b><font face="Calibri"><br>To: </font></b><font face="Calibri">"Popescu, Razvan" <rp2927@gsb.columbia.edu>, gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><b><font face="Calibri"><br>Subject: </font></b><font face="Calibri">RE: [gpfsug-discuss] Quota: revert user quota to FILESET default</font><br><font face="Calibri"> </font><p><font size="2">Razvan,</font><br><font size="2"><br>Perhaps you should open a ticket (so that specific configuration data could be collected and analyzed) on this topic. We would look at your system configuration, the code level to figure out whether what you are seeing is a problem or it is just an expected behavior or a limitation; there are some limitations, specifically moving default limits between file system and fileset default scope, that may not work for your scenario.<br><br>Thanks,</font><br><font size="2"><br>Kuei<br>------------------------------------<br>Kuei-Yu Wang-Knop <br>IBM Scalable I/O development<br>(845) 433-9333 T/L 293-9333, E-mail: kywang@us.ibm.com</font><br><br><br><img src="cid:2__=8FBB0E7BDFF4A05E8f9e8a93df938690918c8FB@" width="16" height="16" alt="Inactive hide details for "Popescu, Razvan" ---01/07/2020 11:32:42 AM---Hi Kuei-Yu (et al.) Happy New Year!"><font size="2" color="#424282">"Popescu, Razvan" ---01/07/2020 11:32:42 AM---Hi Kuei-Yu (et al.) Happy New Year!</font><br><font size="2" color="#5F5F5F"><br>From: </font><font size="2">"Popescu, Razvan" <rp2927@gsb.columbia.edu></font><font size="2" color="#5F5F5F"><br>To: </font><font size="2">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><font size="2" color="#5F5F5F"><br>Date: </font><font size="2">01/07/2020 11:32 AM</font><font size="2" color="#5F5F5F"><br>Subject: </font><font size="2">[EXTERNAL] Re: [gpfsug-discuss] Quota: revert user quota to FILESET default</font><font size="2" color="#5F5F5F"><br>Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade><br><font face="Calibri"><br><br><br>Hi Kuei-Yu (et al.)<br><br>Happy New Year!<br><br>I’d like to reiterate my follow-up question to your comments – in particular to the line copied below, which mentions a behavior that I’m seeking for this command, but cannot reproduce (in vers, 5.0.3@Linux), namely (with my highlights):<br></font><b><font face="Courier New"><br># mmedquota -d -u pfs004 </font></b><b><u><font size="4" face="Courier New">fs9:fset7</font></u></b><b><font face="Courier New"> <=== run mmedquota -d -u to get default limits</font></b><font face="Calibri"><br><br>The reduction of scope to a named filesystem/fileset is what I’m seeking, *</font><b><font face="Calibri">but</font></b><font face="Calibri">* at least the 5.0.3 version seems to reject that parameter with an error, and apply the user’s default restoration to *</font><b><font face="Calibri">all filesystems and filesets</font></b><font face="Calibri">*<br>Are you using a different version? Or a different implementations? I’m running SS 5.0.3 on Linux x64. <br><br>I apologize for having to press this point, but this matter is of a certain importance to us and it appears that the public documentation is mum in this regard. Furthermore, the IBM support, at the first pass, was quite confused and unfocused. (I’m trying with a new case now, but my hopes are low). You seem to be an IBM insider, so …. I count on your help </font><font face="Apple Color Emoji">?</font><font face="Calibri">. Sorry, for the insistence. </font><font face="Apple Color Emoji">?</font><font face="Calibri"><br><br>Best,<br><br>Razvan Popescu<br><br>Columbia Univ.<br><br>-- <br><br></font><b><font face="Calibri"><br>From: </font></b><font face="Calibri"><gpfsug-discuss-bounces@spectrumscale.org> on behalf of Kuei-Yu Wang-Knop <kywang@us.ibm.com></font><b><font face="Calibri"><br>Reply-To: </font></b><font face="Calibri">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><b><font face="Calibri"><br>Date: </font></b><font face="Calibri">Thursday, December 19, 2019 at 3:56 PM</font><b><font face="Calibri"><br>To: </font></b><font face="Calibri">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><b><font face="Calibri"><br>Subject: </font></b><font face="Calibri">Re: [gpfsug-discuss] Quota: revert user quota to FILESET default</font><p>Razvan<font size="2">,<br><br>mmedquota -d -u fs:fset:</font><br><br>-d
<ul><ul><ul><ul><ul><ul><ul><ul><font face="Calibri">Reestablish default quota limits for a specific user, group, or fileset that had an explicit quota limit set by a previous invocation of the mmedquota command.</font></ul></ul></ul></ul></ul></ul></ul></ul><font size="2" face="Calibri">This option will assign the default quota to the user. The quota entry type will change from "e" to "d_fset". You may need to play a little bit with your system to get the result as you can have default quota per file system set and default quota per fileset enabled.<br><br>An exemple to illustrate</font><font size="2" color="#2F2F2F" face="Courier New"><br><br>User pfs004 in filesystem fs9 and fileset fset7 has explicit quota set:<br><br># mmrepquota -u -v fs9 | grep pfs004<br>pfs004 fset7 USR 1088 102400 1048576 0 none | 13 10000 </font><b><font size="2" color="#2F2F2F" face="Courier New">33333</font></b><font size="2" color="#2F2F2F" face="Courier New"> 0 none </font><b><font size="2" color="#2F2F2F" face="Courier New">e <=== explicit</font></b><font face="Calibri"><br></font><font size="2" color="#2F2F2F" face="Courier New"><br><br># mmlsquota -d fs9:fset7<br>Default Block Limits(KB) | Default File Limits<br>Filesystem Fileset type quota limit | quota limit entryType</font><b><font size="2" color="#2F2F2F" face="Courier New"><br>fs9 fset7 USR 102400 1048576 | 10000 0 default on <=== default quota limits for fs9:fset7, the default</font></b><font size="2" color="#2F2F2F" face="Courier New"><br>fs9 fset7 GRP 0 0 | 0 0 i</font><font face="Calibri"><br></font><font size="2" color="#2F2F2F" face="Courier New"><br><br># mmlsquota -u pfs004 fs9:fset7<br>Block Limits | File Limits<br>Filesystem Fileset type KB quota limit in_doubt grace | files quota limit in_doubt grace Remarks<br>fs9 fset7 USR 1088 102400 1048576 0 none | 13 10000 </font><b><font size="2" color="#2F2F2F" face="Courier New">33333</font></b><font size="2" color="#2F2F2F" face="Courier New"> 0 none </font><b><font size="2" color="#2F2F2F" face="Courier New"><=== explicit </font></b><b><u><font size="5" face="Courier New"><br><br># mmedquota -d -u pfs004 fs9:fset7 <=== run mmedquota -d -u to get default limits</font></u></b><font size="2" color="#2F2F2F" face="Courier New"><br><br># mmlsquota -u pfs004 fs9:fset7<br>Block Limits | File Limits<br>Filesystem Fileset type KB quota limit in_doubt grace | files quota limit in_doubt grace Remarks<br>fs9 fset7 USR 1088 102400 1048576 0 none | 13 </font><b><font size="2" color="#2F2F2F" face="Courier New">10000 0 </font></b><font size="2" color="#2F2F2F" face="Courier New">0 none </font><b><font size="2" color="#2F2F2F" face="Courier New"><=== takes the default value</font></b><font face="Calibri"><br></font><font size="2" color="#2F2F2F" face="Courier New"><br><br># mmrepquota -u -v fs9:fset7 | grep pfs004<br>pfs004 fset7 USR 1088 102400 1048576 0 none | 13 </font><b><font size="2" color="#2F2F2F" face="Courier New">10000 0 </font></b><font size="2" color="#2F2F2F" face="Courier New">0 none d_fset </font><b><font size="2" color="#2F2F2F" face="Courier New"><=== now user pfs004 in fset7 takes the default limits</font></b><font size="2" color="#2F2F2F" face="Courier New"><br>#</font><font size="2" face="Calibri"><br><br><br>------------------------------------<br>Kuei-Yu Wang-Knop <br>IBM Scalable I/O development<br>(845) 433-9333 T/L 293-9333, E-mail: kywang@us.ibm.com</font><font face="Calibri"><br><br><br></font><img src="cid:3__=8FBB0E7BDFF4A05E8f9e8a93df938690918c8FB@" width="16" height="16" alt="Inactive hide details for "Popescu, Razvan" ---12/19/2019 02:28:51 PM---I see. May I ask one follow-up question, please: what"><font size="2" color="#424282" face="Calibri">"Popescu, Razvan" ---12/19/2019 02:28:51 PM---I see. May I ask one follow-up question, please: what is “mmedquota -d -u <username>” supposed</font><font size="2" color="#5F5F5F" face="Calibri"><br><br>From: </font><font size="2" face="Calibri">"Popescu, Razvan" <rp2927@gsb.columbia.edu></font><font size="2" color="#5F5F5F" face="Calibri"><br>To: </font><font size="2" face="Calibri">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><font size="2" color="#5F5F5F" face="Calibri"><br>Date: </font><font size="2" face="Calibri">12/19/2019 02:28 PM</font><font size="2" color="#5F5F5F" face="Calibri"><br>Subject: </font><font size="2" face="Calibri">[EXTERNAL] Re: [gpfsug-discuss] Quota: revert user quota to FILESET default</font><font size="2" color="#5F5F5F" face="Calibri"><br>Sent by: </font><font size="2" face="Calibri">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade><br><font face="Calibri"><br><br><br><br>I see. <br><br>May I ask one follow-up question, please: what is “mmedquota -d -u <username>” supposed to do in this case?<br><br>Really appreciate your assistance.<br><br>Razvan<br><br>-- <br></font><b><font face="Calibri"><br><br>From: </font></b><font face="Calibri"><gpfsug-discuss-bounces@spectrumscale.org> on behalf of Kuei-Yu Wang-Knop <kywang@us.ibm.com></font><b><font face="Calibri"><br>Reply-To: </font></b><font face="Calibri">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><b><font face="Calibri"><br>Date: </font></b><font face="Calibri">Thursday, December 19, 2019 at 2:25 PM</font><b><font face="Calibri"><br>To: </font></b><font face="Calibri">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><b><font face="Calibri"><br>Subject: </font></b><font face="Calibri">Re: [gpfsug-discuss] Quota: revert user quota to FILESET default </font><p>>> To make it more technical …. This fellow’s quota entryType is now “e” . I want to change it back to entryType “I”. (I hope I’m not talking nonsense here)<font size="2"><br><br>Currently there is no function to revert an explicit quota entry (e) to initial (i) entry.<br><br>Kuei<br>------------------------------------<br>Kuei-Yu Wang-Knop <br>IBM Scalable I/O development<br>(845) 433-9333 T/L 293-9333, E-mail: kywang@us.ibm.com</font><br><br><br><img src="cid:4__=8FBB0E7BDFF4A05E8f9e8a93df938690918c8FB@" width="16" height="16" alt="Inactive hide details for "Popescu, Razvan" ---12/19/2019 02:18:54 PM---Thanks for your kind reply. My problem is different tho"><font size="2" color="#424282">"Popescu, Razvan" ---12/19/2019 02:18:54 PM---Thanks for your kind reply. My problem is different though.</font><font size="2" color="#5F5F5F"><br><br>From: </font><font size="2">"Popescu, Razvan" <rp2927@gsb.columbia.edu></font><font size="2" color="#5F5F5F"><br>To: </font><font size="2">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><font size="2" color="#5F5F5F"><br>Date: </font><font size="2">12/19/2019 02:18 PM</font><font size="2" color="#5F5F5F"><br>Subject: </font><font size="2">[EXTERNAL] Re: [gpfsug-discuss] Quota: revert user quota to FILESET default</font><font size="2" color="#5F5F5F"><br>Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade><br><font face="Calibri"><br><br><br><br><br>Thanks for your kind reply.<br><br>My problem is different though. <br><br>I have set a fileset default quota (doing all the steps you recommended) and all was Ok. During operations I have edited *</font><b><font face="Calibri">individual</font></b><font face="Calibri">* quotas, for example to increase certain user’s allocations. <br><br>Now, I want to *</font><b><font face="Calibri">revert</font></b><font face="Calibri">* (change back) one of these users to the (fileset) default quota ! <br><br>For example, I have used one user account to test the mmedquota command setting his limits to a certain value (just testing). I’d like now to make that user’s quota be the default fileset quota, and not just numerically, but have his quota record follow the changes in fileset default quota limits. <br><br>To make it more technical …. This fellow’s quota entryType is now “e” . I want to change it back to entryType “I”. (I hope I’m not talking nonsense here)<br><br>mmedquota’s “-d” option is supposed to reinstate the defaults, but it doesn’t seem to work for fileset based quotas … !?!<br><br>Razvan<br><br>-- </font><b><font face="Calibri"><br><br><br>From: </font></b><font face="Calibri"><gpfsug-discuss-bounces@spectrumscale.org> on behalf of Kuei-Yu Wang-Knop <kywang@us.ibm.com></font><b><font face="Calibri"><br>Reply-To: </font></b><font face="Calibri">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><b><font face="Calibri"><br>Date: </font></b><font face="Calibri">Thursday, December 19, 2019 at 2:06 PM</font><b><font face="Calibri"><br>To: </font></b><font face="Calibri">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><b><font face="Calibri"><br>Subject: </font></b><font face="Calibri">Re: [gpfsug-discuss] Quota: revert user quota to FILESET default </font><p><font size="2">It sounds like you would like to have default perfileset quota enabled. Have you tried to enable the default quota on the filesets and then set the default quota limits for those filesets?<br><br>For example, in a filesystem fs9 and fileset fset9. File system fs9 has default quota on and --perfileset-quota enabled.</font><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><b><font face="Courier-Bold"># mmlsfs fs9 -Q --perfileset-quota <br>flag value description<br>------------------- ------------------------ -----------------------------------<br>-Q user;group;fileset Quotas accounting enabled<br>user;fileset Quotas enforced<br>user;group;fileset Default quotas enabled<br>--perfileset-quota Yes Per-fileset quota enforcement<br><br>#</font></b></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul><font size="2" face="Calibri"><br><br>Enable default user quota for fileset fset9, if not enabled yet,<br><br>e.g. "mmdefquotaon -u fs9:fset9"<br><br>Then set the default quota for this fileset using mmdefedquota"</font><font face="Calibri"> </font><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><ul><font size="2" face="Courier New"># mmdefedquota -u fs9:fset9</font><font size="2" face="Calibri"><br><br>..</font><font size="2" face="Courier New"><br>*** Edit quota limits for USR DEFAULT entry for fileset fset9<br>NOTE: block limits will be rounded up to the next multiple of the block size.<br>block units may be: K, M, G, T or P, inode units may be: K, M or G.<br>fs9: blocks in use: 0K, limits (soft = 102400K, hard = 1048576K)<br>inodes in use: 0, limits (soft = 10000, hard = 22222)</font><font size="2" face="Calibri"><br><br>...</font></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul></ul><font size="2" face="Calibri"><br><br>Hope that this helps.<br><br><br>------------------------------------<br>Kuei-Yu Wang-Knop <br>IBM Scalable I/O development<br>(845) 433-9333 T/L 293-9333, E-mail: kywang@us.ibm.com</font><font face="Calibri"><br><br><br></font><img src="cid:5__=8FBB0E7BDFF4A05E8f9e8a93df938690918c8FB@" width="16" height="16" alt="Inactive hide details for "Popescu, Razvan" ---12/19/2019 12:22:34 PM---Hi, I’d like to revert a user’s quota to the fileset"><font size="2" color="#424282" face="Calibri">"Popescu, Razvan" ---12/19/2019 12:22:34 PM---Hi, I’d like to revert a user’s quota to the fileset’s default, but “mmedquota -d -u <username>”</font><font size="2" color="#5F5F5F" face="Calibri"><br><br>From: </font><font size="2" face="Calibri">"Popescu, Razvan" <rp2927@gsb.columbia.edu></font><font size="2" color="#5F5F5F" face="Calibri"><br>To: </font><font size="2" face="Calibri">"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org></font><font size="2" color="#5F5F5F" face="Calibri"><br>Date: </font><font size="2" face="Calibri">12/19/2019 12:22 PM</font><font size="2" color="#5F5F5F" face="Calibri"><br>Subject: </font><font size="2" face="Calibri">[EXTERNAL] [gpfsug-discuss] Quota: revert user quota to FILESET default</font><font size="2" color="#5F5F5F" face="Calibri"><br>Sent by: </font><font size="2" face="Calibri">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade><br><font face="Calibri"><br><br><br><br><br><br>Hi,<br><br>I’d like to </font><u><font face="Calibri">revert a user’s quota to the </font></u><b><u><font face="Calibri">fileset’s</font></u></b><u><font face="Calibri"> default</font></u><font face="Calibri">, but “mmedquota -d -u <username>” fails because I do have not set a filesystem default…. </font><font size="2" face="Calibri"><br>[root@xxx]# mmedquota -d -u user<br>gsb USR default quota is off</font><font face="Calibri"><br><br>(SpectrumScale 5.0.3 Standard Ed. on RHEL7 x86)<br><br>Is this a limitation of the current mmedquota implementation, or of something more profound?... <br><br>I have several filesets within this filesystem, each with various quota structures. A filesystem-wide default quota didn’t seem useful so I never defined one; however I do have multiple fileset-level default quotas, and this is the level at which I’d like to be able to handle this matter… Have I hit a limitation of the implementation? Any workaround, if that’s the case?<br><br>Many thanks, <br><br>Razvan Popescu<br>Columbia Business School</font><font size="2" face="Courier New"><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font><u><font color="#0000FF" face="Calibri"><br></font></u><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><u><font size="2" color="#0000FF" face="Courier New">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></u></a><font size="2" face="Courier New"> </font><font face="Calibri"><br></font><font size="2" face="Courier New"><br><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font><u><font color="#0000FF" face="Calibri"><br></font></u><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><u><font size="2" color="#0000FF" face="Courier New">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></u></a><font size="2" face="Courier New"> </font><font face="Calibri"><br><br></font><font size="2" face="Courier New"><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font><u><font color="#0000FF" face="Calibri"><br></font></u><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><u><font size="2" color="#0000FF" face="Courier New">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></u></a><font size="2" face="Courier New"> </font><font face="Calibri"><br><br><br></font><font size="2" face="Courier New"><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font><u><font size="2" color="#0000FF" face="Courier New"><br></font></u><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><u><font size="2" color="#0000FF" face="Courier New">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></u></a><font size="2" face="Courier New"> </font><font face="Calibri"><br><br><br><br></font><br><br><BR>
</body></html>