<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div dir="ltr" ><div>Thanks for your responses !</div>
<div> </div>
<div>I'll definitely explore the <font size="2" face="sans-serif" >enforceFilesetQuotaOnRoot option.</font></div></div>
<div dir="ltr" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial;font-size:10.5pt" ><div dir="ltr" style="margin-top: 20px;" ><div style="font-size: 12pt; font-weight: bold; font-family: sans-serif; color: #7C7C5F;" ><span style="font-family:lucida sans unicode,lucida grande,sans-serif;" ><span style="font-size: 0.714em;" >Best regards</span>,</span></div>
<div style="font-size: 12pt; font-weight: bold; font-family: sans-serif; color: #7C7C5F;" >__________________________________________________________________________________</div>
<div style="font-size: 12pt; font-weight: bold; font-family: sans-serif; color: #7C7C5F;" ><span style="font-size:0.857em;" ><span style="color: rgb(0, 0, 0);" >Emmanuel Barajas Gonzalez</span></span></div>
<div style="font-size: 12pt; font-weight: bold; font-family: sans-serif; color: #7C7C5F;" ><span style="color:#696969;" ><span style="font-size: 0.714em;" ><strong>Transparent Cloud Tiering for DS8000, Master Inventor</strong></span></span></div>
<div style="font-size: 12pt; font-weight: bold; font-family: sans-serif; color: #7C7C5F;" ><table width="658" border="0" height="88" > <tbody> <tr> <td>
<div style="font-size: 8pt; font-family: sans-serif; margin-top: 10px;" > <div><span style="font-weight: bold; color: #336699;" >Phone: </span>52-33-3669-7000 x5547</div>
<div><span style="font-weight: bold; color: #336699;" >E-mail: </span><a href="mailto:vanfalen@mx1.ibm.com" style="color: #555" >vanfalen@mx1.ibm.com</a></div>
<div><span style="font-weight: bold; color: #336699;" >Follow me: @van_falen</span></div> </div> </td> <td> <div style="text-align: right;" ><img alt="" src="data:image/gif;base64,R0lGODlhUwAeALMAAP///wCKvwCz7wA+abLc7H/E33/Z90yt0kzK9LLo+gAAAAAAAAAAAAAAAAAAAAAAACH5BAAAAAAALAAAAABTAB4AAAT/cMhJKwAi680zMlcIBGRpkmJ6rkEaVjB1dXRnJCJ7Ei5A6KaecEgsGo/IpHLJbKZi0FltugGNgCWe6IdF9aAxKXV86ZIKqYK55Wy73/C4XBkedlyGuwqIvqiBdDBEeiJ5GwguXSGKc42Oj5CRInVCYzY9XQcAB4xIlD2WVUIrfyWlZyuSqqusrV+CdqEZVok7Vyw+qUmfLrIatDm2gFxBrsbHyG+8KYQhhhqIeyZapwF9xCWBFrEbeM1ltuDZF9heyefo6RdgsL414ixaAKV9uYCv7BNi7r/wK/K3tmARUeAAQHWOCBRQWA9howMFCRzIJwMDPwE3gukAqKZhuRMhFQosFElRn0VfH2ptVJHiYzE/EAFEAAA7" ></div>
<div style="text-align: right;" ><span style="font-size:0.571em;" >2200 Camino A El Castillo<br> El Salto, JAL 45680<br> Mexico</span></div> </td> </tr> </tbody></table></div></div></div></div></div></div></div>
<div dir="ltr" > </div>
<div dir="ltr" > </div>
<blockquote dir="ltr" style="border-left:solid #aaaaaa 2px; margin-left:5px; padding-left:5px; direction:ltr; margin-right:0px" >----- Original message -----<br>From: "Tomer Perry" <TOMP@il.ibm.com><br>Sent by: gpfsug-discuss-bounces@spectrumscale.org<br>To: gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>Cc: gpfsug-discuss-bounces@spectrumscale.org<br>Subject: Re: [gpfsug-discuss] Fileset quotas enforcement<br>Date: Thu, Oct 26, 2017 4:10 AM<br> <br><font size="2" face="sans-serif" >And this behavior can be changed using the enforceFilesetQuotaOnRoot options ( check mmchconfig man page)</font><br><br><font size="2" face="sans-serif" >Regards,<br><br>Tomer Perry<br>Scalable I/O Development (Spectrum Scale)<br>email: tomp@il.ibm.com<br>1 Azrieli Center, Tel Aviv 67021, Israel<br>Global Tel: +1 720 3422758<br>Israel Tel: +972 3 9188625<br>Mobile: +972 52 2554625</font><br><br><br><br><br><font color="#5f5f5f" size="1" face="sans-serif" >From: </font><font size="1" face="sans-serif" >"Markus Rohwedder" <rohwedder@de.ibm.com></font><br><font color="#5f5f5f" size="1" face="sans-serif" >To: </font><font size="1" face="sans-serif" >gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><br><font color="#5f5f5f" size="1" face="sans-serif" >Cc: </font><font size="1" face="sans-serif" >gpfsug-discuss-bounces@spectrumscale.org</font><br><font color="#5f5f5f" size="1" face="sans-serif" >Date: </font><font size="1" face="sans-serif" >26/10/2017 10:18</font><br><font color="#5f5f5f" size="1" face="sans-serif" >Subject: </font><font size="1" face="sans-serif" >Re: [gpfsug-discuss] Fileset quotas enforcement</font><br><font color="#5f5f5f" size="1" face="sans-serif" >Sent by: </font><font size="1" face="sans-serif" >gpfsug-discuss-bounces@spectrumscale.org</font>
<hr noshade="noshade" ><br><br><br><font size="2" >Please also note that when you write as root, you are not restricted by the quota limits.</font><br><br><font size="2" >See example:</font><br><br><font size="2" face="Courier New" >Write as non root user and run into hard limit:<br>[mr@home-11 limited]$ dd if=/dev/urandom of=testfile2 bs=1000 count=100000<br>dd: error writing ‘testfile2’: Disk quota exceeded<br>29885+0 records in<br>29884+0 records out<br>29884000 bytes (30 MB) copied, 3.38491 s, 8.8 MB/s</font><br><br><font size="2" face="Courier New" >[root@home-11 limited]# mmrepquota gpfs0<br>Block Limits | File Limits<br>Name type KB quota limit in_doubt grace | files quota limit in_doubt grace<br>...<br>limited FILESET 322176 214784 322304 128 7 days | 5 0 0 0 none</font><br><br><font size="2" face="Courier New" >Now write as root user and exceed hard limit:<br>[root@home-11 limited]# dd if=/dev/urandom of=testfile2 bs=1000 count=100000<br>100000+0 records in<br>100000+0 records out<br>100000000 bytes (100 MB) copied, 12.8355 s, 7.8 MB/s</font><br><br><font size="2" face="Courier New" >[root@home-11 limited]# mmrepquota gpfs0<br>Block Limits | File Limits<br>Name type KB quota limit in_doubt grace | files quota limit in_doubt grace<br>...<br>limited FILESET 390656 214784 322304 8939520 7 days | 5 0 0 40 none</font><br><br><font size="1" face="Arial" >Mit freundlichen Grüßen / Kind regards</font><br><br><font size="1" face="Arial" ><b>Dr. Markus Rohwedder</b></font><br><br><font color="#0060a0" size="1" face="Arial" >Spectrum Scale GUI Development</font>
<table style="border-collapse:collapse;" width="497" > <tbody> <tr height="8" > <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="497" > <hr></td> </tr> <tr height="8" > <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="497" ><img src="cid:_1_E46716A4E467141C003256C7C22581C5" style="border:0px solid;" width="1" align="bottom" height="1" ></td> </tr> <tr height="8" > <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="36" ><font color="#0060a0" size="1" face="Arial" >Phone:</font></td> <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="160" ><font color="#0060a0" size="1" face="Arial" >+49 7034 6430190</font></td> <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="214" ><font color="#0060a0" size="1" face="Arial" >IBM Deutschland</font></td> <td rowspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="87" > <div align="right" ><img src="cid:_1_E4642530E4641FB0003256C7C22581C5" style="border:0px solid;" align="bottom" ></div> </td> </tr> <tr height="8" > <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="36" ><font color="#0060a0" size="1" face="Arial" >E-Mail:</font></td> <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="160" ><font color="#0060a0" size="1" face="Arial" >rohwedder@de.ibm.com</font></td> <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="214" ><font color="#0060a0" size="1" face="Arial" >Am Weiher 24</font></td> </tr> <tr height="8" > <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="36" ><img src="cid:_1_E463FD50E463FAF8003256C7C22581C5" style="border:0px solid;" width="1" align="bottom" height="1" ></td> <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="160" ><img src="cid:_1_E46402D0E4640078003256C7C22581C5" style="border:0px solid;" width="1" align="bottom" height="1" ></td> <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="214" ><font color="#0060a0" size="1" face="Arial" >65451 Kelsterbach</font></td> </tr> <tr height="8" > <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="36" ><img src="cid:_1_E4641128E4640ED0003256C7C22581C5" style="border:0px solid;" width="1" align="bottom" height="1" ></td> <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="160" ><img src="cid:_1_E46416A8E4641450003256C7C22581C5" style="border:0px solid;" width="1" align="bottom" height="1" ></td> <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="214" ><font color="#0060a0" size="1" face="Arial" >Germany</font></td> </tr> <tr height="8" > <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="497" > <hr></td> </tr> <tr height="8" > <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="497" ><img src="cid:_1_E4644278E4643FF0003256C7C22581C5" style="border:0px solid;" width="1" align="bottom" height="1" ></td> </tr> <tr height="8" > <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="497" ><font color="#a2a2a2" size="1" face="Arial" >IBM Deutschland Research & Development GmbH / Vorsitzender des Aufsichtsrats: Martina Köderitz<br> Geschäftsführung: Dirk Wittkopp<br> Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, HRB 243294 </font></td> </tr> </tbody></table><br><br><br><img alt="Inactive hide details for "Jaime Pinto" ---10/26/2017 12:18:45 AM---Did you try to run mmcheckquota on the device I observed th" src="cid:_1_E460E9D8E466F160003256C7C22581C5" style="border:0px solid;" ><font color="#424282" size="2" >"Jaime Pinto" ---10/26/2017 12:18:45 AM---Did you try to run mmcheckquota on the device I observed that in the most recent versions (for the l</font><br><br><font color="#5f5f5f" size="2" >From: </font><font size="2" >"Jaime Pinto" <pinto@scinet.utoronto.ca></font><br><font color="#5f5f5f" size="2" >To: </font><font size="2" >"gpfsug main discussion list" <gpfsug-discuss@spectrumscale.org>, "Emmanuel Barajas Gonzalez" <vanfalen@mx1.ibm.com></font><br><font color="#5f5f5f" size="2" >Cc: </font><font size="2" >gpfsug-discuss@spectrumscale.org</font><br><font color="#5f5f5f" size="2" >Date: </font><font size="2" >10/26/2017 12:18 AM</font><br><font color="#5f5f5f" size="2" >Subject: </font><font size="2" >Re: [gpfsug-discuss] Fileset quotas enforcement</font><br><font color="#5f5f5f" size="2" >Sent by: </font><font size="2" >gpfsug-discuss-bounces@spectrumscale.org</font>
<hr noshade="noshade" ><br><br><br><tt><font size="3" face="" >Did you try to run mmcheckquota on the device<br><br>I observed that in the most recent versions (for the last 3 years) <br>there is a real long lag for GPFS to process the internal accounting. <br>So there is a slippage effects that skews quota operations. <br>mmcheckquota is supposed to reset and zero all those cumulative deltas <br>effective immediately.<br><br>Jaime<br><br>Quoting "Emmanuel Barajas Gonzalez" <vanfalen@mx1.ibm.com>:<br><br>> Hello spectrum scale team! I'm working on the implementation of<br>> quotas per fileset and I followed the basic instructions described in<br>> the documentation. Currently the gpfs device has per-fileset quotas<br>> and there is one fileset with a block soft and a hard limit set. My<br>> problem is that I'm being able to write more and more files beyond<br>> the quota (the grace period has expired as well). How can I make<br>> sure quotas will be enforced and that no user will be able to consume<br>> more space than specified? mmrepquota smfslv0<br>> Block Limits<br>> |<br>> Name fileset type KB quota limit<br>> in_doubt grace |<br>> root root USR 512 0 0<br>> 0 none |<br>> root cp1 USR 64128 0 0<br>> 0 none |<br>> system root GRP 512 0 0<br>> 0 none |<br>> system cp1 GRP 64128 0 0<br>> 0 none |<br>> valid root GRP 0 0 0<br>> 0 none |<br>> root root FILESET 512 0 0<br>> 0 none |<br>> cp1 root FILESET 64128 2048 2048<br>> 0 expired |<br>> Thanks in advance ! Best regards,<br>> __________________________________________________________________________________<br>> Emmanuel Barajas Gonzalez TRANSPARENT CLOUD TIERING FOR DS8000<br>><br>> Phone:<br>> 52-33-3669-7000 x5547 E-mail: vanfalen@mx1.ibm.com[1] Follow me:<br>> @van_falen<br>> 2200 Camino A El Castillo<br>> El Salto, JAL 45680<br>> Mexico<br>><br>><br>><br>><br>> Links:<br>> ------<br>> [1] </font></tt><a href="mailto:vanfalen@mx1.ibm.com" target="_blank" ><tt><font color="blue" size="3" face="" ><u>mailto:vanfalen@mx1.ibm.com</u></font></tt></a><br><tt><font size="3" face="" >><br><br><br><br><br><br><br> ************************************<br> TELL US ABOUT YOUR SUCCESS STORIES<br> </font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.scinethpc.ca_testimonials&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=mno73q7nVmqF-YTzo7pAF50B_45epo6ZzccTAwcroRU&e=" target="_blank" ><tt><font color="blue" size="3" face="" ><u>https://urldefense.proofpoint.com/v2/url?u=http-3A__www.scinethpc.ca_testimonials&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=mno73q7nVmqF-YTzo7pAF50B_45epo6ZzccTAwcroRU&e=</u></font></tt></a><br><tt><font size="3" face="" > ************************************<br>---<br>Jaime Pinto<br>SciNet HPC Consortium - Compute/Calcul Canada</font></tt><br><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.scinet.utoronto.ca&d=DwMFAw&c=jf_iaSHvJObTbx-siA1ZOg&r=QdLRrh1E-8uEEGHaHPZ-qGdFYqX7AZzpmPLhBd-5oGQ&m=-FY_B7uDnSKqmEonUMZBIOQQlYi-86TjHpkpo-NzbWk&s=v0aZYMJN86RJEStrDwoANrTUvVg0RyO4ITlWAP-l2ik&e=" target="_blank" ><tt><font size="3" face="" >www.scinet.utoronto.ca</font></tt></a><tt><font size="3" face="" >- </font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.computecanada.ca&d=DwMFAw&c=jf_iaSHvJObTbx-siA1ZOg&r=QdLRrh1E-8uEEGHaHPZ-qGdFYqX7AZzpmPLhBd-5oGQ&m=-FY_B7uDnSKqmEonUMZBIOQQlYi-86TjHpkpo-NzbWk&s=Edoz4EYvjYFSJjNYiCQ395qidEzAa3Kmy5hijDJBXno&e=" target="_blank" ><tt><font size="3" face="" >www.computecanada.ca</font></tt></a><br><tt><font size="3" face="" >University of Toronto<br>661 University Ave. (MaRS), Suite 1140<br>Toronto, ON, M5G1M1<br>P: 416-978-2755<br>C: 416-505-1477<br><br>----------------------------------------------------------------<br>This message was sent using IMP at SciNet Consortium, University of Toronto.<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font></tt><br><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=F6chd4olb-U3RlL5pcqBPagIccRSJd963K0FFS7auko&e=" target="_blank" ><tt><font color="blue" size="3" face="" ><u>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=F6chd4olb-U3RlL5pcqBPagIccRSJd963K0FFS7auko&e=</u></font></tt></a><br><br><br><br><tt><font size="3" face="" >_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font></tt><br><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=mLPyKeOa1gNDrORvEXBgMw&m=RxLph-CHLj5Iq5-RYe9eqHId7vsI_uuX4W-Y145ETD8&s=3cgWIXnSFvb65_5JkJDygm3hnSOeeCfYnDnPJdX-hWY&e=" target="_blank" ><tt><font size="3" face="" >https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=mLPyKeOa1gNDrORvEXBgMw&m=RxLph-CHLj5Iq5-RYe9eqHId7vsI_uuX4W-Y145ETD8&s=3cgWIXnSFvb65_5JkJDygm3hnSOeeCfYnDnPJdX-hWY&e=</font></tt></a><br><br><br>
<div><font size="2" face="Default Monospace,Courier New,Courier,monospace" >_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=QdLRrh1E-8uEEGHaHPZ-qGdFYqX7AZzpmPLhBd-5oGQ&m=-FY_B7uDnSKqmEonUMZBIOQQlYi-86TjHpkpo-NzbWk&s=6_GwuH8pR4vbVvEPFLPxNCOnSrzq9gJ54gp1IFgaX_k&e=" target="_blank" >https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=QdLRrh1E-8uEEGHaHPZ-qGdFYqX7AZzpmPLhBd-5oGQ&m=-FY_B7uDnSKqmEonUMZBIOQQlYi-86TjHpkpo-NzbWk&s=6_GwuH8pR4vbVvEPFLPxNCOnSrzq9gJ54gp1IFgaX_k&e=</a></font></div></blockquote>
<div dir="ltr" > </div></div>
<BR>