[gpfsug-discuss] Fileset quotas enforcement

Tomer Perry TOMP at il.ibm.com
Thu Oct 26 10:09:56 BST 2017


And this behavior can be changed using the enforceFilesetQuotaOnRoot 
options ( check mmchconfig man page)

Regards,

Tomer Perry
Scalable I/O Development (Spectrum Scale)
email: tomp at il.ibm.com
1 Azrieli Center, Tel Aviv 67021, Israel
Global Tel:    +1 720 3422758
Israel Tel:      +972 3 9188625
Mobile:         +972 52 2554625




From:   "Markus Rohwedder" <rohwedder at de.ibm.com>
To:     gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Cc:     gpfsug-discuss-bounces at spectrumscale.org
Date:   26/10/2017 10:18
Subject:        Re: [gpfsug-discuss] Fileset quotas enforcement
Sent by:        gpfsug-discuss-bounces at spectrumscale.org



Please also note that when you write as root, you are not restricted by 
the quota limits.

See example:

Write as non root user and run into hard limit:
[mr at home-11 limited]$ dd if=/dev/urandom of=testfile2 bs=1000 count=100000
dd: error writing ?testfile2?: Disk quota exceeded
29885+0 records in
29884+0 records out
29884000 bytes (30 MB) copied, 3.38491 s, 8.8 MB/s

[root at home-11 limited]# mmrepquota gpfs0
Block Limits | File Limits
Name type KB quota limit in_doubt grace | files quota limit in_doubt grace
...
limited FILESET 322176 214784 322304 128 7 days | 5 0 0 0 none

Now write as root user and exceed hard limit:
[root at home-11 limited]# dd if=/dev/urandom of=testfile2 bs=1000 
count=100000
100000+0 records in
100000+0 records out
100000000 bytes (100 MB) copied, 12.8355 s, 7.8 MB/s

[root at home-11 limited]# mmrepquota gpfs0
Block Limits | File Limits
Name type KB quota limit in_doubt grace | files quota limit in_doubt grace
...
limited FILESET 390656 214784 322304 8939520 7 days | 5 0 0 40 none

Mit freundlichen Grüßen / Kind regards

Dr. Markus Rohwedder

Spectrum Scale GUI Development


Phone:
+49 7034 6430190
IBM Deutschland

E-Mail:
rohwedder at de.ibm.com
Am Weiher 24


65451 Kelsterbach


Germany


IBM Deutschland Research & Development GmbH / Vorsitzender des 
Aufsichtsrats: Martina Köderitz 
Geschäftsführung: Dirk Wittkopp
Sitz der Gesellschaft: Böblingen / Registergericht: Amtsgericht Stuttgart, 
HRB 243294 


"Jaime Pinto" ---10/26/2017 12:18:45 AM---Did you try to run mmcheckquota 
on the device I observed that in the most recent versions (for the l

From: "Jaime Pinto" <pinto at scinet.utoronto.ca>
To: "gpfsug main discussion list" <gpfsug-discuss at spectrumscale.org>, 
"Emmanuel Barajas Gonzalez" <vanfalen at mx1.ibm.com>
Cc: gpfsug-discuss at spectrumscale.org
Date: 10/26/2017 12:18 AM
Subject: Re: [gpfsug-discuss] Fileset quotas enforcement
Sent by: gpfsug-discuss-bounces at spectrumscale.org



Did you try to run mmcheckquota on the device

I observed that in the most recent versions (for the last 3 years) 
there is a real long lag for GPFS to process the internal accounting. 
So there is a slippage effects that skews quota operations. 
mmcheckquota is supposed to reset and zero all those cumulative deltas 
effective immediately.

Jaime

Quoting "Emmanuel Barajas Gonzalez" <vanfalen at mx1.ibm.com>:

> Hello spectrum scale team!   I'm working on the implementation of
> quotas per fileset and I followed the basic instructions described in
> the documentation. Currently the gpfs device has per-fileset quotas
> and there is one fileset with a block soft and a hard limit set.  My
> problem is that I'm being able to write more and more files beyond
> the quota (the grace period has expired as well).   How can I make
> sure quotas will be enforced and that no user will be able to consume
> more space than specified?   mmrepquota smfslv0
>                          Block Limits
>    |
> Name       fileset    type             KB      quota      limit
> in_doubt    grace |
> root       root       USR             512          0          0
>    0     none |
> root       cp1        USR           64128          0          0
>    0     none |
> system     root       GRP             512          0          0
>    0     none |
> system     cp1        GRP           64128          0          0
>    0     none |
> valid      root       GRP               0          0          0
>    0     none |
> root       root       FILESET         512          0          0
>    0     none |
> cp1        root       FILESET       64128       2048       2048
>    0  expired |
> Thanks in advance !   Best regards,
> 
__________________________________________________________________________________
> Emmanuel Barajas Gonzalez TRANSPARENT CLOUD TIERING FOR DS8000
>
>                                                 Phone:
> 52-33-3669-7000 x5547 E-mail: vanfalen at mx1.ibm.com[1] Follow me:
> @van_falen
>                                       2200 Camino A El Castillo
>                         El Salto, JAL 45680
>                         Mexico
>
>
>
>
> Links:
> ------
> [1] mailto:vanfalen at mx1.ibm.com
>






         ************************************
          TELL US ABOUT YOUR SUCCESS STORIES
         
https://urldefense.proofpoint.com/v2/url?u=http-3A__www.scinethpc.ca_testimonials&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=mno73q7nVmqF-YTzo7pAF50B_45epo6ZzccTAwcroRU&e=

         ************************************
---
Jaime Pinto
SciNet HPC Consortium - Compute/Calcul Canada
www.scinet.utoronto.ca - www.computecanada.ca
University of Toronto
661 University Ave. (MaRS), Suite 1140
Toronto, ON, M5G1M1
P: 416-978-2755
C: 416-505-1477

----------------------------------------------------------------
This message was sent using IMP at SciNet Consortium, University of 
Toronto.

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=IbxtjdkPAM2Sbon4Lbbi4w&m=2KW8at7r2duccqfXKnq1b4-HmXZvC48q9hZ-RpiIFZ0&s=F6chd4olb-U3RlL5pcqBPagIccRSJd963K0FFS7auko&e=




_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=mLPyKeOa1gNDrORvEXBgMw&m=RxLph-CHLj5Iq5-RYe9eqHId7vsI_uuX4W-Y145ETD8&s=3cgWIXnSFvb65_5JkJDygm3hnSOeeCfYnDnPJdX-hWY&e=





-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171026/85ecf786/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 45 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171026/85ecf786/attachment-0016.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1851 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171026/85ecf786/attachment-0017.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 45 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171026/85ecf786/attachment-0018.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 45 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171026/85ecf786/attachment-0019.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 45 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171026/85ecf786/attachment-0020.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 45 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171026/85ecf786/attachment-0021.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 45 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171026/85ecf786/attachment-0022.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20171026/85ecf786/attachment-0023.gif>


More information about the gpfsug-discuss mailing list