[gpfsug-discuss] [External] Re: Quota Idea / RFE

[Peter Childs]

Indeed, copying quota's within AFM is not really a very good use/case.

However, there are loads of other use case where you need to copy quota's between file systems, or want to change quota's where text file editing with mmedquota, mmsetquota or using default quota's is not flexible enough.

Peter



Get Outlook for Android<https://aka.ms/AAb9ysg>
________________________________
From: gpfsug-discuss <gpfsug-discuss-bounces at gpfsug.org> on behalf of Simon Thompson2 <sthompson2 at lenovo.com>
Sent: Monday, July 11, 2022 8:45:52 AM
To: gpfsug main discussion list <gpfsug-discuss at gpfsug.org>
Subject: Re: [gpfsug-discuss] [External] Re: Quota Idea / RFE

CAUTION: This email originated from outside of QMUL. Do not click links or open attachments unless you recognise the sender and know the content is safe.


Home and cache can have different amounts of disk space used, so "replicating quotas" is mostly pointless, unless you populate cache with all the data at home. But yes, this was something that hurt when I was running AFM some time ago. We saw the AFM queues "stall" when this happened (and eventually crash).

And then you have the problem that you might have different replication factors for your AFM home and cache, and that makes what the quota should be a hard question. E.g. my super fast ingest system (1 copy, cache) and my slow long-term store (2 copies, home).

Simon


Simon Thompson
He/Him/His
Sr. Manager, HPC Storage and Performance
Chineham Business Park,
Crockford Lane, Basingstoke, Hampshire, RG24 8WQ
HPC Customer Solutions
Lenovo UK
+44 7788 320635
sthompson2 at lenovo.com

Lenovo.com/uk
Twitter | Instagram | Facebook | Linkedin | YouTube | Privacy






-----Original Message-----
From: gpfsug-discuss <gpfsug-discuss-bounces at gpfsug.org> On Behalf Of Ryan Novosielski
Sent: 08 July 2022 17:03
To: gpfsug-discuss at gpfsug.org
Subject: [External] Re: [gpfsug-discuss] Quota Idea / RFE

I have a similar issue related to AFM: you can have two different quotas on the AFM home and cache (which I can't really see why you would ever want to do, but whatever), and there's not currently a way to syncrhornize them even if you want to (which you almost always would).

The behavior you get if you allow a cache to fill, for example, but being over quota on the at-home fileset is very strange (you get persistent load average on involved machines, etc., which are trying to play back writes).

On 7/1/22 05:50, Peter Childs wrote:
> I've opened a Spectrum Scale Idea for Enhancement, https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fibm-sys-storage.ideas.ibm.com%2Fideas%2FGPFS-I-857&data=05%7C01%7Csthompson2%40lenovo.com%7C3970173257fd4b75415f08da60fb9221%7C5c7d0b28bdf8410caa934df372b16203%7C0%7C0%7C637928930859469707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=zhBpDIU2B5vkOIhJCvEqAX4DGWgfngZT%2BzBsjZzPV5A%3D&reserved=0 I suspect I'm not the first one trying to achieve this so it might be worth upvoting the idea.
>
> Basically I'd like to see some way to copy quotas between filesystems, either within scale and outside that can in theory be already done with mmedquota -F but there is no way to dump the quotas in this format currently.
>
> Thanks
--
#BlackLivesMatter
____
  || \\UTGERS,     |----------------------*O*------------------------
  ||_// the State  |    Ryan Novosielski - novosirj at rutgers.edu
  || \\ University | Sr. Technologist - 973/972.0922 ~*~ RBHS Campus
  ||  \\    of NJ  | Office of Advanced Res. Comp. - MSB C630, Newark
       `'

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
https://apc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss_gpfsug.org&data=05%7C01%7Csthompson2%40lenovo.com%7C3970173257fd4b75415f08da60fb9221%7C5c7d0b28bdf8410caa934df372b16203%7C0%7C0%7C637928930859469707%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=azIehWp1xO7DtTFuwhHfkoKa8aH3bEdL%2FQmr%2FixmhA4%3D&reserved=0

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220711/d8017592/attachment-0002.htm>