<html><body><p>This is a long discussion thread, touching on several related subjects, but as far as the original "secondary groups" question, things are quite simple. A file in a Unix file system has an owning user and an owning group. Those are two IDs that are stored in the inode on disk, and those IDs are used to charge the corresponding user and group quotas. Exactly how the owning GID gets set is an entirely separate question. It may be the current user's primary group, or a secondary group, or a result of chown, etc. To GPFS code it doesn't matter what supplementary GIDs a given thread has in its security context for the purposes of charging group quota, the only thing that matters is the GID in the file inode.<br><br>yuri<br><br><img width="16" height="16" src="cid:1__=07BB0A82DFC63BB98f9e8a93df938690918c07B@" border="0" alt="Inactive hide details for "Jaime Pinto" ---08/04/2016 09:34:32 AM---OK More info:"><font color="#424282">"Jaime Pinto" ---08/04/2016 09:34:32 AM---OK More info:</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">"Jaime Pinto" <pinto@scinet.utoronto.ca></font><br><font size="2" color="#5F5F5F">To: </font><font size="2">"gpfsug main discussion list" <gpfsug-discuss@spectrumscale.org>, "Buterbaugh, Kevin L" <Kevin.Buterbaugh@Vanderbilt.Edu>, </font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">08/04/2016 09:34 AM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">Re: [gpfsug-discuss] quota on secondary groups for a user?</font><br><font size="2" color="#5F5F5F">Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><tt>OK<br><br>More info:<br><br>Users can apply the 'sg group1' or 'sq group2' command from a shell or <br>script to switch the group mask from that point on, and dodge the <br>quota that may have been exceeded on a group.<br><br>However, as the group owner or other member of the group on the limit, <br>I could not find a tool they can use on their own to find out who <br>is(are) the largest user(s); 'du' takes too long, and some users don't <br>give read permissions on their directories.<br><br>As part of the puzzle solution I have to come up with a root wrapper <br>that can make the contents of the mmrepquota report available to them.<br><br>Jaime<br><br><br><br>Quoting "Buterbaugh, Kevin L" <Kevin.Buterbaugh@Vanderbilt.Edu>:<br><br>> Hi Jaime,<br>><br>> Thank you sooooo much for doing this and reporting back the results! <br>> They?re in line with what I would expect to happen. I was going <br>> to test this as well, but we have had to extend our downtime until <br>> noontime tomorrow, so I haven?t had a chance to do so yet. Now I <br>> don?t have to? ;-)<br>><br>> Kevin<br>><br>> On Aug 4, 2016, at 10:59 AM, Jaime Pinto <br>> <pinto@scinet.utoronto.ca<</tt><tt><a href="mailto:pinto@scinet.utoronto.ca">mailto:pinto@scinet.utoronto.ca</a></tt><tt>>> wrote:<br>><br>> Since there were inconsistencies in the responses, I decided to rig <br>> a couple of accounts/groups on our LDAP to test "My interpretation", <br>> and determined that I was wrong. When Kevin mentioned it would mean <br>> a bug I had to double-check:<br>><br>> If a user hits the hard quota or exceeds the grace period on the <br>> soft quota on any of the secondary groups that user will be stopped <br>> from further writing to those groups as well, just as in the primary <br>> group.<br>><br>> I hope this clears the waters a bit. I still have to solve my puzzle.<br>><br>> Thanks everyone for the feedback.<br>> Jaime<br>><br>><br>><br>> Quoting "Jaime Pinto" <br>> <pinto@scinet.utoronto.ca<</tt><tt><a href="mailto:pinto@scinet.utoronto.ca">mailto:pinto@scinet.utoronto.ca</a></tt><tt>>>:<br>><br>> Quoting "Buterbaugh, Kevin L" <br>> <Kevin.Buterbaugh@Vanderbilt.Edu<</tt><tt><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu">mailto:Kevin.Buterbaugh@vanderbilt.edu</a></tt><tt>>>:<br>><br>> Hi Sven,<br>><br>> Wait - am I misunderstanding something here? Let?s say that I have <br>> ?user1? who has primary group ?group1? and secondary group <br>> ?group2?. And let?s say that they write to a directory where the <br>> bit on the directory forces all files created in that directory to <br>> have group2 associated with them. Are you saying that those files <br>> still count against group1?s group quota???<br>><br>> Thanks for clarifying?<br>><br>> Kevin<br>><br>> Not really,<br>><br>> My interpretation is that all files written with group2 will count<br>> towards the quota on that group. However any users with group2 as the<br>> primary group will be prevented from writing any further when the<br>> group2 quota is reached. However the culprit user1 with primary group<br>> as group1 won't be detected by gpfs, and can just keep going on writing<br>> group2 files.<br>><br>> As far as the individual user quota, it doesn't matter: group1 or<br>> group2 it will be counted towards the usage of that user.<br>><br>> It would be interesting if the behavior was more as expected. I just<br>> checked with my Lustre counter-parts and they tell me whichever<br>> secondary group is hit first, however many there may be, the user will<br>> be stopped. The problem then becomes identifying which of the secondary<br>> groups hit the limit for that user.<br>><br>> Jaime<br>><br>><br>><br>> On Aug 3, 2016, at 11:35 AM, Sven Oehme <br>> <oehmes@gmail.com<</tt><tt><a href="mailto:oehmes@gmail.com">mailto:oehmes@gmail.com</a></tt><tt>><</tt><tt><a href="mailto:oehmes@gmail.com">mailto:oehmes@gmail.com</a></tt><tt>>> <br>> wrote:<br>><br>> Hi,<br>><br>> quotas are only counted against primary group<br>><br>> sven<br>><br>><br>> On Wed, Aug 3, 2016 at 9:22 AM, Jaime Pinto <br>> <pinto@scinet.utoronto.ca<</tt><tt><a href="mailto:pinto@scinet.utoronto.ca">mailto:pinto@scinet.utoronto.ca</a></tt><tt>><</tt><tt><a href="mailto:pinto@scinet.utoronto.ca">mailto:pinto@scinet.utoronto.ca</a></tt><tt>>> <br>> wrote:<br>> Suppose I want to set both USR and GRP quotas for a user, however <br>> GRP is not the primary group. Will gpfs enforce the secondary group <br>> quota for that user?<br>><br>> What I mean is, if the user keeps writing files with secondary <br>> group as the attribute, and that overall group quota is reached, <br>> will that user be stopped by gpfs?<br>><br>> Thanks<br>> Jaime<br>><br>><br>><br>><br>> ************************************<br>> TELL US ABOUT YOUR SUCCESS STORIES<br>> </tt><tt><a href="http://www.scinethpc.ca/testimonials">http://www.scinethpc.ca/testimonials</a></tt><tt><br>> ************************************<br>> ---<br>> Jaime Pinto<br>> SciNet HPC Consortium - Compute/Calcul Canada<br>> </tt><tt>www.scinet.utoronto.ca</tt><tt><</tt><tt><a href="http://www.scinet.utoronto.ca">http://www.scinet.utoronto.ca</a></tt><tt>><</tt><tt><a href="http://www.scinet.utoronto.ca/">http://www.scinet.utoronto.ca/</a></tt><tt>> - <br>> </tt><tt>www.computecanada.org</tt><tt><</tt><tt><a href="http://www.computecanada.org">http://www.computecanada.org</a></tt><tt>><</tt><tt><a href="http://www.computecanada.org/">http://www.computecanada.org/</a></tt><tt>><br>> University of Toronto<br>> 256 McCaul Street, Room 235<br>> Toronto, ON, M5T1W5<br>> P: 416-978-2755<tel:416-978-2755><br>> C: 416-505-1477<tel:416-505-1477><br>><br>><br>><br>> ----------------------------------------------------------------<br>> This message was sent using IMP at SciNet Consortium, University of Toronto.<br>><br>> _______________________________________________<br>> gpfsug-discuss mailing list<br>> gpfsug-discuss at spectrumscale.org<</tt><tt><a href="http://spectrumscale.org">http://spectrumscale.org</a></tt><tt>><br>> </tt><tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br>><br>><br>><br>><br>><br>><br>><br>> ************************************<br>> TELL US ABOUT YOUR SUCCESS STORIES<br>> </tt><tt><a href="http://www.scinethpc.ca/testimonials">http://www.scinethpc.ca/testimonials</a></tt><tt><br>> ************************************<br>> ---<br>> Jaime Pinto<br>> SciNet HPC Consortium - Compute/Calcul Canada<br>> </tt><tt>www.scinet.utoronto.ca</tt><tt><</tt><tt><a href="http://www.scinet.utoronto.ca">http://www.scinet.utoronto.ca</a></tt><tt>> - <br>> </tt><tt>www.computecanada.org</tt><tt><</tt><tt><a href="http://www.computecanada.org">http://www.computecanada.org</a></tt><tt>><br>> University of Toronto<br>> 256 McCaul Street, Room 235<br>> Toronto, ON, M5T1W5<br>> P: 416-978-2755<br>> C: 416-505-1477<br>><br>> ----------------------------------------------------------------<br>> This message was sent using IMP at SciNet Consortium, University of Toronto.<br>><br>> _______________________________________________<br>> gpfsug-discuss mailing list<br>> gpfsug-discuss at spectrumscale.org<</tt><tt><a href="http://spectrumscale.org">http://spectrumscale.org</a></tt><tt>><br>> </tt><tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br>><br>> ?<br>> Kevin Buterbaugh - Senior System Administrator<br>> Vanderbilt University - Advanced Computing Center for Research and Education<br>> Kevin.Buterbaugh@vanderbilt.edu<</tt><tt><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu">mailto:Kevin.Buterbaugh@vanderbilt.edu</a></tt><tt>> - <br>> (615)875-9633<br>><br>><br>><br>><br><br><br><br><br><br><br> ************************************<br> TELL US ABOUT YOUR SUCCESS STORIES<br> </tt><tt><a href="http://www.scinethpc.ca/testimonials">http://www.scinethpc.ca/testimonials</a></tt><tt><br> ************************************<br>---<br>Jaime Pinto<br>SciNet HPC Consortium - Compute/Calcul Canada<br></tt><tt>www.scinet.utoronto.ca</tt><tt> - </tt><tt>www.computecanada.org</tt><tt><br>University of Toronto<br>256 McCaul Street, Room 235<br>Toronto, ON, M5T1W5<br>P: 416-978-2755<br>C: 416-505-1477<br><br>----------------------------------------------------------------<br>This message was sent using IMP at SciNet Consortium, University of Toronto.<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></tt><tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br><br></tt><br><BR>
</body></html>