<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
Hi Andrew / All,
<div class=""><br class="">
</div>
<div class="">Well, it does _sound_ useful, but in its current state it’s really not for several reasons, mainly having to do with it being coded in a moderately site-specific way. It needs an overhaul anyway, so I’m going to look at getting rid of as much
of that as possible (there’s some definite low-hanging fruit there) and, for the site-specific things that can’t be gotten rid of, maybe consolidating them into one place in the code so that the script could be more generally useful if you just change those
values.</div>
<div class=""><br class="">
</div>
<div class="">If I can accomplish those things, then yes, we’d be glad to share the script.</div>
<div class=""><br class="">
</div>
<div class="">But I’ve also realized that I didn’t _entirely_ answer my original question. Yes, mmlsquota will show me all the filesets … but I also need to know the junction path for each of those filesets. One of the main reasons we wrote this script in
the first place is that if you run mmlsquota you see that you have no limits on about 60 filesets (currently we use fileset quotas only on our filesets) … and that’s because there are no user (or group) quotas in those filesets. The script, however, reads
in that text file that is created nightly by root that is nothing more than the output of “mmlsfileset <filesystem name>”, gets the junction path, looks up the GID of the junction path, and sees if you’re a member of that group. If you’re not, well, no sense
in showing you anything about that fileset. But, of course, if you are a member of that group, then we do want to show you the fileset quota for that fileset.</div>
<div class=""><br class="">
</div>
<div class="">So … my question now is, “Is there a way for a non-root user” to get the junction path for the fileset(s)? Thanks…</div>
<div class=""><br class="">
</div>
<div class="">Kevin</div>
<div class=""><br class="">
</div>
<div class="">
<div class="">
<div class="">—</div>
<div class="">Kevin Buterbaugh - Senior System Administrator</div>
<div class="">Vanderbilt University - Advanced Computing Center for Research and Education</div>
<div class=""><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" class="">Kevin.Buterbaugh@vanderbilt.edu</a> - (615)875-9633</div>
<div class=""><br class="">
</div>
</div>
<div>
<blockquote type="cite" class="">
<div class="">On Jan 9, 2019, at 7:13 PM, Andrew Beattie <<a href="mailto:abeattie@au1.ibm.com" class="">abeattie@au1.ibm.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt">
<div dir="ltr" class="">Kevin,</div>
<div dir="ltr" class=""> </div>
<div dir="ltr" class="">That sounds like a useful script</div>
<div dir="ltr" class="">would you care to share?</div>
<div dir="ltr" class=""> </div>
<div dir="ltr" class="">Thanks</div>
<div dir="ltr" class="">
<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial;font-size:10.5pt">
<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial;font-size:10.5pt">
<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial;font-size:10.5pt">
<div dir="ltr" style="margin-top: 20px;" class="">
<div style="font-size: 12pt; font-weight: bold; font-family: sans-serif; color: #7C7C5F;" class="">
Andrew Beattie</div>
<div style="font-size: 10pt; font-weight: bold; font-family: sans-serif;" class="">
Software Defined Storage - IT Specialist</div>
<div style="font-size: 8pt; font-family: sans-serif; margin-top: 10px;" class="">
<div class=""><span style="font-weight: bold; color: #336699;" class="">Phone: </span>
614-2133-7927</div>
<div class=""><span style="font-weight: bold; color: #336699;" class="">E-mail: </span>
<a href="mailto:abeattie@au1.ibm.com" style="color: #555" class="">abeattie@au1.ibm.com</a></div>
</div>
</div>
</div>
</div>
</div>
</div>
<div dir="ltr" class=""> </div>
<div dir="ltr" class=""> </div>
<blockquote data-history-content-modified="1" dir="ltr" style="border-left:solid #aaaaaa 2px; margin-left:5px; padding-left:5px; direction:ltr; margin-right:0px" class="">
----- Original message -----<br class="">
From: "Buterbaugh, Kevin L" <<a href="mailto:Kevin.Buterbaugh@Vanderbilt.Edu" class="">Kevin.Buterbaugh@Vanderbilt.Edu</a>><br class="">
Sent by: <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" class="">gpfsug-discuss-bounces@spectrumscale.org</a><br class="">
To: gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" class="">gpfsug-discuss@spectrumscale.org</a>><br class="">
Cc:<br class="">
Subject: Re: [gpfsug-discuss] Get list of filesets _without_ running mmlsfileset?<br class="">
Date: Thu, Jan 10, 2019 9:22 AM<br class="">
<br class="">
<!--Notes ACF
<meta http-equiv="Content-Type" content="text/html; charset=utf8" >-->Hi All,
<div class=""> </div>
<div class="">Let me answer Skylar’s questions in another e-mail, which may also tell whether the rest API is a possibility or not.</div>
<div class=""> </div>
<div class="">The Python script in question is to display quota information for a user. The mmlsquota command has a couple of issues: 1) its output is confusing to some of our users, 2) more significantly, it displays a ton of information that doesn’t apply
to the user running it. For example, it will display all the filesets in a filesystem whether or not the user has access to them. So the Python script figures out what group(s) the user is a member of and only displays information pertinent to them (i.e.
the group of the fileset junction path is a group this user is a member of) … and in a simplified (and potentially colorized) output format.</div>
<div class=""> </div>
<div class="">And typing that preceding paragraph caused the lightbulb to go off … I know the answer to my own question … have the script run mmlsquota and get the full list of filesets from that, then parse that to determine which ones I actually need to display
quota information for. Thanks!</div>
<div class=""> </div>
<div class="">Kevin
<div class="">
<div class="">—</div>
<div class="">Kevin Buterbaugh - Senior System Administrator</div>
<div class="">Vanderbilt University - Advanced Computing Center for Research and Education</div>
<div class=""><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" target="_blank" class="">Kevin.Buterbaugh@vanderbilt.edu</a> - (615)875-9633</div>
<div class=""> </div>
</div>
<div class="">
<blockquote type="cite" class="">
<div class="">On Jan 9, 2019, at 4:42 PM, Simon Thompson <<a href="mailto:S.J.Thompson@bham.ac.uk" target="_blank" class="">S.J.Thompson@bham.ac.uk</a>> wrote:</div>
<div class="">
<div class="">Hi Kevin,<br class="">
<br class="">
Have you looked at the rest API?<br class="">
<br class="">
<a href="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fsupport%2Fknowledgecenter%2Fen%2FSTXKQY_5.0.2%2Fcom.ibm.spectrum.scale.v5r02.doc%2Fbl1adm_listofapicommands.htm&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7Cc1ffac821c5f4524104908d67698e948%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C636826796466979672&sdata=0%2FsV4sgFJmyJjaETdNtmsRP21pm5zFSYdpr9eNtDSs4%3D&reserved=0" originalsrc="https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.2/com.ibm.spectrum.scale.v5r02.doc/bl1adm_listofapicommands.htm" shash="mOQgy8BSUiF+h0ESM/t6B9TD7Bb4lTHeUA1KgqiI2eL8LT3RAwaBlKOg73NQ9vw7iBqE+OBvTDXN8BqQ88z4+GE+xCvmQdabKj7KaNsnQcDYdvyLJ6g/h1BralYK4xDB+4Iku2WkjOvqEWcWDtasucstImzvRtVJLj/70txx+gA=" target="_blank" class="">https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fsupport%2Fknowledgecenter%2Fen%2FSTXKQY_5.0.2%2Fcom.ibm.spectrum.scale.v5r02.doc%2Fbl1adm_listofapicommands.htm&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C36fb451ce9a945f5e0cb08d67683af85%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C1%7C636826705300525885&sdata=uotWilntiZa2E9RIBE2ikhxxBm3Mk3y%2FW%2FKUHovaJpY%3D&reserved=0</a><br class="">
<br class="">
I don't know how much access control there is available in the API so not sure if you could lock some sort of service user down to just the get filesets command?<br class="">
<br class="">
Simon<br class="">
_______________________________________<br class="">
From: <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" class="">gpfsug-discuss-bounces@spectrumscale.org</a> [<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" class="">gpfsug-discuss-bounces@spectrumscale.org</a>] on behalf of Buterbaugh,
Kevin L [<a href="mailto:Kevin.Buterbaugh@Vanderbilt.Edu" class="">Kevin.Buterbaugh@Vanderbilt.Edu</a>]<br class="">
Sent: 08 January 2019 22:12<br class="">
To: gpfsug main discussion list<br class="">
Subject: [gpfsug-discuss] Get list of filesets _without_ running mmlsfileset?<br class="">
<br class="">
Hi All,<br class="">
<br class="">
Happy New Year to all! Personally, I’ll gladly and gratefully settle for 2019 not being a dumpster fire like 2018 was (those who attended my talk at the user group meeting at SC18 know what I’m referring to), but I certainly wish all of you the best!<br class="">
<br class="">
Is there a way to get a list of the filesets in a filesystem without running mmlsfileset? I was kind of expecting to find them in one of the config files somewhere under /var/mmfs but haven’t found them yet in the searching I’ve done.<br class="">
<br class="">
The reason I’m asking is that we have a Python script that users can run that needs to get a list of all the filesets in a filesystem. There are obviously multiple issues with that, so the workaround we’re using for now is to have a cron job which runs mmlsfileset
once a day and dumps it out to a text file, which the script then reads. That’s sub-optimal for any day on which a fileset gets created or deleted, so I’m looking for a better way … one which doesn’t require root privileges and preferably doesn’t involve
running a GPFS command at all.<br class="">
<br class="">
Thanks in advance.<br class="">
<br class="">
Kevin<br class="">
<br class="">
P.S. I am still working on metadata and iSCSI testing and will report back on that when complete.<br class="">
P.P.S. We ended up adding our new NSDs comprised of (not really) 12 TB disks to the capacity pool and things are working fine.<br class="">
<br class="">
—<br class="">
Kevin Buterbaugh - Senior System Administrator<br class="">
Vanderbilt University - Advanced Computing Center for Research and Education<br class="">
<a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" class="">Kevin.Buterbaugh@vanderbilt.edu</a><<a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" class="">mailto:Kevin.Buterbaugh@vanderbilt.edu</a>> - (615)875-9633<br class="">
<br class="">
<br class="">
<br class="">
_______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class="">
<a href="https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C36fb451ce9a945f5e0cb08d67683af85%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C1%7C636826705300525885&sdata=WSijRrjhOgQyuWsh9K8ckpjf%2F2CkXfZW1n%2BJw5Gw5tw%3D&reserved=0" class="">https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C36fb451ce9a945f5e0cb08d67683af85%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C1%7C636826705300525885&sdata=WSijRrjhOgQyuWsh9K8ckpjf%2F2CkXfZW1n%2BJw5Gw5tw%3D&reserved=0</a></div>
</div>
</blockquote>
</div>
</div>
<div class=""><font size="2" face="Default Monospace,Courier New,Courier,monospace" class="">_______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class="">
<a href="https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7Cc1ffac821c5f4524104908d67698e948%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C1%7C636826796466989681&sdata=u32oTmCl3WXoCpPQQplOtAeAuzfNfHBjUmg%2BU194rbI%3D&reserved=0" originalsrc="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" shash="pQd31h1F/jd6IQ+6s/r0qkL1QEKP4YkxdOmVyJfqwDOMz8hED0PfcTvX+vDocKuorW9Rin4c1qCg0WfZgdLMHW6u/YEk7+uU7Y55E2OwEGGCsD9x7nMjUeWSciV2tpolv2I4Err4rWunan9s8vNZVIMqgXlBjpdifBo7rf3INWs=" target="_blank" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></font></div>
</blockquote>
<div dir="ltr" class=""> </div>
</div>
<br class="">
_______________________________________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class="">
<a href="https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7Cc1ffac821c5f4524104908d67698e948%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C1%7C636826796467009700&sdata=Xfz4JiItI8ukHgnvO5YoN27jVpk6Ngsk03NtMrKJcHk%3D&reserved=0" class="">https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7Cc1ffac821c5f4524104908d67698e948%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C1%7C636826796467009700&sdata=Xfz4JiItI8ukHgnvO5YoN27jVpk6Ngsk03NtMrKJcHk%3D&reserved=0</a><br class="">
</div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>