<div dir="ltr"><br><div>as long as your currently do not need more than 1000 on a filesystem </div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, 8 Jul 2020 at 04:20, Daniel Kidger <<a href="mailto:daniel.kidger@uk.ibm.com">daniel.kidger@uk.ibm.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:9pt"><div dir="ltr">It is worth noting that Independent Filesets are a relatively recent addition to Spectrum Scale, compared to Dependant Filesets. They havesolved some of the limitations of the former.</div>
<div dir="ltr"> </div>
<div dir="ltr"> </div>
<div dir="ltr">My view would be to always use Independent FIlesets unless there is a particular reason to use Dependant ones.</div>
<div dir="ltr"> </div>
<div dir="ltr"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:10pt"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:10.5pt"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:10.5pt"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:10.5pt"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:10.5pt"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr" style="margin-top:20px"><div style="margin-top:10px"><div style="font-family:sans-serif;font-size:8pt;margin-bottom:0.0001pt;line-height:normal"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><span style="font-size:1em">Daniel</span></font></font></div>
<div style="font-family:sans-serif;font-size:8pt;margin-bottom:0.0001pt;line-height:normal"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"> </font></font></div>
<div style="margin-bottom:0.0001pt;line-height:normal"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font color="#19A9F3" size="3" style="font-family:"Helvetica Neue",Helvetica,Arial,"Lucida Grande",sans-serif;font-size:8pt;outline:none">_________________________________________________________</font><br style="outline:none"><font color="#808080" face="Arial" size="2"><span><b>Daniel Kidger Ph.D.</b></span></font></font></font></div>
<div style="margin-bottom:0.0001pt;line-height:normal"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><span style="outline:none;font-size:10.6667px"><font color="#121212"><span style="outline:none;font-size:7.5pt">IBM Technical Sales Specialist</span></font></span></font></font></div>
<div style="margin-bottom:0.0001pt;line-height:normal"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><span style="outline:none;font-size:10.6667px"><font color="#121212"><span style="outline:none;font-size:7.5pt">Spectrum Scale, Spectrum Discover and IBM Cloud Object Store<br style="outline:none"><br style="outline:none"><span style="font-size:0.857em">+</span></span></font></span><span style="font-size:0.857em"><span style="outline:none;font-family:sans-serif"><font color="#5f5f5f"><span style="outline:none;font-family:Verdana,Geneva,sans-serif"><span style="outline:none">44-(0)7818 522 266 </span></span></font></span></span><br style="outline:none;font-family:sans-serif;font-size:10.6667px"><span style="outline:none;font-family:sans-serif;font-size:10.6667px"><font color="#5f5f5f"><span style="outline:none;font-family:Arial,Helvetica,sans-serif"><span style="outline:none;font-size:8pt"><a href="mailto:daniel.kidger@uk.ibm.com" target="_blank">daniel.kidger@uk.ibm.com</a></span></span></font></span> </font></font>
<table border="0" style="border-collapse:collapse;border-color:rgb(105,105,105);table-layout:fixed;width:264px"> <tbody> <tr> <td style="overflow:hidden;width:88px;border-color:rgb(105,105,105)"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><a href="https://www.youracclaim.com/badges/687cf790-fe65-4a92-b129-d23ae41862ac/public_url" target="_blank"><img alt="" src="https://images.youracclaim.com/images/c49300ae-d13e-4071-90f5-15f59d199c9e/IBM%2BVolunteers%2BGold%2Bv6.png" style="width: 88px; height: 88px;"></a></font></font></td> <td style="overflow:hidden;width:88px;border-color:rgb(105,105,105)"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><a href="https://www.youracclaim.com/badges/8153c6a7-3e02-40be-87ee-24e27ae9459c/public_url" target="_blank"><img alt="" src="https://images.youracclaim.com/images/f2539224-f951-46b4-b376-b88f21c2be98/IBM-Selling-Certification---Level-1.png" style="width: 88px; height: 88px;"></a></font></font></td> <td style="overflow:hidden;width:88px;border-color:rgb(105,105,105)"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><a href="https://www.youracclaim.com/badges/78197e2c-4277-4ec9-808b-ad6abe1e1b16/public_url" target="_blank"><img alt="" src="https://images.youracclaim.com/images/ea52b12f-97ac-4e72-8d24-b0ced8054e7d/Storage%2BTechnical%2BV1.png" style="width: 88px; height: 88px;"></a></font></font></td> </tr> </tbody></table><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"> </font></font>
<div><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"> </font></font></div><font face="Verdana,Arial,Helvetica,sans-serif" size="2"><font face="Verdana,Arial,Helvetica,sans-serif" size="2"> </font></font></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
<div dir="ltr"> </div>
<div dir="ltr"> </div>
<blockquote dir="ltr" style="border-left:2px solid rgb(170,170,170);margin-left:5px;padding-left:5px;direction:ltr;margin-right:0px">----- Original message -----<br>From: "Frederick Stock" <<a href="mailto:stockf@us.ibm.com" target="_blank">stockf@us.ibm.com</a>><br>Sent by: <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectrumscale.org</a><br>To: <a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a><br>Cc: <a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a><br>Subject: [EXTERNAL] Re: [gpfsug-discuss] dependent versus independent filesets<br>Date: Tue, Jul 7, 2020 17:25<br>
<div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:12pt"><div dir="ltr">One comment about inode preallocation. There was a time when inode creation was performance challenged but in my opinion that is no longer the case, unless you have need for file creates to complete at extreme speed. In my experience it is the rare customer that requires extremely fast file create times so pre-allocation is not truly necessary. As was noted once an inode is allocated it cannot be deallocated. The more important item is the maximum inodes defined for a fileset or file system. Yes, those do need to be monitored so they can be increased if necessary to avoid out of space errors.</div>
<div dir="ltr"><div dir="ltr" style="font-family:Arial,Helvetica,sans-serif;font-size:10.5pt"><div dir="ltr"><br><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><span style="font-size:1.143em">Fred<br>__________________________________________________<br>Fred Stock | IBM Pittsburgh Lab | 720-430-8821<br><a href="mailto:stockf@us.ibm.com" target="_blank">stockf@us.ibm.com</a></span></font></div></div></div>
<div dir="ltr"> </div>
<div dir="ltr"> </div>
<blockquote dir="ltr" style="border-left:2px solid rgb(170,170,170);margin-left:5px;padding-left:5px;direction:ltr;margin-right:0px">----- Original message -----<br>From: "Wahl, Edward" <<a href="mailto:ewahl@osc.edu" target="_blank">ewahl@osc.edu</a>><br>Sent by: <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectrumscale.org</a><br>To: gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a>><br>Cc:<br>Subject: [EXTERNAL] Re: [gpfsug-discuss] dependent versus independent filesets<br>Date: Tue, Jul 7, 2020 11:59 AM<br>
<div><font face="Default Monospace,Courier New,Courier,monospace" size="2">We also went with independent filesets for both backup (and quota) reasons for several years now, and have stuck with this across to 5.x. However we still maintain a minor number of dependent filesets for administrative use. Being able to mmbackup on many filesets at once can increase your parallelization _quite_ nicely! We create and delete the individual snaps before and after each backup, as you may expect. Just be aware that if you do massive numbers of fast snapshot deletes and creates you WILL reach a point where you will run into issues due to quiescing compute clients, and that certain types of workloads have issues with snapshotting in general.<br><br>You have to more closely watch what you pre-allocate, and what you have left in the common metadata/inode pool. Once allocated, even if not being used, you cannot reduce the inode allocation without removing the fileset and re-creating. (say a fileset user had 5 million inodes and now only needs 500,000) <br><br>Growth can also be an issue if you do NOT fully pre-allocate each space. This can be scary if you are not used to over-subscription in general. But I imagine that most sites have some decent % of oversubscription if they use filesets and quotas.<br><br>Ed<br>OSC<br><br>-----Original Message-----<br>From: <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectrumscale.org</a> <<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectrumscale.org</a>> On Behalf Of Skylar Thompson<br>Sent: Tuesday, July 7, 2020 10:00 AM<br>To: <a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a><br>Subject: Re: [gpfsug-discuss] dependent versus independent filesets<br><br>We wanted to be able to snapshot and backup filesets separately with mmbackup, so went with independent filesets.<br><br>On Tue, Jul 07, 2020 at 08:37:46AM -0500, Damir Krstic wrote:<br>> We are deploying our new ESS and are considering moving to independent<br>> filesets. The snapshot per fileset feature appeals to us.<br>><br>> Has anyone considered independent vs. dependent filesets and what was<br>> your reasoning to go with one as opposed to the other? Or perhaps you<br>> opted to have both on your filesystem, and if, what was the reasoning for it?<br>><br>> Thank you.<br>> Damir<br><br>> _______________________________________________<br>> gpfsug-discuss mailing list<br>> gpfsug-discuss at <a href="http://spectrumscale.org" target="_blank">spectrumscale.org</a><br>> <a href="https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-" target="_blank">https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-</a><br>> discuss__;!!KGKeukY!j-c9kslUrEaNslhTbLLfaY8TES7Xf4eUCxysOaXwroHhTMwiVY<br>> vcGNh4M_no$<br><br><br>--<br>-- Skylar Thompson (<a href="mailto:skylar2@u.washington.edu" target="_blank">skylar2@u.washington.edu</a>)<br>-- Genome Sciences Department (UW Medicine), System Administrator<br>-- Foege Building S046, (206)-685-7354<br>-- Pronouns: He/Him/His<br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at <a href="http://spectrumscale.org" target="_blank">spectrumscale.org</a><br><a href="https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!KGKeukY!j-c9kslUrEaNslhTbLLfaY8TES7Xf4eUCxysOaXwroHhTMwiVYvcGNh4M_no$" target="_blank">https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!KGKeukY!j-c9kslUrEaNslhTbLLfaY8TES7Xf4eUCxysOaXwroHhTMwiVYvcGNh4M_no$</a> <br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at <a href="http://spectrumscale.org" target="_blank">spectrumscale.org</a><br><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a> </font><br> </div></blockquote>
<div dir="ltr"> </div></div>
<div><font face="Default Monospace,Courier New,Courier,monospace" size="2">_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at <a href="http://spectrumscale.org" target="_blank">spectrumscale.org</a><br><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a> </font></div></blockquote>
<div dir="ltr"> </div></div>Unless stated otherwise above:<br>
IBM United Kingdom Limited - Registered in England and Wales with number 741598. <br>
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU<br>
<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" rel="noreferrer" target="_blank">spectrumscale.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br>
</blockquote></div>