<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Each independent fileset is an allocation area, and they are (I believe) handled separately. There are a set of allocation managers for each file system, and when you need to create a file you ask one of them to do it. Each one has a pre-negotiated range of inodes to hand out, so there isn’t a single point of contention for creating files. I’m pretty sure that means that they all have to have a range for each inode space. This is based on my own logic, and could be complete nonsense.<div class=""><br class=""></div><div class="">While I’m sure that limit could be changed eventually, there’s probably some efficiencies in not making it much bigger than it needs to be. I don’t know if it would take an on-disk format change or not.</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">So how do you decide that a use case gets it’s own fileset, and do you just always use independent or is there an evaluation? I’m just curious because I like to understand lots of different points of view — feel free to tell me to go away. :)</div><div class=""><div class=""><br class=""><div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">-- <br class="">Stephen<br class=""><br class=""><br class=""></div>
</div>
<br class=""><div><blockquote type="cite" class=""><div class="">On May 18, 2017, at 10:32 AM, Sobey, Richard A <<a href="mailto:r.sobey@imperial.ac.uk" class="">r.sobey@imperial.ac.uk</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="WordSection1" style="page: WordSection1; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Thanks, I was just about to post that, and I guess is still the reason a dependent fileset is still the default without the –inode-space new option fileset creation.<o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">I do wonder why there is a limit of 1000, whether it’s just IBM not envisaging any customer needing more than that? We’ve only got 414 at the moment but that will grow to over 500 this year.<span class="Apple-converted-space"> </span><o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class="">Richard<o:p class=""></o:p></span></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span style="font-size: 11pt; font-family: Calibri, sans-serif; color: rgb(31, 73, 125);" class=""><o:p class=""> </o:p></span></div><div class=""><div style="border-style: solid none none; border-top-width: 1pt; border-top-color: rgb(225, 225, 225); padding: 3pt 0cm 0cm;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><b class=""><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif;" class="">From:</span></b><span lang="EN-US" style="font-size: 11pt; font-family: Calibri, sans-serif;" class=""><span class="Apple-converted-space"> </span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a><span class="Apple-converted-space"> </span>[<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">mailto:gpfsug-discuss-bounces@spectrumscale.org</a>]<b class="">On Behalf Of<span class="Apple-converted-space"> </span></b>David D. Johnson<br class=""><b class="">Sent:</b><span class="Apple-converted-space"> </span>18 May 2017 15:24<br class=""><b class="">To:</b><span class="Apple-converted-space"> </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><br class=""><b class="">Subject:</b><span class="Apple-converted-space"> </span>Re: [gpfsug-discuss] What is an independent fileset? was: mmbackup with fileset : scope errors<o:p class=""></o:p></span></div></div></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><o:p class=""> </o:p></div><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">Here is one big reason independent filesets are problematic:<o:p class=""></o:p></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; background-color: white; vertical-align: baseline;" class=""><span class="ph"><span style="font-family: Arial, sans-serif; color: rgb(50, 50, 50); border: 1pt none windowtext; padding: 0cm;" class="">A5.13:</span></span><b class=""><span style="font-family: Arial, sans-serif; color: rgb(50, 50, 50);" class=""><o:p class=""></o:p></span></b></div><div class=""><div class=""><table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" summary="" style="margin-left: 36pt; border-collapse: collapse;"><thead class=""><tr class=""><td colspan="3" style="border: none; padding: 12pt 15pt;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><span class="tablecap"><span style="border: 1pt none windowtext; padding: 0cm;" class="">Table 43. Maximum number of filesets</span></span><o:p class=""></o:p></div></td></tr><tr class=""><td width="22%" valign="bottom" style="width: 94.15625px; border: 1pt solid rgb(224, 224, 224); padding: 12pt 15pt;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; text-align: center;" class=""><b class="">Version of GPFS<o:p class=""></o:p></b></div></td><td width="36%" valign="bottom" style="width: 180.15625px; border-top-width: 1pt; border-right-width: 1pt; border-bottom-width: 1pt; border-style: solid solid solid none; border-top-color: rgb(224, 224, 224); border-right-color: rgb(224, 224, 224); border-bottom-color: rgb(224, 224, 224); padding: 12pt 15pt;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; text-align: center;" class=""><b class="">Maximum Number of Dependent Filesets<o:p class=""></o:p></b></div></td><td width="40%" valign="bottom" style="width: 204.71875px; border-top-width: 1pt; border-right-width: 1pt; border-bottom-width: 1pt; border-style: solid solid solid none; border-top-color: rgb(224, 224, 224); border-right-color: rgb(224, 224, 224); border-bottom-color: rgb(224, 224, 224); padding: 12pt 15pt;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif; text-align: center;" class=""><b class="">Maximum Number of Independent Filesets<o:p class=""></o:p></b></div></td></tr></thead><tbody class=""><tr style="font-size: inherit;" class=""><td width="22%" valign="top" style="width: 94.15625px; border-right-width: 1pt; border-bottom-width: 1pt; border-left-width: 1pt; border-style: none solid solid; border-right-color: rgb(224, 224, 224); border-bottom-color: rgb(224, 224, 224); border-left-color: rgb(224, 224, 224); padding: 12pt 15pt; font-size: inherit;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">IBM Spectrum Scale V4<o:p class=""></o:p></div></td><td width="36%" valign="top" style="width: 180.15625px; border-style: none solid solid none; border-bottom-width: 1pt; border-bottom-color: rgb(224, 224, 224); border-right-width: 1pt; border-right-color: rgb(224, 224, 224); padding: 12pt 15pt; font-size: inherit;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">10,000<o:p class=""></o:p></div></td><td width="40%" valign="top" style="width: 204.71875px; border-style: none solid solid none; border-bottom-width: 1pt; border-bottom-color: rgb(224, 224, 224); border-right-width: 1pt; border-right-color: rgb(224, 224, 224); padding: 12pt 15pt; font-size: inherit;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">1,000<o:p class=""></o:p></div></td></tr><tr style="font-size: inherit;" class=""><td width="22%" valign="top" style="width: 94.15625px; border-right-width: 1pt; border-bottom-width: 1pt; border-left-width: 1pt; border-style: none solid solid; border-right-color: rgb(224, 224, 224); border-bottom-color: rgb(224, 224, 224); border-left-color: rgb(224, 224, 224); padding: 12pt 15pt; font-size: inherit;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">GPFS V3.5<o:p class=""></o:p></div></td><td width="36%" valign="top" style="width: 180.15625px; border-style: none solid solid none; border-bottom-width: 1pt; border-bottom-color: rgb(224, 224, 224); border-right-width: 1pt; border-right-color: rgb(224, 224, 224); padding: 12pt 15pt; font-size: inherit;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">10,000<o:p class=""></o:p></div></td><td width="40%" valign="top" style="width: 204.71875px; border-style: none solid solid none; border-bottom-width: 1pt; border-bottom-color: rgb(224, 224, 224); border-right-width: 1pt; border-right-color: rgb(224, 224, 224); padding: 12pt 15pt; font-size: inherit;" class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">1,000<o:p class=""></o:p></div></td></tr></tbody></table></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">Another is that each independent fileset must be sized (and resized) for the number of inodes it is expected to contain.<o:p class=""></o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">If that runs out (due to growth or a runaway user job), new files cannot be created until the inode limit is bumped up.<o:p class=""></o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">This is true of the root namespace as well, but there’s only one number to watch per filesystem. <o:p class=""></o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""><o:p class=""> </o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class=""> — ddj<o:p class=""></o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">Dave Johnson<o:p class=""></o:p></div></div><div class=""><div style="margin: 0cm 0cm 0.0001pt; font-size: 12pt; font-family: 'Times New Roman', serif;" class="">Brown University<o:p class=""></o:p></div></div></div></div><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">gpfsug-discuss mailing list</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">gpfsug-discuss at<span class="Apple-converted-space"> </span></span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">spectrumscale.org</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px;" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></div></blockquote></div><br class=""></div></div></body></html>