<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p>Dear Olaf,</p>
<p><br>
</p>
<p>I know that this is "just" a "support" limit. However Sven some day on a UG meeting in Ehningen told me that there is more to this than just</p>
<p>adjusting your QA qualification tests since the way it is implemented today does not really scale ;). </p>
<p>That's probably the reason why you said you see sometimes problems <span style="font-size: 12pt;">when you are not even close to the limit.</span></p>
<p><br>
</p>
<p>So if you look at the 250PB Alpine file system of Summit today, that is what's going to deployed at more than one site world wide in 2-4 years and</p>
<p>imho independent filesets are a great way to make this large systems much more handy while still maintaining a unified namespace.</p>
<p>So I really think it would be beneficial if the architectural limit that prevents scaling the number of independent filesets could be removed at all.</p>
<p><br>
</p>
Best Regards,
<div>Stephan Peinkofer<br>
<br>
<div style="color: rgb(0, 0, 0);">
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> gpfsug-discuss-bounces@spectrumscale.org <gpfsug-discuss-bounces@spectrumscale.org> on behalf of Olaf Weiser <olaf.weiser@de.ibm.com><br>
<b>Sent:</b> Friday, August 10, 2018 2:51 PM<br>
<b>To:</b> gpfsug main discussion list<br>
<b>Cc:</b> gpfsug-discuss-bounces@spectrumscale.org; Doris Franke; Uwe Tron; Dorian Krause<br>
<b>Subject:</b> Re: [gpfsug-discuss] GPFS Independent Fileset Limit</font>
<div> </div>
</div>
<div><font size="2" face="sans-serif">Hallo Stephan, </font><br>
<div><font size="2" face="sans-serif">the limit is not a hard coded limit - technically spoken, you can raise it easily.
</font><br>
<font size="2" face="sans-serif">But as always, it is a question of test 'n support ..
</font><br>
<br>
<font size="2" face="sans-serif">I've seen customer cases, where the use of much smaller amount of independent filesets generates a lot performance issues, hangs ... at least noise and partial trouble ..
</font><br>
<font size="2" face="sans-serif">it might be not the case with your specific workload, because due to the fact, that you 're running already close to 1000 ...</font><br>
<br>
<font size="2" face="sans-serif">I suspect , this number of 1000 file sets - at the time of introducing it - was as also just that one had to pick a number...
</font><br>
<br>
<font size="2" face="sans-serif">... turns out.. that a general commitment to support > 1000 ind.fileset is more or less hard.. because what uses cases should we test / support</font><br>
<font size="2" face="sans-serif">I think , there might be a good chance for you , that for your specific workload, one would allow and support more than 1000
</font><br>
<br>
<font size="2" face="sans-serif">do you still have a PMR for your side for this ? - if not - I know .. open PMRs is an additional ...but could you please ..
</font><br>
<font size="2" face="sans-serif">then we can decide .. if raising the limit is an option for you ..
</font><br>
<br>
<br>
<br>
<br>
<br>
<font size="2" face="sans-serif">Mit freundlichen Grüßen / Kind regards</font><br>
<br>
<font size="2" face="sans-serif"> <br>
Olaf Weiser<br>
<br>
EMEA Storage Competence Center Mainz, German / IBM Systems, Storage Platform,<br>
-------------------------------------------------------------------------------------------------------------------------------------------<br>
IBM Deutschland<br>
IBM Allee 1<br>
71139 Ehningen<br>
Phone: +49-170-579-44-66<br>
E-Mail: olaf.weiser@de.ibm.com<br>
-------------------------------------------------------------------------------------------------------------------------------------------<br>
IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter<br>
Geschäftsführung: Martina Koederitz (Vorsitzende), Susanne Peter, Norbert Janzen, Dr. Christian Keller, Ivo Koerner, Markus Koerner<br>
Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940
</font><br>
<br>
<br>
<br>
<font size="1" color="#5f5f5f" face="sans-serif">From: </font><font size="1" face="sans-serif">"Peinkofer, Stephan" <Stephan.Peinkofer@lrz.de></font><br>
<font size="1" color="#5f5f5f" face="sans-serif">To: </font><font size="1" face="sans-serif">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Cc: </font><font size="1" face="sans-serif">Doris Franke <doris.franke@de.ibm.com>, Uwe Tron <utron@lenovo.com>, Dorian Krause <d.krause@fz-juelich.de></font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Date: </font><font size="1" face="sans-serif">08/10/2018 01:29 PM</font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Subject: </font><font size="1" face="sans-serif">[gpfsug-discuss] GPFS Independent Fileset Limit</font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Sent by: </font><font size="1" face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br>
<hr noshade="">
<br>
<br>
<br>
<font size="3" face="Calibri">Dear IBM and GPFS List,</font><br>
<br>
<font size="3" face="Calibri">we at the Leibniz Supercomputing Centre and our GCS Partners from the Jülich Supercomputing Centre will soon be hitting the current Independent Fileset Limit of 1000 on a number of our GPFS Filesystems.</font><br>
<br>
<font size="3" face="Calibri">There are also a number of RFEs from other users open, that target this limitation:</font><br>
<a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=56780" id="LPlnk864446" previewremoved="true"><font size="3" color="blue" face="Calibri"><u>https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=56780</u></font></a>
<div id="LPBorder_GT_15339140951280.6931749780785109" style="margin-bottom: 20px; overflow: auto; width: 100%; text-indent: 0px;">
<table id="LPContainer_15339140951270.22351227563352905" role="presentation" cellspacing="0" style="width: 90%; background-color: rgb(255, 255, 255); position: relative; overflow: auto; padding-top: 20px; padding-bottom: 20px; margin-top: 20px; border-top-width: 1px; border-top-style: dotted; border-top-color: rgb(200, 200, 200); border-bottom-width: 1px; border-bottom-style: dotted; border-bottom-color: rgb(200, 200, 200);">
<tbody>
<tr valign="top" style="border-spacing: 0px;">
<td id="TextCell_15339140951280.1689039595899" colspan="2" style="vertical-align: top; position: relative; padding: 0px; display: table-cell;">
<div id="LPRemovePreviewContainer_15339140951280.8383665429843578"></div>
<div id="LPTitle_15339140951280.5940573507750396" style="top: 0px; color: rgb(0, 120, 215); font-weight: normal; font-size: 21px; font-family: wf_segoe-ui_light, "Segoe UI Light", "Segoe WP Light", "Segoe UI", "Segoe WP", Tahoma, Arial, sans-serif; line-height: 21px;">
<a id="LPUrlAnchor_15339140951280.8984653875385452" href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=56780" target="_blank" style="text-decoration: none;">Sign up for an IBM account</a></div>
<div id="LPMetadata_15339140951280.05086185600997517" style="margin: 10px 0px 16px; color: rgb(102, 102, 102); font-weight: normal; font-family: wf_segoe-ui_normal, "Segoe UI", "Segoe WP", Tahoma, Arial, sans-serif; font-size: 14px; line-height: 14px;">
www.ibm.com</div>
<div id="LPDescription_15339140951280.06752571013458131" style="display: block; color: rgb(102, 102, 102); font-weight: normal; font-family: wf_segoe-ui_normal, "Segoe UI", "Segoe WP", Tahoma, Arial, sans-serif; font-size: 14px; line-height: 20px; max-height: 100px; overflow: hidden;">
IBM account registration</div>
</td>
</tr>
</tbody>
</table>
</div>
<br>
<br>
<a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=56780"></a><a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=120534"><font size="3" face="Calibri">https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=120534</font></a><font size="3" color="blue" face="Calibri"><u><br>
</u></font><a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=106530"><font size="3" color="blue" face="Calibri"><u>https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=106530</u></font></a><br>
<a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=85282"><font size="3" color="blue" face="Calibri"><u>https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=85282</u></font></a><font size="3" face="Calibri"><br>
</font><br>
<font size="3" face="Calibri">I know GPFS Development was very busy fulfilling the CORAL requirements but maybe now there is again some time to improve something else.
</font><br>
<br>
<font size="3" face="Calibri">If there are any other users on the list that are approaching the current limitation in independent filesets, please take some time and vote for the RFEs above.</font><br>
<br>
<font size="3" face="Calibri">Many thanks in advance and have a nice weekend.</font><br>
<font size="3" face="Calibri">Best Regards,</font><br>
<font size="3" face="Calibri">Stephan Peinkofer</font><br>
<br>
<tt><font size="2">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
</font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size="2">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size="2"><br>
</font></tt><br>
<br>
</div>
<br>
</div>
</div>
</div>
</div>
</body>
</html>