<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Segoe UI";
panose-1:2 11 5 2 4 2 4 2 2 3;}
@font-face
{font-family:"Segoe UI Light";
panose-1:2 11 5 2 4 2 4 2 2 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
tt
{mso-style-priority:99;
font-family:"Courier New";}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle23
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Just as a follow up to my own note, <span style="font-size:12.0pt;color:black">
Stephan, already provided a list of existing RFEs from which to vote through the IBM RFE site, cheers,<o:p></o:p></span></p>
<p class="MsoNormal">-Bryan<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> gpfsug-discuss-bounces@spectrumscale.org <gpfsug-discuss-bounces@spectrumscale.org>
<b>On Behalf Of </b>Bryan Banister<br>
<b>Sent:</b> Friday, August 10, 2018 10:51 AM<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject:</b> Re: [gpfsug-discuss] GPFS Independent Fileset Limit<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><em><span style="font-size:8.5pt;font-family:"Verdana",sans-serif;color:#333333">Note: External Email</span></em><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="3" width="100%" align="center">
</div>
<p class="MsoNormal">This is definitely a great candidate for a RFE, if one does not already exist.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Not to try and contradict by friend Olaf here, but I have been talking a lot with those internal to IBM, and the PMR process is for finding and correcting operational problems with the code level you are running, and closing out the PMR
as quickly as possible. PMRs are not the vehicle for getting substantive changes and enhancements made to the product in general, which the RFE process is really the main way to do this.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I just got off a call with Kristie and Carl about the RFE process and those on the list may know that we are working to improve this overall process. More will be sent out about this in the near future!! So I thought I would chime in
on this discussion here to hopefully help us understand how important the RFE (admittedly currently got great) process really is and will be a great way to work together on these common goals and needs for the product we rely so heavily upon!<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Cheers!!<o:p></o:p></p>
<p class="MsoNormal">-Bryan<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">
gpfsug-discuss-bounces@spectrumscale.org</a> <<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a>>
<b>On Behalf Of </b>Peinkofer, Stephan<br>
<b>Sent:</b> Friday, August 10, 2018 10:40 AM<br>
<b>To:</b> gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a>><br>
<b>Subject:</b> Re: [gpfsug-discuss] GPFS Independent Fileset Limit<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><em><span style="font-size:8.5pt;font-family:"Verdana",sans-serif;color:#333333">Note: External Email</span></em><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="3" width="100%" align="center">
</div>
<div id="divtagdefaultwrapper">
<p><span style="font-size:12.0pt;color:black">Dear Olaf,<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p><span style="font-size:12.0pt;color:black">I know that this is "just" a "support" limit. However Sven some day on a UG meeting in Ehningen told me that there is more to this than just<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black">adjusting your QA qualification tests since the way it is implemented today does not really scale ;). <o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black">That's probably the reason why you said you see sometimes problems when you are not even close to the limit.<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p><span style="font-size:12.0pt;color:black">So if you look at the 250PB Alpine file system of Summit today, that is what's going to deployed at more than one site world wide in 2-4 years and<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black">imho independent filesets are a great way to make this large systems much more handy while still maintaining a unified namespace.<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black">So I really think it would be beneficial if the architectural limit that prevents scaling the number of independent filesets could be removed at all.<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">Best Regards, <o:p>
</o:p></span></p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:12.0pt;color:black">Stephan Peinkofer<o:p></o:p></span></p>
<div>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:12.0pt;color:black">
<hr size="3" width="98%" align="center">
</span></div>
<div id="divRplyFwdMsg">
<p class="MsoNormal"><b><span style="color:black">From:</span></b><span style="color:black">
<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a> <<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a>> on behalf of Olaf Weiser <<a href="mailto:olaf.weiser@de.ibm.com">olaf.weiser@de.ibm.com</a>><br>
<b>Sent:</b> Friday, August 10, 2018 2:51 PM<br>
<b>To:</b> gpfsug main discussion list<br>
<b>Cc:</b> <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a>; Doris Franke; Uwe Tron; Dorian Krause<br>
<b>Subject:</b> Re: [gpfsug-discuss] GPFS Independent Fileset Limit</span><span style="font-size:12.0pt;color:black">
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"> <o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">Hallo Stephan,
</span><span style="font-size:12.0pt;color:black"><o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">the limit is not a hard coded limit - technically spoken, you can raise it easily.
</span><span style="font-size:12.0pt;color:black"><br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">But as always, it is a question of test 'n support ..
</span><span style="font-size:12.0pt;color:black"><br>
<br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">I've seen customer cases, where the use of much smaller amount of independent filesets generates a lot performance issues, hangs ... at least noise and partial trouble ..
</span><span style="font-size:12.0pt;color:black"><br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">it might be not the case with your specific workload, because due to the fact, that you 're running already close to 1000 ...</span><span style="font-size:12.0pt;color:black"><br>
<br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">I suspect , this number of 1000 file sets - at the time of introducing it - was as also just that one had to pick a number...
</span><span style="font-size:12.0pt;color:black"><br>
<br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">... turns out.. that a general commitment to support > 1000 ind.fileset is more or less hard.. because what uses cases should we test / support</span><span style="font-size:12.0pt;color:black"><br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">I think , there might be a good chance for you , that for your specific workload, one would allow and support more than 1000
</span><span style="font-size:12.0pt;color:black"><br>
<br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">do you still have a PMR for your side for this ? - if not - I know .. open PMRs is an additional ...but could you please ..
</span><span style="font-size:12.0pt;color:black"><br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">then we can decide .. if raising the limit is an option for you ..
</span><span style="font-size:12.0pt;color:black"><br>
<br>
<br>
<br>
<br>
<br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">Mit freundlichen Grüßen / Kind regards</span><span style="font-size:12.0pt;color:black"><br>
<br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black"> <br>
Olaf Weiser<br>
<br>
EMEA Storage Competence Center Mainz, German / IBM Systems, Storage Platform,<br>
-------------------------------------------------------------------------------------------------------------------------------------------<br>
IBM Deutschland<br>
IBM Allee 1<br>
71139 Ehningen<br>
Phone: +49-170-579-44-66<br>
E-Mail: <a href="mailto:olaf.weiser@de.ibm.com">olaf.weiser@de.ibm.com</a><br>
-------------------------------------------------------------------------------------------------------------------------------------------<br>
IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter<br>
Geschäftsführung: Martina Koederitz (Vorsitzende), Susanne Peter, Norbert Janzen, Dr. Christian Keller, Ivo Koerner, Markus Koerner<br>
Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940
</span><span style="font-size:12.0pt;color:black"><br>
<br>
<br>
<br>
</span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">From: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black">"Peinkofer, Stephan" <<a href="mailto:Stephan.Peinkofer@lrz.de">Stephan.Peinkofer@lrz.de</a>></span><span style="font-size:12.0pt;color:black"><br>
</span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">To: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a>></span><span style="font-size:12.0pt;color:black"><br>
</span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Cc: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black">Doris Franke <<a href="mailto:doris.franke@de.ibm.com">doris.franke@de.ibm.com</a>>,
Uwe Tron <<a href="mailto:utron@lenovo.com">utron@lenovo.com</a>>, Dorian Krause <<a href="mailto:d.krause@fz-juelich.de">d.krause@fz-juelich.de</a>></span><span style="font-size:12.0pt;color:black"><br>
</span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Date: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black">08/10/2018 01:29 PM</span><span style="font-size:12.0pt;color:black"><br>
</span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Subject: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black">[gpfsug-discuss] GPFS Independent Fileset Limit</span><span style="font-size:12.0pt;color:black"><br>
</span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F">Sent by: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black"><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a></span><span style="font-size:12.0pt;color:black"><o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:12.0pt;color:black">
<hr size="3" width="100%" noshade="" style="color:#A0A0A0" align="center">
</span></div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><br>
<br>
<br>
Dear IBM and GPFS List,<br>
<br>
we at the Leibniz Supercomputing Centre and our GCS Partners from the Jülich Supercomputing Centre will soon be hitting the current Independent Fileset Limit of 1000 on a number of our GPFS Filesystems.<br>
<br>
There are also a number of RFEs from other users open, that target this limitation:<br>
<a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=56780">https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=56780</a>
<o:p></o:p></span></p>
<div style="margin-bottom:15.0pt;overflow:auto" id="LPBorder_GT_15339140951280.6931749780785109">
<table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="90%" style="width:90.0%;background:white;border-top:dotted #C8C8C8 1.0pt;border-left:none;border-bottom:dotted #C8C8C8 1.0pt;border-right:none">
<tbody>
<tr>
<td valign="top" style="border:none;padding:0in 0in 0in 0in">
<div id="LPTitle_15339140951280.5940573507750396">
<p class="MsoNormal" style="margin-top:15.0pt;mso-line-height-alt:15.75pt"><span style="font-size:16.0pt;font-family:"Segoe UI Light",sans-serif;color:#0078D7"><a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=56780" target="_blank"><span style="text-decoration:none">Sign
up for an IBM account</span></a><o:p></o:p></span></p>
</div>
<div style="margin-top:7.5pt;margin-bottom:12.0pt" id="LPMetadata_15339140951280.05086185600997517">
<p class="MsoNormal" style="margin-top:15.0pt;line-height:10.5pt"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:#666666"><a href="http://www.ibm.com">www.ibm.com</a><o:p></o:p></span></p>
</div>
<div id="LPDescription_15339140951280.06752571013458131">
<p class="MsoNormal" style="margin-top:15.0pt;line-height:15.0pt"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;color:#666666">IBM account registration<o:p></o:p></span></p>
</div>
</td>
</tr>
</tbody>
</table>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:12.0pt;color:black"><br>
<br>
<a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=120534">https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=120534</a></span><u><span style="font-size:12.0pt;color:blue"><br>
</span></u><span style="font-size:12.0pt;color:black"><a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=106530">https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=106530</a><br>
<a href="https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=85282">https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=85282</a><br>
<br>
I know GPFS Development was very busy fulfilling the CORAL requirements but maybe now there is again some time to improve something else.
<br>
<br>
If there are any other users on the list that are approaching the current limitation in independent filesets, please take some time and vote for the RFEs above.<br>
<br>
Many thanks in advance and have a nice weekend.<br>
Best Regards,<br>
Stephan Peinkofer<br>
<br>
</span><tt><span style="font-size:10.0pt;color:black">_______________________________________________</span></tt><span style="font-size:10.0pt;font-family:"Courier New";color:black"><br>
<tt>gpfsug-discuss mailing list</tt><br>
<tt>gpfsug-discuss at spectrumscale.org</tt><br>
</span><span style="font-size:12.0pt;color:black"><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><span style="font-size:10.0pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="3" width="100%" align="center">
</div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:gray"><br>
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential, or privileged information and/or personal data. If you are not the intended recipient, you are hereby notified that any review, dissemination,
or copying of this email is strictly prohibited, and requested to notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees
as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request, or solicitation of any kind to buy, sell, subscribe, redeem, or perform any type of
transaction of a financial product. Personal data, as defined by applicable data privacy laws, contained in this email may be processed by the Company, and any of its affiliated or related companies, for potential ongoing compliance and/or business-related
purposes. You may have rights regarding your personal data; for information on exercising these rights or the Company’s treatment of personal data, please email
<a href="mailto:datarequests@jumptrading.com">datarequests@jumptrading.com</a>. </span>
<o:p></o:p></p>
</div>
<br>
<hr>
<font face="Arial" color="Gray" size="1"><br>
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential, or privileged information and/or personal data. If you are not the intended recipient, you are hereby notified that any review, dissemination,
or copying of this email is strictly prohibited, and requested to notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees
as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request, or solicitation of any kind to buy, sell, subscribe, redeem, or perform any type of
transaction of a financial product. Personal data, as defined by applicable data privacy laws, contained in this email may be processed by the Company, and any of its affiliated or related companies, for potential ongoing compliance and/or business-related
purposes. You may have rights regarding your personal data; for information on exercising these rights or the Company’s treatment of personal data, please email datarequests@jumptrading.com.
<br>
</font>
</body>
</html>