<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Tms Rmn";
panose-1:2 2 6 3 4 5 5 2 3 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:slack-lato;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="en-IL" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span lang="en-IL" style="mso-fareast-language:EN-US">Hi<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="en-IL" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="en-IL" style="mso-fareast-language:EN-US">Please review:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="en-IL" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="en-IL" style="mso-fareast-language:EN-US"><a href="https://www.ibm.com/docs/en/storage-scale/5.0.3?topic=recommendations-operating-system-configuration-tuning">https://www.ibm.com/docs/en/storage-scale/5.0.3?topic=recommendations-operating-system-configuration-tuning</a><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="en-IL" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-top:12.0pt;text-autospace:none"><span lang="EN-US" style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">Regards<o:p></o:p></span></p>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="1464" style="width:1098.0pt;border-collapse:collapse">
<tbody>
<tr>
<td width="1464" colspan="4" style="width:1098.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" align="center" style="text-align:center;page-break-after:avoid;text-autospace:none">
<span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black"><o:p> </o:p></span></p>
<p class="MsoNormal" style="margin-top:12.0pt;page-break-after:avoid;text-autospace:none">
<span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:black"><o:p> </o:p></span></p>
</td>
</tr>
<tr>
<td width="1464" colspan="4" style="width:1098.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:1.0pt;font-family:"Arial",sans-serif;color:black"> <o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="606" colspan="2" style="width:454.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:blue">Yaron Daniel<o:p></o:p></span></p>
</td>
<td width="168" style="width:126.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">94 Em Ha'Moshavot Rd<o:p></o:p></span></p>
</td>
<td width="690" rowspan="3" style="width:517.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F"><img border="0" width="87" height="30" style="width:.9083in;height:.3083in" id="Picture_x0020_3" src="cid:image001.png@01DA4E44.A419AE20"><o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="606" colspan="2" style="width:454.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:blue">Storage and Cloud Consultant<o:p></o:p></span></p>
</td>
<td width="168" style="width:126.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">Petach Tiqva, 49527<o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="606" colspan="2" style="width:454.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:11.5pt;font-family:slack-lato;color:blue;background:#F8F8F8">Technology Services</span><span style="font-size:11.5pt;font-family:slack-lato;color:blue"><br>
<span style="background:#F8F8F8">IBM Technology Lifecycle Service</span></span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:blue"><o:p></o:p></span></p>
</td>
<td width="168" style="width:126.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">Israel<o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="606" colspan="2" style="width:454.5pt;padding:0cm 0cm 0cm 0cm"></td>
<td width="168" style="width:126.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F"> <o:p></o:p></span></p>
</td>
<td width="690" style="width:517.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black"> <o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="90" style="width:67.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">Phone:<o:p></o:p></span></p>
</td>
<td width="516" style="width:387.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">+972-3-916-5672<o:p></o:p></span></p>
</td>
<td width="168" style="width:126.0pt;padding:0cm 0cm 0cm 0cm"></td>
<td width="690" style="width:517.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Tms Rmn",serif;color:black"> </span><span style="font-size:10.0pt;font-family:"Tms Rmn",serif;color:black"><o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="90" style="width:67.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">Fax:<o:p></o:p></span></p>
</td>
<td width="516" style="width:387.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">+972-3-916-5672<o:p></o:p></span></p>
</td>
<td width="168" style="width:126.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">
<o:p></o:p></span></p>
</td>
<td width="690" style="width:517.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Tms Rmn",serif;color:black"> </span><span style="font-size:10.0pt;font-family:"Tms Rmn",serif;color:black"><o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="90" style="width:67.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">Mobile:<o:p></o:p></span></p>
</td>
<td width="516" style="width:387.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">+972-52-8395593<o:p></o:p></span></p>
</td>
<td width="168" style="width:126.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">
<o:p></o:p></span></p>
</td>
<td width="690" style="width:517.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Tms Rmn",serif;color:black"> </span><span style="font-size:10.0pt;font-family:"Tms Rmn",serif;color:black"><o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="90" style="width:67.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">e-mail:<o:p></o:p></span></p>
</td>
<td width="516" style="width:387.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F"><a href="mailto:yard@il.ibm.com"><span style="color:#0563C1">yard@il.ibm.com</span></a><o:p></o:p></span></p>
</td>
<td width="168" style="width:126.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:#5F5F5F">
<o:p></o:p></span></p>
</td>
<td width="690" style="width:517.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Tms Rmn",serif;color:black"> </span><span style="font-size:10.0pt;font-family:"Tms Rmn",serif;color:black"><o:p></o:p></span></p>
</td>
</tr>
<tr>
<td width="606" colspan="2" style="width:454.5pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><span style="font-size:10.0pt;font-family:"Tms Rmn",serif;color:black"><a href="webex:%20%20%20%20%20%20%20%20%20%20%20%20https://ibm.webex.com/meet/yard"><span style="font-family:"Arial",sans-serif;text-decoration:none">Webex: </span><span style="font-size:12.0pt;font-family:"Times New Roman",serif;text-decoration:none">https://ibm.webex.com/meet/yard</span></a></span><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:blue"><br>
<a href="webex:%20%20%20%20%20%20%20%20%20%20%20%20%20https://ibm.webex.com/meet/yard%0dIBM%20Israel"><span style="text-decoration:none">IBM Israel</span></a><o:p></o:p></span></p>
</td>
<td width="168" style="width:126.0pt;padding:0cm 0cm 0cm 0cm">
<p class="MsoNormal" style="page-break-after:avoid;text-autospace:none"><u><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:blue"><o:p><span style="text-decoration:none"> </span></o:p></span></u></p>
</td>
<td width="690" style="width:517.5pt;padding:0cm 0cm 0cm 0cm"></td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="en-IL" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> gpfsug-discuss <gpfsug-discuss-bounces@gpfsug.org>
<b>On Behalf Of </b>Jan-Frode Myklebust<br>
<b>Sent:</b> Tuesday, 23 January 2024 21:30<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@gpfsug.org><br>
<b>Subject:</b> [EXTERNAL] Re: [gpfsug-discuss] IBM Flashsystem 7300 HDD sequential write performance issue<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">First thing I would check is that the GPFS block size is a multiple of a full RAID stripe. It’s been a while since I worked with SVC/FlashSystem performance, but
this has been my main issue. So, 8+2p with the default 128KB «chunk size» would <o:p>
</o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerStart<o:p></o:p></span></p>
</div>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%;border-radius:4px">
<tbody>
<tr>
<td style="padding:12.0pt 0cm 12.0pt 0cm">
<table class="MsoNormalTable" border="1" cellspacing="0" cellpadding="0" width="100%" style="width:100.0%;background:#D0D8DC;border:none;border-top:solid #90A4AE 3.0pt">
<tbody>
<tr>
<td valign="top" style="border:none;padding:0cm 7.5pt 3.75pt 4.5pt">
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="left">
<tbody>
<tr>
<td style="padding:3.0pt 6.0pt 3.0pt 6.0pt">
<p class="MsoNormal"><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black">This Message Is From an Untrusted Sender
<o:p></o:p></span></b></p>
</td>
</tr>
<tr>
<td style="padding:3.0pt 6.0pt 3.0pt 6.0pt">
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Arial",sans-serif;color:black">You have not previously corresponded with this sender.
<o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
<table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" align="right">
<tbody>
<tr>
<td style="padding:3.0pt 0cm 3.0pt 0cm">
<p class="MsoNormal"> <a href="https://us-phishalarm-ewt.proofpoint.com/EWT/v1/PjiDSg!12-vrJF3prOyMQWwFOsq4IVI2F5sW_rNmdbw10fUE-83G9qDoqHYRutCSd3L3Y0Et2YfQhxWnsuZhQfbT1dpCZ4bDtks0wi9Fpa3x3wHAwMy-No9_vCZEOUx$" target="_blank"><strong><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black;border:solid #666666 1.0pt;padding:6.0pt;font-weight:normal;text-decoration:none"> Report Suspicious </span></strong></a>
<o:p></o:p></p>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">ZjQcmQRYFpfptBannerEnd<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">First thing I would check is that the GPFS block size is a multiple of a full RAID stripe. It’s been a while since I worked with SVC/FlashSystem performance, but this has been my main issue. So, 8+2p with the default 128KB «chunk size»
would work with 1 MB or larger block size.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">The other thing was that it’s important to disable prefetching (chsystem -cacheprefetch off), as it will always be prefetching the wrong data because of how GPFS scatters the blocks.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">And.. on linux side there’s some max device transfersize setting that has had huge impact on some systems.. But the exact setting escapes me right now..<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">HTH<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"> -jf<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">tir. 23. jan. 2024 kl. 15:05 skrev Petr Plodík <<a href="mailto:petr.plodik@mcomputers.cz">petr.plodik@mcomputers.cz</a>>:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal">Hi, <br>
<br>
we have GPFS cluster with two IBM FlashSystem 7300 systems with HD expansion and 80x 12TB HDD each (in DRAID 8+P+Q), 3 GPFS servers connected via 32G FC. We are doing performance tuning on sequential writes to HDDs and seeing suboptimal performance. After several
tests, it turns out, that the bottleneck seems to be the single HDD write performance, which is below 40MB/s and one would expect at least 100MB/s.<br>
<br>
Does anyone have experiences with IBM flashsystem sequential write performance tuning or has these arrays in the infrastructure? We would really appreciate any help/explanation.<br>
<br>
Thank you!<br>
<br>
Petr Plodik<br>
M Computers s.r.o.<br>
<a href="mailto:petr.plodik@mcomputers.cz" target="_blank">petr.plodik@mcomputers.cz</a><br>
<br>
<br>
<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://gpfsug.org" target="_blank">gpfsug.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a><o:p></o:p></p>
</blockquote>
</div>
</div>
</div>
</body>
</html>