<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
tt
{mso-style-priority:99;
font-family:"Courier New";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:70.85pt 70.85pt 56.7pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Daniel –in our environment we have data and metadata split out onto separate drives in separate servers. We also set the GPFS parameter “mmchconfig defaultHelperNodes=”list_of_metadata_servers”
which will automatically only use these nodes for the scan for restriping/rebalancing data (rather than having to specify the –N option). This dramatically reduced the impact to clients accessing the data nodes while these activities are taking place. Also
using SSDs for metadata nodes can make a big improvement.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Chris<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> gpfsug-discuss-bounces@gpfsug.org [mailto:gpfsug-discuss-bounces@gpfsug.org]
<b>On Behalf Of </b>Daniel Vogel<br>
<b>Sent:</b> Thursday, July 02, 2015 8:13 AM<br>
<b>To:</b> 'gpfsug main discussion list'<br>
<b>Subject:</b> Re: [gpfsug-discuss] GPFS 4.1.1 without QoS for mmrestripefs?<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Sven,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Yes I agree, but “using –N” to reduce the load helps not really. If I use NFS, for example, as a ESX data store, ESX I/O latency for NFS goes very
high, the VM’s hangs. By the way I use SSD PCIe cards, perfect “mirror speed” but slow I/O on NFS.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">The GPFS cluster concept I use are different than GSS or traditional FC (shared storage). I use shared nothing with IB (no FPO), many GPFS nodes
with NSD’s. I know the need to resync the FS with mmchdisk / mmrestripe will happen more often. The only one feature will help is QoS for the GPFS admin jobs. I hope we are not fare away from this.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-GB" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Daniel<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="DE-CH" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="DE-CH" style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span lang="DE" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">Von:</span></b><span lang="DE" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">
<a href="mailto:gpfsug-discuss-bounces@gpfsug.org">gpfsug-discuss-bounces@gpfsug.org</a> [<a href="mailto:gpfsug-discuss-bounces@gpfsug.org">mailto:gpfsug-discuss-bounces@gpfsug.org</a>]
<b>Im Auftrag von </b>Sven Oehme<br>
<b>Gesendet:</b> Mittwoch, 1. Juli 2015 16:21<br>
<b>An:</b> gpfsug main discussion list<br>
<b>Betreff:</b> Re: [gpfsug-discuss] GPFS 4.1.1 without QoS for mmrestripefs?<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="DE-CH"><o:p> </o:p></span></p>
<p><span lang="DE-CH">Daniel,<br>
<br>
as you know, we can't discuss future / confidential items on a mailing list. <br>
what i presented as an outlook to future releases hasn't changed from a technical standpoint, we just can't share a release date until we announce it official.<br>
there are multiple ways today to limit the impact on restripe and other tasks, the best way to do this is to run the task ( using -N) on a node (or very small number of nodes) that has no performance critical role. while this is not perfect, it should limit
the impact significantly. .<br>
<br>
sven<br>
<br>
------------------------------------------<br>
Sven Oehme <br>
Scalable Storage Research <br>
email: <a href="mailto:oehmes@us.ibm.com">oehmes@us.ibm.com</a> <br>
Phone: +1 (408) 824-8904 <br>
IBM Almaden Research Lab <br>
------------------------------------------<br>
<br>
<img border="0" width="16" height="16" id="_x0000_i1025" src="cid:image001.gif@01D0B49F.8F9C9DB0" alt="Inactive hide details for Daniel Vogel ---07/01/2015 03:29:11 AM---Hi Years ago, IBM made some plan to do a implementation "QoS"><span style="color:#424282">Daniel
Vogel ---07/01/2015 03:29:11 AM---Hi Years ago, IBM made some plan to do a implementation "QoS for mmrestripefs, mmdeldisk...". If a "</span><br>
<br>
</span><span lang="DE-CH" style="font-size:10.0pt;color:#5F5F5F">From: </span><span lang="DE-CH" style="font-size:10.0pt">Daniel Vogel <<a href="mailto:Daniel.Vogel@abcsystems.ch">Daniel.Vogel@abcsystems.ch</a>></span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-size:10.0pt;color:#5F5F5F">To: </span><span lang="DE-CH" style="font-size:10.0pt">"'gpfsug-discuss@gpfsug.org'" <<a href="mailto:gpfsug-discuss@gpfsug.org">gpfsug-discuss@gpfsug.org</a>></span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-size:10.0pt;color:#5F5F5F">Date: </span><span lang="DE-CH" style="font-size:10.0pt">07/01/2015 03:29 AM</span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-size:10.0pt;color:#5F5F5F">Subject: </span>
<span lang="DE-CH" style="font-size:10.0pt">[gpfsug-discuss] GPFS 4.1.1 without QoS for mmrestripefs?</span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-size:10.0pt;color:#5F5F5F">Sent by: </span>
<span lang="DE-CH" style="font-size:10.0pt"><a href="mailto:gpfsug-discuss-bounces@gpfsug.org">gpfsug-discuss-bounces@gpfsug.org</a></span><span lang="DE-CH"><o:p></o:p></span></p>
<div>
<div class="MsoNormal"><span lang="DE-CH">
<hr size="2" width="100%" noshade="" style="color:#8091A5" align="left">
</span></div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span lang="DE-CH"><br>
<br>
<br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">Hi</span><span lang="DE-CH"><br>
<br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">Years ago, IBM made some plan to do a implementation “QoS for mmrestripefs, mmdeldisk…”. If a “mmfsrestripe” is running, very poor performance for NFS access.</span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">I opened a PMR to ask for QoS in version 4.1.1 (Spectrum Scale).</span><span lang="DE-CH"><br>
<br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">PMR 61309,113,848:</span><span lang="DE-CH"><br>
</span><i><span lang="DE-CH" style="font-family:"Arial","sans-serif"">I discussed the question of QOS with the development team. These
<br>
command changes that were noticed are not meant to be used as GA code<br>
which is why they are not documented. I cannot provide any further <br>
information from the support perspective. </span></i><span lang="DE-CH" style="font-family:"Arial","sans-serif""><br>
</span><span lang="DE-CH"><br>
<br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">Anybody knows about QoS? The last hope was at “GPFS Workshop Stuttgart März 2015” with Sven Oehme as speaker.</span><span lang="DE-CH"><br>
<br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">Daniel Vogel</span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">IT Consultant</span><span lang="DE-CH"><br>
<br>
</span><b><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">ABC SYSTEMS AG</span></b><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">Hauptsitz Zürich</span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">Rütistrasse 28</span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">CH - 8952 Schlieren</span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">T +41 43 433 6 433</span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif"">D +41 43 433 6 467</span><span lang="DE-CH"><br>
</span><span lang="DE-CH" style="font-family:"Calibri","sans-serif""><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.abcsystems.ch&d=BQMGaQ&c=j-EkbjBYwkAB4f8ZbVn1Fw&r=nHJv7dxZGfwepdslZ1poUwiWMXw8gczQJteqZqtddrk&m=M-3P0t8gFp_R58kbCJK8n1NcPRdxDCBb6MbVvO7wzdM&s=56myHOAgOopfTF3xisqZ2ejnhqhm9_wTYQ_qoPxmCH0&e=">http://www.abcsystems.ch</a></span><span lang="DE-CH"><br>
<br>
</span><b><i><span lang="DE-CH" style="font-family:"Calibri","sans-serif";color:#1F497D">ABC - A</span></i></b><i><span lang="DE-CH" style="font-family:"Calibri","sans-serif";color:#1F497D">lways
<b>B</b>etter <b>C</b>oncepts. <b>A</b>pproved <b>B</b>y <b>C</b>ustomers since 1981.</span></i><span lang="DE-CH"><br>
</span><tt><span lang="DE-CH" style="font-size:10.0pt">_______________________________________________</span></tt><span lang="DE-CH" style="font-size:10.0pt;font-family:"Courier New""><br>
<tt>gpfsug-discuss mailing list</tt><br>
<tt>gpfsug-discuss at gpfsug.org</tt><br>
<tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=BQMGaQ&c=j-EkbjBYwkAB4f8ZbVn1Fw&r=nHJv7dxZGfwepdslZ1poUwiWMXw8gczQJteqZqtddrk&m=M-3P0t8gFp_R58kbCJK8n1NcPRdxDCBb6MbVvO7wzdM&s=ghMBFWPp_SkgkcFCBfZO6LoCaIaYtUna8VhrFoY_LHM&e=">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><br>
<br>
</span><span lang="DE-CH"><o:p></o:p></span></p>
</div>
</body>
</html>