<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">The cgroups are something we moved onto, which has helped a lot with GPFS Clients responding to necessary GPFS commands demanding a low latency response (e.g.
mmcrsnapshots, byte range locks, quota reporting, etc).<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Good luck!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">-Bryan<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> gpfsug-discuss-bounces@spectrumscale.org [mailto:gpfsug-discuss-bounces@spectrumscale.org]
<b>On Behalf Of </b>Keith Ball<br>
<b>Sent:</b> Thursday, March 29, 2018 11:15 AM<br>
<b>To:</b> gpfsug-discuss@spectrumscale.org<br>
<b>Subject:</b> Re: [gpfsug-discuss] Control of where mmcrsnapshot runs?<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><em><span style="font-size:8.5pt;font-family:"Verdana",sans-serif;color:#333333">Note: External Email</span></em><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="3" width="100%" align="center">
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">You're right, Brian, the key load will be on the filesystem manager in any case, and as you say, all nodes nodes must quiesce - it's not really an issue of where to run the command, like it would be for mmfsck,
etc.<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">GPFS version is 3.5.0.26. We'll investigate upgrade to later version that accommodates combined operations.
<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I will also look into the cgroups approach - is this a documented thing, or just something that people have tinkered with/hand rolled?<o:p></o:p></p>
</div>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
</div>
<p class="MsoNormal"> Keith<o:p></o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Wed, Mar 28, 2018 at 7:00 AM, <<a href="mailto:gpfsug-discuss-request@spectrumscale.org" target="_blank">gpfsug-discuss-</a><o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
What version of GPFS are you running Keith?<br>
<br>
All nodes mounting the file system must briefly quiesce I/O operations during the snapshot create operations, hence the ?Quiescing all file system operations.? message in the output. So don?t really see a way to specify a specific set of nodes for these operations.
They have made updates in newer releases of GPFS to combine operations (e.g. create and delete snapshots at the same time) which IBM says ?system performance is increased by batching operations and reducing overhead.?.<br>
<br>
Trying to isolate GPFS resources (e.g. cgroups) on the clients (e.g. CPU and memory resources dedicated to GPFS/SSH/kernel/networking/etc) can help them respond more quickly to quiesce I/O requests.<br>
<br>
HTH,<br>
-Bryan<br>
<br>
From: <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a> [mailto:<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a>] On Behalf Of Keith Ball<br>
Sent: Tuesday, March 27, 2018 5:26 PM<br>
To: <a href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a><br>
Subject: [gpfsug-discuss] Control of where mmcrsnapshot runs?<br>
<br>
Note: External Email<br>
________________________________<br>
Hi All,<br>
Two questions on snapshots:<br>
1.) I note that neither "mmcrsnapshot" nor "mmdelsnapshot" appear to have an "-N" option as "PIT" commands typically do. Is there any way to control where threads for snapshot creation/deletion run? (I assume the filesystem manager will always be involved regardless).<br>
<br>
2.) When mmdelsnapshot hangs or times out, the error messages tend to appear on client nodes, and not necessarily the node where mmdelsnapshot is run from, not the FS manager. Besides telling all users "don't use any I/O" when runnign these commands, are there
ways that folks have found to avoid hangs and timeouts of mmdelsnapshot?<br>
FWIW our filesystem manager is probably overextended (replication factor 2 on data+MD, 30 daily snapshots kept, a number of client clusters served, plus the FS manager is also an NSD server).<br>
<br>
Many Thanks,<br>
Keith<br>
RedLine Performance Solutions LLC<br>
<br>
________________________________<o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<hr>
<font face="Arial" color="Gray" size="1"><br>
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this
email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness
or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial
product.<br>
</font>
</body>
</html>