<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
p.msochpdefault, li.msochpdefault, div.msochpdefault
{mso-style-name:msochpdefault;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.emailstyle17
{mso-style-name:emailstyle17;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">Thank you,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">The cluster was freshly set up and the VM node never was denoted as manager, it was created as quorum-client. What I didn’t mention but probably should have: This is a multicluster mount, the cluster has no
own storage. Hence the filesystem manager are on the home cluster, according to mmlsmgr. Hm, probably more complicated as I initially thought. Still I would expect that for file-access that is restricted to this cluster all token management is handled inside
the cluster, too? And I don’t want the weakest node to participate.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Kind regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Heiner<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt">--<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Paul Scherrer Institut<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Science IT<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Heiner Billich<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">WHGA 106<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">CH 5232 Villigen PSI<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">056 310 36 02<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">https://www.psi.ch<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="color:black">From: </span></b><span style="color:black"><gpfsug-discuss-bounces@spectrumscale.org> on behalf of Bryan Banister <bbanister@jumptrading.com><br>
<b>Reply-To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Date: </b>Tuesday 24 July 2018 at 23:12<br>
<b>To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject: </b>Re: [gpfsug-discuss] control which hosts become token manager<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt">Agree with Peter here. And if the file system and workload are of significant size then isolating the token manager to a dedicated node is definitely best practice.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Unfortunately there isn’t a way to specify a preferred manager per FS… (Bryan starts typing up a new RFE…).</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Cheers,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">-Bryan</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:11.0pt">From:</span></b><span style="font-size:11.0pt"> gpfsug-discuss-bounces@spectrumscale.org <gpfsug-discuss-bounces@spectrumscale.org>
<b>On Behalf Of </b>Peter Childs<br>
<b>Sent:</b> Tuesday, July 24, 2018 2:29 PM<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject:</b> Re: [gpfsug-discuss] control which hosts become token manager</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><em><span style="font-size:8.5pt;font-family:"Verdana",sans-serif;color:#333333">Note: External Email</span></em><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:11.0pt">
<hr size="6" width="100%" align="center">
</span></div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:11.0pt"><br>
What does mmlsmgr show?<br>
<br>
Your config looks fine.<br>
<br>
I suspect you need to do a <br>
<br>
mmchmgr perf <a href="http://node-1.psi.ch">node-1.psi.ch</a><br>
mmchmgr tiered <a href="http://node-2.psi.ch">node-2.psi.ch</a><br>
<br>
It looks like the node was set up as a manager and was demoted to just quorum but since its still currently the manager it needs to be told to stop.<br>
<br>
From experience it's also worth having different file system managers on different nodes, if at all possible.<br>
<br>
But that's just a guess without seeing the output of mmlsmgr.<br>
<br>
<br>
Peter Childs<br>
Research Storage<br>
ITS Research and Teaching Support<br>
Queen Mary, University of London<br>
<br>
<br>
---- Billich Heinrich Rainer (PSI) wrote ----</span><o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt">Hello,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I want to control which nodes can become token manager. In detail I run a virtual machine as quorum node. I don’t want this machine to become a token manager - it has no access to Infiniband and only very
limited memory. </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">What I see is that ‘mmdiag –tokenmgr’ lists the machine as active token manager. The machine has role ‘quorum-client’. This doesn’t seem sufficient to exclude it.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Is there any way to tell spectrum scale to exclude this single machine with role quorum-client?
</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">I run 5.0.1-1. </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Sorry if this is a faq, I did search quite a bit before I wrote to the list.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Thank you,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Heiner Billich</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">[root@node-2 ~]# mmlscluster</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">GPFS cluster information</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">========================</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> GPFS cluster name: node.psi.ch</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> GPFS cluster id: 5389874024582403895</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> GPFS UID domain: node.psi.ch</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> Remote shell command: /usr/bin/ssh</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> Remote file copy command: /usr/bin/scp</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> Repository type: CCR</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Node Daemon node name IP address Admin node name Designation</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">--------------------------------------------------------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> 1 node-1.psi.ch a.b.95.31 node-1.psi.ch quorum-manager</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> 2 node-2.psi.ch a.b.95.32 node-2.psi.ch quorum-manager</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> 3 node-quorum.psi.ch a.b.95.30 node-quorum.psi.ch quorum <<<< VIRTUAL MACHINE >>>>>>>>></span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">[root@node-2 ~]# mmdiag --tokenmgr</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">=== mmdiag: tokenmgr ===</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> Token Domain perf</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> There are 3 active token servers in this domain.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> Server list:</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> a.b.95.120</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> a.b.95.121</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> a.b.95.122 <<<< VIRTUAL MACHINE >>>>>>>>></span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> Token Domain tiered</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> There are 3 active token servers in this domain.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> Server list:</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> a.b.95.120</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> a.b.95.121</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> a.b.95.122 <<<< VIRTUAL MACHINE >>>>>>>>></span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">--</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Paul Scherrer Institut</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Science IT</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Heiner Billich</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">WHGA 106</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">CH 5232 Villigen PSI</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt">056 310 36 02</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><a href="https://www.psi.ch">https://www.psi.ch</a></span><o:p></o:p></p>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:11.0pt">
<hr size="0" width="100%" align="center">
</span></div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:gray"><br>
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential, or privileged information and/or personal data. If you are not the intended recipient, you are hereby notified that any review, dissemination,
or copying of this email is strictly prohibited, and requested to notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees
as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request, or solicitation of any kind to buy, sell, subscribe, redeem, or perform any type of
transaction of a financial product. Personal data, as defined by applicable data privacy laws, contained in this email may be processed by the Company, and any of its affiliated or related companies, for potential ongoing compliance and/or business-related
purposes. You may have rights regarding your personal data; for information on exercising these rights or the Company’s treatment of personal data, please email datarequests@jumptrading.com.
<br>
<br>
</span><span style="font-size:11.0pt"><o:p></o:p></span></p>
</div>
</body>
</html>