<font size=2 face="sans-serif">Hallo Heiner,</font><br><br><font size=2 face="sans-serif">answers inline </font><br><br><font size=1 face="Arial"><br>Mit freundlichen Grüßen / Kind regards</font><p><font size=2 face="Arial"><b>Achim Rehor</b></font><p><table width=600 style="border-collapse:collapse;"><tr height=8><td width=600 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><tr height=8><td width=600 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial"> </font><tr height=8><td width=496 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial">Software
Technical Support Specialist AIX/ Emea HPC Support</font><td width=103 rowspan=10 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=right><img align=bottom src=cid:_1_DBAF00DCDBAEFB5C0032E679C12582D8 style="border:0px solid;"></div><tr height=8><td width=496 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial">IBM
Certified Advanced Technical Expert - Power Systems with AIX</font><tr height=8><td width=496 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial">TSCC
Software Service, Dept. 7922</font><tr height=8><td width=496 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial">Global
Technology Services </font><tr height=8><td width=496 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><tr height=8><td width=44 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">Phone:</font><td width=197 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">+49-7034-274-7862</font><td width=255 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> IBM
Deutschland</font><tr height=8><td width=44 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">E-Mail:</font><td width=197 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial">Achim.Rehor@de.ibm.com</font><td width=255 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> Am
Weiher 24</font><tr height=8><td width=44 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=197 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=255 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> 65451
Kelsterbach</font><tr height=8><td width=44 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=197 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=255 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> Germany</font><tr height=8><td width=44 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=197 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><td width=255 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#0060a0 face="Arial"> </font><tr height=8><td width=600 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><tr height=8><td width=600 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial"> </font><tr height=8><td width=600 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#a2a2a2 face="Arial">IBM
Deutschland GmbH / Vorsitzender des Aufsichtsrats: Martin Jetter <br>Geschäftsführung: Martin Hartmann (Vorsitzender), Norbert Janzen, Stefan
Lutz, Nicole Reimer, Dr. Klaus Seifert, Wolfgang Wendt <br>Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart,
HRB 14562 WEEE-Reg.-Nr. DE 99369940 </font></table><br><p><font size=3> </font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">"Billich Heinrich
Rainer (PSI)" <heiner.billich@psi.ch></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">gpfsug main discussion
list <gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">27/07/2018 18:50</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">Re: [gpfsug-discuss]
control which hosts become token manager</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=2 face="sans-serif">Hello,</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">So probably I was wrong from the beginning
– please can somebody clarify: In a multicluster environment with
all storage and filesystem hosted by a single cluster all token managers
will reside in this central cluster?</font><br><font size=2 face="sans-serif">A: yes, as it cannot be guarantedd that
'mounting' remote clusters can communicate directly with each other, the
token handling must be kept at the owning side.</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Or are there also token managers in
the storage-less clusters which just mount? This managers wouldn’t be
accessible by all nodes which access the file system, hence I doubt this
exists.</font><br><font size=2 face="sans-serif">A: metanode ownership is with the node
opening the file, however token managers are cetnraliized in that multicluster
environment </font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Still it would be nice to know how to
influence the token manager placement and how to exclude certain machines.
And the output of ‘mmdiag –tokenmgr’ indicates that there _<i>are</i>_
token manager in the remote-mounting cluster – confusing.</font><br><font size=2 face="sans-serif">A: if so, that would (in my eyes) need
to be clarified with a PMR .. (or Salesforce Ticket ;) ) , best shown
by a short trace on running the mmdiag --tokenmanager command.</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">I would greatly appreciate if somebody
could sort this out. A point to the relevant documentation would also be
welcome. </font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Thank you & Kind regards,</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Heiner</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">--</font><br><font size=2 face="sans-serif">Paul Scherrer Institut</font><br><font size=2 face="sans-serif">Science IT</font><br><font size=2 face="sans-serif">Heiner Billich</font><br><font size=2 face="sans-serif">WHGA 106</font><br><font size=2 face="sans-serif">CH 5232 Villigen PSI</font><br><font size=2 face="sans-serif">056 310 36 02</font><br><a href="https://www.psi.ch/"><font size=2 face="sans-serif">https://www.psi.ch</font></a><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif"> </font><br><font size=3 face="sans-serif"><b>From: </b><gpfsug-discuss-bounces@spectrumscale.org>
on behalf of "Billich Heinrich Rainer (PSI)" <heiner.billich@psi.ch><b><br>Reply-To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Date: </b>Friday 27 July 2018 at 17:33<b><br>To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Subject: </b>Re: [gpfsug-discuss] control which hosts become token manager</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Thank you,</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">The cluster was freshly set up and the
VM node never was denoted as manager, it was created as quorum-client.
What I didn’t mention but probably should have: This is a multicluster
mount, the cluster has no own storage. Hence the filesystem manager are
on the home cluster, according to mmlsmgr. Hm, probably more complicated
as I initially thought. Still I would expect that for file-access that
is restricted to this cluster all token management is handled inside the
cluster, too? And I don’t want the weakest node to participate.</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Kind regards,</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Heiner</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">--</font><br><font size=2 face="sans-serif">Paul Scherrer Institut</font><br><font size=2 face="sans-serif">Science IT</font><br><font size=2 face="sans-serif">Heiner Billich</font><br><font size=2 face="sans-serif">WHGA 106</font><br><font size=2 face="sans-serif">CH 5232 Villigen PSI</font><br><font size=2 face="sans-serif">056 310 36 02</font><br><a href="https://www.psi.ch/"><font size=2 face="sans-serif">https://www.psi.ch</font></a><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif"> </font><br><font size=3 face="sans-serif"><b>From: </b><gpfsug-discuss-bounces@spectrumscale.org>
on behalf of Bryan Banister <bbanister@jumptrading.com><b><br>Reply-To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Date: </b>Tuesday 24 July 2018 at 23:12<b><br>To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Subject: </b>Re: [gpfsug-discuss] control which hosts become token manager</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Agree with Peter here. And if
the file system and workload are of significant size then isolating the
token manager to a dedicated node is definitely best practice.</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Unfortunately there isn’t a way to
specify a preferred manager per FS… (Bryan starts typing up a new RFE…).</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Cheers,</font><br><font size=2 face="sans-serif">-Bryan</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif"><b>From:</b> gpfsug-discuss-bounces@spectrumscale.org
<gpfsug-discuss-bounces@spectrumscale.org> <b>On Behalf Of </b>Peter
Childs<b><br>Sent:</b> Tuesday, July 24, 2018 2:29 PM<b><br>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Subject:</b> Re: [gpfsug-discuss] control which hosts become token manager</font><br><font size=3 face="sans-serif"> </font><br><font size=1 color=#2f2f2f face="Verdana"><i>Note: External Email</i></font><div align=center><hr></div><br><font size=2 face="sans-serif"><br>What does mmlsmgr show?<br><br>Your config looks fine.<br><br>I suspect you need to do a <br><br>mmchmgr perf </font><a href="http://node-1.psi.ch"><font size=2 color=#0082bf face="sans-serif"><u>node-1.psi.ch</u></font></a><font size=2 face="sans-serif"><br>mmchmgr tiered </font><a href="http://node-2.psi.ch"><font size=2 color=#0082bf face="sans-serif"><u>node-2.psi.ch</u></font></a><font size=2 face="sans-serif"><br><br>It looks like the node was set up as a manager and was demoted to just
quorum but since its still currently the manager it needs to be told to
stop.<br><br>From experience it's also worth having different file system managers on
different nodes, if at all possible.<br><br>But that's just a guess without seeing the output of mmlsmgr.<br><br><br>Peter Childs<br>Research Storage<br>ITS Research and Teaching Support<br>Queen Mary, University of London<br><br><br>---- Billich Heinrich Rainer (PSI) wrote ----</font><br><font size=2 face="sans-serif">Hello,</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">I want to control which nodes can become
token manager. In detail I run a virtual machine as quorum node. I don’t
want this machine to become a token manager - it has no access to Infiniband
and only very limited memory. </font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">What I see is that ‘mmdiag –tokenmgr’
lists the machine as active token manager. The machine has role ‘quorum-client’.
This doesn’t seem sufficient to exclude it.</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Is there any way to tell spectrum scale
to exclude this single machine with role quorum-client? </font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">I run 5.0.1-1. </font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Sorry if this is a faq, I did search
quite a bit before I wrote to the list.</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Thank you,</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Heiner Billich</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">[root@node-2 ~]# mmlscluster</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">GPFS cluster information</font><br><font size=2 face="sans-serif">========================</font><br><font size=2 face="sans-serif"> GPFS cluster name:
node.psi.ch</font><br><font size=2 face="sans-serif"> GPFS cluster id:
5389874024582403895</font><br><font size=2 face="sans-serif"> GPFS UID domain:
node.psi.ch</font><br><font size=2 face="sans-serif"> Remote shell command:
/usr/bin/ssh</font><br><font size=2 face="sans-serif"> Remote file copy command: /usr/bin/scp</font><br><font size=2 face="sans-serif"> Repository type:
CCR</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">Node Daemon node name
IP address Admin node name Designation</font><br><font size=2 face="sans-serif">--------------------------------------------------------------------------------</font><br><font size=2 face="sans-serif"> 1 node-1.psi.ch
a.b.95.31 node-1.psi.ch
quorum-manager</font><br><font size=2 face="sans-serif"> 2 node-2.psi.ch
a.b.95.32 node-2.psi.ch
quorum-manager</font><br><font size=2 face="sans-serif"> 3 node-quorum.psi.ch
a.b.95.30 node-quorum.psi.ch quorum
<<<<
VIRTUAL MACHINE >>>>>>>>></font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">[root@node-2 ~]# mmdiag --tokenmgr</font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">=== mmdiag: tokenmgr ===</font><br><font size=2 face="sans-serif"> Token Domain perf</font><br><font size=2 face="sans-serif"> There are 3 active token
servers in this domain.</font><br><font size=2 face="sans-serif"> Server list:</font><br><font size=2 face="sans-serif"> a.b.95.120</font><br><font size=2 face="sans-serif"> a.b.95.121</font><br><font size=2 face="sans-serif"> a.b.95.122
<<<< VIRTUAL MACHINE >>>>>>>>></font><br><font size=2 face="sans-serif"> Token Domain tiered</font><br><font size=2 face="sans-serif"> There are 3 active token
servers in this domain.</font><br><font size=2 face="sans-serif"> Server list:</font><br><font size=2 face="sans-serif"> a.b.95.120</font><br><font size=2 face="sans-serif"> a.b.95.121</font><br><font size=2 face="sans-serif"> a.b.95.122
<<<< VIRTUAL MACHINE >>>>>>>>></font><br><font size=2 face="sans-serif"> </font><br><font size=2 face="sans-serif">--</font><br><font size=2 face="sans-serif">Paul Scherrer Institut</font><br><font size=2 face="sans-serif">Science IT</font><br><font size=2 face="sans-serif">Heiner Billich</font><br><font size=2 face="sans-serif">WHGA 106</font><br><font size=2 face="sans-serif">CH 5232 Villigen PSI</font><br><font size=2 face="sans-serif">056 310 36 02</font><br><a href="https://www.psi.ch"><font size=2 color=#0082bf face="sans-serif"><u>https://www.psi.ch</u></font></a><br><font size=3 face="sans-serif"> </font><br><font size=2 face="sans-serif"> </font><div align=center><hr></div><br><font size=1 color=#808080 face="Arial"><br>Note: This email is for the confidential use of the named addressee(s)
only and may contain proprietary, confidential, or privileged information
and/or personal data. If you are not the intended recipient, you are hereby
notified that any review, dissemination, or copying of this email is strictly
prohibited, and requested to notify the sender immediately and destroy
this email and any attachments. Email transmission cannot be guaranteed
to be secure or error-free. The Company, therefore, does not make any guarantees
as to the completeness or accuracy of this email or any attachments. This
email is for informational purposes only and does not constitute a recommendation,
offer, request, or solicitation of any kind to buy, sell, subscribe, redeem,
or perform any type of transaction of a financial product. Personal data,
as defined by applicable data privacy laws, contained in this email may
be processed by the Company, and any of its affiliated or related companies,
for potential ongoing compliance and/or business-related purposes. You
may have rights regarding your personal data; for information on exercising
these rights or the Company’s treatment of personal data, please email
datarequests@jumptrading.com. <br><br></font><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size=2><br></font></tt><br><br><BR>