<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body>
<p>Also I found no documentation that advised against having the
gateway role on a nsd server. There was advise to not run the
gateway role on a CES node. What is the recommendation there.
Would a SAN client or shared disk be preferred to keep the latency
down.</p>
<p>Thanks</p>
<p>Matt<br>
</p>
<div class="moz-cite-prefix">On 3/26/20 4:03 AM, Venkateswara R
Puvvada wrote:<br>
</div>
<blockquote type="cite" cite="mid:OF67F98EE2.114EF0BB-ON65258537.003194FF-65258537.0031C81A@notes.na.collabserv.com">
<font size="2" face="sans-serif">Most of these recommendations
documented
in KC, we will add missing information on number of filesets and
inodes
per gateway in the next release.</font><br>
<br>
<a href="https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1ins_gatewaynodefailureafm.htm" moz-do-not-send="true"><font size="2" face="sans-serif" color="blue">https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1ins_gatewaynodefailureafm.htm</font></a><br>
<br>
<font size="2" face="sans-serif">~Venkat (<a class="moz-txt-link-abbreviated" href="mailto:vpuvvada@in.ibm.com">vpuvvada@in.ibm.com</a>)</font><br>
<br>
<br>
<br>
<font size="1" face="sans-serif" color="#5f5f5f">From:
</font><font size="1" face="sans-serif">Matt Weil
<a class="moz-txt-link-rfc2396E" href="mailto:mweil@wustl.edu"><mweil@wustl.edu></a></font><br>
<font size="1" face="sans-serif" color="#5f5f5f">To:
</font><font size="1" face="sans-serif"><a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a></font><br>
<font size="1" face="sans-serif" color="#5f5f5f">Date:
</font><font size="1" face="sans-serif">03/25/2020 10:34 PM</font><br>
<font size="1" face="sans-serif" color="#5f5f5f">Subject:
</font><font size="1" face="sans-serif">[EXTERNAL] Re:
[gpfsug-discuss] AFM gateway node scaling</font><br>
<font size="1" face="sans-serif" color="#5f5f5f">Sent by:
</font><font size="1" face="sans-serif"><a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a></font><br>
<hr noshade="noshade"><br>
<br>
<br>
<font size="3">thank you thank you... I would like to see that in
IBM
documentation somewhere.</font>
<p><font size="3">On 3/25/20 11:50 AM, Venkateswara R Puvvada
wrote:</font><br>
<font size="2" face="sans-serif">Matt,</font><font size="3"><br>
</font><font size="2" face="sans-serif"><br>
It is recommended to have dedicated AFM gateway nodes. Memory
and CPU requirements
for AFM gateway node depends on the number of filesets handled
by the node
and the inode usage of those filesets. Since AFM keeps track
of changes
in the memory, any network disturbance can cause the memory
utilization
to go high and which eventually leads to in-memory queue to be
dropped.
After the queue is dropped, AFM runs recovery to recover the
lost operations
which is expensive as it involves creating the snapshot,
running policy
scan, doing readdir from home/secondary and build the list of
lost
operations. When the gateway node goes down, all the filesets
handled by
that node distributed to the remaining active gateway nodes.
After the
gateway node comes back, filesets are transferred back to the
original
gateway node. When designing the gateway node, make sure that
it have enough
memory , CPU resources for handling the incoming and outgoing
data based
on the bandwidth. Limit the filesets per gateway(ex. less than
20 filesets
per gateway) so that number of AFM recoveries triggered will
be minimal
when the queues are lost. Also limit the total number of
inodes handled
by the gateway node across all the filesets (ex. less than 400
million
inodes per gateway). AFM gateway nodes are licensed as server
nodes.</font><font size="3"><br>
<br>
</font><font size="2" face="sans-serif"><br>
~Venkat (</font><a href="mailto:vpuvvada@in.ibm.com" moz-do-not-send="true"><font size="2" face="sans-serif" color="blue"><u>vpuvvada@in.ibm.com</u></font></a><font size="2" face="sans-serif">)</font><font size="3"><br>
<br>
<br>
</font><font size="1" face="sans-serif" color="#5f5f5f"><br>
From: </font><font size="1" face="sans-serif">Matt
Weil </font><a href="mailto:mweil@wustl.edu" moz-do-not-send="true"><font size="1" face="sans-serif" color="blue"><u><mweil@wustl.edu></u></font></a><font size="1" face="sans-serif" color="#5f5f5f"><br>
To: </font><a href="mailto:gpfsug-discuss@spectrumscale.org" moz-do-not-send="true"><font size="1" face="sans-serif" color="blue"><u>gpfsug-discuss@spectrumscale.org</u></font></a><font size="1" face="sans-serif" color="#5f5f5f"><br>
Date: </font><font size="1" face="sans-serif">03/23/2020
11:39 PM</font><font size="1" face="sans-serif" color="#5f5f5f"><br>
Subject: </font><font size="1" face="sans-serif">[EXTERNAL]
[gpfsug-discuss] AFM gateway node scaling</font><font size="1" face="sans-serif" color="#5f5f5f"><br>
Sent by: </font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" moz-do-not-send="true"><font size="1" face="sans-serif" color="blue"><u>gpfsug-discuss-bounces@spectrumscale.org</u></font></a><font size="3"><br>
</font></p>
<hr noshade="noshade"><font size="3"><br>
<br>
</font><tt><font size="2"><br>
Hello all,<br>
<br>
Is there any guide and or recommendation as to how to scale
this.<br>
<br>
filesets per gateway node? Is it necessary to separate NSD
server
and<br>
gateway roles. Are dedicated gateway nodes licensed as
clients?<br>
<br>
Thanks for any guidance.<br>
<br>
Matt<br>
<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org</font></tt><font size="3" color="blue"><u><br>
</u></font><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" moz-do-not-send="true"><tt><font size="2" color="blue"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></tt></a><tt><font size="2"><br>
</font></tt><font size="3"><br>
<br>
<br>
<br>
</font><br>
<tt><font size="3">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
</font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" moz-do-not-send="true"><tt><font size="3" color="blue"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></tt></a><tt><font size="3"><br>
</font></tt><tt><font size="2">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
</font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" moz-do-not-send="true"><tt><font size="2">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size="2"><br>
</font></tt><br>
<br>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
<a class="moz-txt-link-freetext" href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a>
</pre>
</blockquote>
</body>
</html>