<font size=2 face="sans-serif">Most of these recommendations documented
in KC, we will add missing information on number of filesets and inodes
per gateway in the next release.</font><br><br><a href="https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1ins_gatewaynodefailureafm.htm"><font size=2 color=blue face="sans-serif">https://www.ibm.com/support/knowledgecenter/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1ins_gatewaynodefailureafm.htm</font></a><br><br><font size=2 face="sans-serif">~Venkat (vpuvvada@in.ibm.com)</font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">Matt Weil <mweil@wustl.edu></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">gpfsug-discuss@spectrumscale.org</font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">03/25/2020 10:34 PM</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">[EXTERNAL] Re:
[gpfsug-discuss] AFM gateway node scaling</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=3>thank you thank you... I would like to see that in IBM
documentation somewhere.</font><p><font size=3>On 3/25/20 11:50 AM, Venkateswara R Puvvada wrote:</font><br><font size=2 face="sans-serif">Matt,</font><font size=3><br></font><font size=2 face="sans-serif"><br>It is recommended to have dedicated AFM gateway nodes. Memory and CPU requirements
for AFM gateway node depends on the number of filesets handled by the node
and the inode usage of those filesets. Since AFM keeps track of changes
in the memory, any network disturbance can cause the memory utilization
to go high and which eventually leads to in-memory queue to be dropped.
After the queue is dropped, AFM runs recovery to recover the lost operations
which is expensive as it involves creating the snapshot, running policy
scan, doing readdir from home/secondary and build the list of lost
operations. When the gateway node goes down, all the filesets handled by
that node distributed to the remaining active gateway nodes. After the
gateway node comes back, filesets are transferred back to the original
gateway node. When designing the gateway node, make sure that it have enough
memory , CPU resources for handling the incoming and outgoing data based
on the bandwidth. Limit the filesets per gateway(ex. less than 20 filesets
per gateway) so that number of AFM recoveries triggered will be minimal
when the queues are lost. Also limit the total number of inodes handled
by the gateway node across all the filesets (ex. less than 400 million
inodes per gateway). AFM gateway nodes are licensed as server nodes.</font><font size=3><br><br></font><font size=2 face="sans-serif"><br>~Venkat (</font><a href="mailto:vpuvvada@in.ibm.com"><font size=2 color=blue face="sans-serif"><u>vpuvvada@in.ibm.com</u></font></a><font size=2 face="sans-serif">)</font><font size=3><br><br><br></font><font size=1 color=#5f5f5f face="sans-serif"><br>From: </font><font size=1 face="sans-serif">Matt
Weil </font><a href="mailto:mweil@wustl.edu"><font size=1 color=blue face="sans-serif"><u><mweil@wustl.edu></u></font></a><font size=1 color=#5f5f5f face="sans-serif"><br>To: </font><a href="mailto:gpfsug-discuss@spectrumscale.org"><font size=1 color=blue face="sans-serif"><u>gpfsug-discuss@spectrumscale.org</u></font></a><font size=1 color=#5f5f5f face="sans-serif"><br>Date: </font><font size=1 face="sans-serif">03/23/2020
11:39 PM</font><font size=1 color=#5f5f5f face="sans-serif"><br>Subject: </font><font size=1 face="sans-serif">[EXTERNAL]
[gpfsug-discuss] AFM gateway node scaling</font><font size=1 color=#5f5f5f face="sans-serif"><br>Sent by: </font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org"><font size=1 color=blue face="sans-serif"><u>gpfsug-discuss-bounces@spectrumscale.org</u></font></a><font size=3><br></font><hr noshade><font size=3><br><br></font><tt><font size=2><br>Hello all,<br><br>Is there any guide and or recommendation as to how to scale this.<br><br>filesets per gateway node? Is it necessary to separate NSD server
and<br>gateway roles. Are dedicated gateway nodes licensed as clients?<br><br>Thanks for any guidance.<br><br>Matt<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font></tt><font size=3 color=blue><u><br></u></font><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2 color=blue><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></tt></a><tt><font size=2><br></font></tt><font size=3><br><br><br><br></font><br><tt><font size=3>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=3 color=blue><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></tt></a><tt><font size=3><br></font></tt><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size=2><br></font></tt><br><br><BR>