<font size=2 face="sans-serif">Hi,</font><br><br><font size=2 face="sans-serif">I believe the right term is not multithreaded,
but rather multistream. NFS will submit multiple requests in parallel,
but without using large enough window you won't be able to get much of
each stream.</font><br><font size=2 face="sans-serif">So, the first place to look is here:
</font><a href="https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1adm_tuningbothnfsclientnfsserver.htm"><font size=3 color=blue><u>https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1adm_tuningbothnfsclientnfsserver.htm</u></font></a><font size=3></font><font size=2 face="sans-serif"> - and while its talking about
"Kernel NFS" the same apply to any TCP socket based communication
( including Ganesha). I tend to test the performance using iperf/nsdperf
( just make sure to use single stream) in order to see what is the expected
maximum performance.</font><br><font size=2 face="sans-serif">After that, you can start looking into
"how can I get multiple streams?" - for that there are two options:</font><br><a href="https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1ins_paralleldatatransfersafm.htm"><font size=3 color=blue><u>https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/bl1ins_paralleldatatransfersafm.htm</u></font></a><font size=3></font><br><font size=2 face="sans-serif">and</font><br><a href="https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/b1lins_afmparalleldatatransferwithremotemounts.htm"><font size=3 color=blue><u>https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.4/com.ibm.spectrum.scale.v5r04.doc/b1lins_afmparalleldatatransferwithremotemounts.htm</u></font></a><font size=3></font><br><br><font size=2 face="sans-serif">The former enhance large file transfer,
while the latter ( new in 5.0.4) will help with multiple small files as
well.</font><br><br><br><font size=2 face="sans-serif"><br>Regards,<br><br>Tomer Perry<br>Scalable I/O Development (Spectrum Scale)<br>email: tomp@il.ibm.com<br>1 Azrieli Center, Tel Aviv 67021, Israel<br>Global Tel: +1 720 3422758<br>Israel Tel: +972 3 9188625<br>Mobile: +972 52 2554625<br></font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">Andi Christiansen <andi@christiansen.xxx></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">"gpfsug-discuss@spectrumscale.org"
<gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">21/02/2020 15:25</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">[EXTERNAL] [gpfsug-discuss]
Spectrum Scale Ganesha NFS multi threaded AFM?</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=3>Hi all, </font><br><br><font size=3>i have searched the internet for a good time now with
no answer to this.. So i hope someone can tell me if this is possible or
not. </font><br><br><font size=3>We use NFS from our Cluster1 to a AFM enabled fileset
on Cluster2. That is working as intended. But when AFM transfers files
from one site to another it caps out at about 5-700Mbit/s which isnt impressive..
The sites are connected on 10Gbit links but the distance/round-trip is
too far/high to use the NSD protocol with AFM. </font><br><br><font size=3>On the cluster where the fileset is exported we can only
see 1 session against the client cluster, is there a way to either tune
Ganesha or AFM to use more threads/sessions? </font><br><br><font size=3>We have about 7.7Gbit bandwidth between the sites from
the 10Gbit links and with multiple NFS sessions we can reach the maximum
bandwidth(each using about 50-60MBits per session). </font><br><br><font size=3>Best Regards </font><br><font size=3>Andi Christiansen </font><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size=2><br></font></tt><br><br><BR>