<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10pt" ><div dir="ltr" >Ganesha uses /etc/netconfig for using IPv6 or IPv4. It will use IPv6 only, unless you remove/comment IPv6 entries from /etc/netconfig, then it will use IPv4.</div>
<div dir="ltr" > </div>
<div dir="ltr" >If IPv6 is configured in /etc/netconfig, it will try creating socket() with IPv6. If that fails with EAFNOSUPPORT, then it will fall back to IPv4. Any other error code, it bails out with an error message. So with your original initramfs, it is possible that socket() call for IPv6 might be failing with a different error.</div>
<div dir="ltr" > </div>
<div dir="ltr" >Regards, Malahal.</div>
<div dir="ltr" > </div>
<blockquote data-history-content-modified="1" dir="ltr" style="border-left:solid #aaaaaa 2px; margin-left:5px; padding-left:5px; direction:ltr; margin-right:0px" >----- Original message -----<br>From: "Billich Heinrich Rainer (ID SD)" <heinrich.billich@id.ethz.ch><br>Sent by: gpfsug-discuss-bounces@spectrumscale.org<br>To: gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>Cc:<br>Subject: [EXTERNAL] Re: [gpfsug-discuss] Ganesha all IPv6 sockets - ist this to be expected?<br>Date: Tue, Oct 1, 2019 6:04 PM<br> <br><!--Notes ACF
<meta http-equiv="Content-Type" content="text/html; charset=utf8" >--> <!--[if !mso]><style></style><![endif]--><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit" >
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div><p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >Hello,<o:p></o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" ><o:p> </o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >I wanted to completely disable IPv6 to get ganesha to use IPv4 sockets only. Once we did set the sysctl configs to disable IPv6 *<b>and</b>* did rebuild the initramfs.*.img file to include the new settings IPv6 was completely gone and ganesha did open an IPv4 socket only. We missed to rebuild the initramfs.*.img file in the first trial. Rpcbind/ganesha failed to start without the initramfs rebuild.<o:p></o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" ><o:p> </o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >Cheers, Heiner<o:p></o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" ><o:p> </o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >Some related documents from netapp<o:p></o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" ><a href="https://access.redhat.com/solutions/8709#%E2%80%8Crhel7disable" target="_blank">https://access.redhat.com/solutions/8709#rhel7disable</a><o:p></o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" ><a href="https://access.redhat.com/solutions/2798411" target="_blank">https://access.redhat.com/solutions/2798411</a><o:p></o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >https://access.redhat.com/solutions/2963091<o:p></o:p></span></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" ><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm" ><p style="margin: 0px;" ><b><span style="font-size:12.0pt;color:black" >From: </span></b><span style="font-size:12.0pt;color:black" ><gpfsug-discuss-bounces@spectrumscale.org> on behalf of "Billich Heinrich Rainer (ID SD)" <heinrich.billich@id.ethz.ch><br><b>Reply to: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br><b>Date: </b>Monday, 16 September 2019 at 17:51<br><b>To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br><b>Subject: </b>Re: [gpfsug-discuss] Ganesha all IPv6 sockets - ist this to be expected?<o:p></o:p></span></p></div>
<div><p style="margin: 0px;" ><o:p> </o:p></p></div>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >Hello Olaf,</span><o:p></o:p></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" > </span><o:p></o:p></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >Thank you, so we’ll try to get rid of IPv6. Actually we do have this settings active but I may have to add them to the initrd file, too. (See <a href="https://access.redhat.com/solutions/8709#%E2%80%8Crhel7disable" target="_blank">https://access.redhat.com/solutions/8709#rhel7disable</a>) to prevent ganesha from opening an IPv6 socket. It’s probably no big issue if ganesha uses IPv4overIPv6 for all connections, but to keep things simple I would like to avoid it.</span><o:p></o:p></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" > </span><o:p></o:p></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >@Edward</span><o:p></o:p></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >We got /etc/tuned/scale/tuned.conf with GSS/xCAT. I’m not sure whether it’s part of any rpm.</span><o:p></o:p></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" > </span><o:p></o:p></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >Cheers,</span><o:p></o:p></p>
<p style="margin: 0px;" ><span style="mso-fareast-language:EN-US" >Heiner</span><o:p></o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm" ><p style="margin: 0px;" ><b><span style="font-size:12.0pt;color:black" >From: </span></b><span style="font-size:12.0pt;color:black" ><gpfsug-discuss-bounces@spectrumscale.org> on behalf of Olaf Weiser <olaf.weiser@de.ibm.com><br><b>Reply to: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br><b>Date: </b>Monday, 16 September 2019 at 09:12<br><b>To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br><b>Subject: </b>Re: [gpfsug-discuss] Ganesha all IPv6 sockets - ist this to be expected?</span><o:p></o:p></p></div>
<div><p style="margin: 0px;" > <o:p></o:p></p></div>
<div><p style="margin: 0px;" ><span style="font-size:10.0pt;font-family:"Arial",sans-serif" >Hallo Heiner, </span><br><span style="font-size:10.0pt;font-family:"Arial",sans-serif" >usually, Spectrum Scale comes with a tuned profile (named scale) .. </span><br><br><tt><span style="font-size:12.0pt" >[root@nsd01 ~]# tuned-adm active </span></tt><br><tt><span style="font-size:10.0pt" >Current active profile: scale</span></tt><o:p></o:p></p>
<div><p style="margin: 0px;" ><br><span style="font-size:10.0pt;font-family:"Arial",sans-serif" >in there </span><br><tt><span style="font-size:12.0pt" >[root@nsd01 ~]# cat /etc/tuned/scale/tuned.conf | tail -3 </span></tt><br><tt><span style="font-size:10.0pt" ># Disable IPv6 </span></tt><br><tt><span style="font-size:10.0pt" >net.ipv6.conf.all.disable_ipv6=1 </span> </tt><br><tt><span style="font-size:10.0pt" >net.ipv6.conf.default.disable_ipv6=1 </span> </tt><br><tt><span style="font-size:10.0pt" >[root@nsd01 ~]# </span></tt><br><br><span style="font-size:10.0pt;font-family:"Arial",sans-serif" >depending on .... what you need to achieve .. one might be forced to changed that.. e.g. for RoCE .. you need IPv6 to be active ... </span><br><span style="font-size:10.0pt;font-family:"Arial",sans-serif" >but for all other scenarios with SpectrumScale (at least what I'm aware of right now) ... IPv6 can be disabled... </span><br><br><br><br><br><br><br><br><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F" >From: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif" >"Billich Heinrich Rainer (ID SD)" <heinrich.billich@id.ethz.ch></span><br><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F" >To: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif" >gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></span><br><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F" >Date: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif" >09/13/2019 05:02 PM</span><br><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F" >Subject: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif" >[EXTERNAL] [gpfsug-discuss] Ganesha all IPv6 sockets - ist this to be expected?</span><br><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#5F5F5F" >Sent by: </span><span style="font-size:7.5pt;font-family:"Arial",sans-serif" >gpfsug-discuss-bounces@spectrumscale.org</span><o:p></o:p></p>
<div align="center" style="text-align: center; margin: 0px;" ><hr align="center" noshade="noshade" size="1" style="color:#A0A0A0" width="100%" ></div>
<p style="margin: 0px;" ><br><br><br><br><span style="font-size:10.0pt;font-family:"Courier New"" ><tt>Hello,</tt><br><br><tt>I just noted that our ganesha daemons offer IPv6 sockets only, IPv4 traffic gets encapsulated. But all traffic to samba is IPv4, smbd offers both IPv4 and IPv6 sockets. </tt><br><tt>I just wonder whether this is to be expected? Protocols support IPv4 only, so why running on IPv6 sockets only for ganesha? Did we configure something wrong and should completely disable IPv6 on the kernel level</tt><br><br><tt>Any comment is welcome</tt><br><br><tt>Cheers,</tt><br><tt>Heiner</tt><br><tt>-- </tt><br><tt>=======================</tt><br><tt>Heinrich Billich</tt><br><tt>ETH Zürich</tt><br><tt>Informatikdienste</tt><br><tt>Tel.: +41 44 632 72 56</tt><br><tt>heinrich.billich@id.ethz.ch</tt><br><tt>========================</tt><br><br><br><tt>I did check with</tt><br><br><tt> ss -l -t -4</tt><br><tt> ss -l -t -6</tt><br><br><tt>add -p to get the process name, too.</tt><br><br><tt>do you get the same results on your ces nodes?</tt><br><br><br><tt>[root@nas22ces04-i config_samples]# ss -l -t -4</tt><br><tt>State Recv-Q Send-Q Local Address:Port Peer Address:Port</tt><br><tt>LISTEN 0 8192 *:gpfs *:*</tt><br><tt>LISTEN 0 50 *:netbios-ssn *:*</tt><br><tt>LISTEN 0 128 *:5355 *:*</tt><br><tt>LISTEN 0 128 *:sunrpc *:*</tt><br><tt>LISTEN 0 128 *:ssh *:*</tt><br><tt>LISTEN 0 100 127.0.0.1:smtp *:*</tt><br><tt>LISTEN 0 10 10.250.135.24:4379 *:*</tt><br><tt>LISTEN 0 128 *:32765 *:*</tt><br><tt>LISTEN 0 50 *:microsoft-ds *:*</tt><br><tt>[root@nas22ces04-i config_samples]# ss -l -t -6</tt><br><tt>State Recv-Q Send-Q Local Address:Port Peer Address:Port</tt><br><tt>LISTEN 0 128 :::32767 :::*</tt><br><tt>LISTEN 0 128 :::32768 :::*</tt><br><tt>LISTEN 0 128 :::32769 :::*</tt><br><tt>LISTEN 0 128 :::2049 :::*</tt><br><tt>LISTEN 0 128 :::5355 :::*</tt><br><tt>LISTEN 0 50 :::netbios-ssn :::*</tt><br><tt>LISTEN 0 128 :::sunrpc :::*</tt><br><tt>LISTEN 0 128 :::ssh :::*</tt><br><tt>LISTEN 0 128 :::32765 :::*</tt><br><tt>LISTEN 0 50 :::microsoft-ds :::*</tt><br><br><tt>_______________________________________________</tt><br><tt>gpfsug-discuss mailing list</tt><br><tt>gpfsug-discuss at spectrumscale.org</tt></span><br><tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><br><br><br><br><o:p></o:p></p></div></div>
<p style="margin: 0px;" ><br><br><br><o:p></o:p></p></div>
<div><font face="Default Monospace,Courier New,Courier,monospace" size="2" >_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a> </font></div></blockquote>
<div dir="ltr" > </div></div><BR>