<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10pt" ><div dir="ltr" >Hallo Walter,</div>
<div dir="ltr" >;-)</div>
<div dir="ltr" >yes !AND! no ..</div>
<div dir="ltr" > </div>
<div dir="ltr" >for sure , you can specifiy a subset of nodes to use RDMA and other nodes just communicating TCPIP</div>
<div dir="ltr" >But that's only half of the truth .</div>
<div dir="ltr" > </div>
<div dir="ltr" >The other half is.. who and how , you are going to migrate/copy the data</div>
<div dir="ltr" >in case you 'll use mmrestripe .... you will have to make sure , that only nodes, connected(green) and configured for RDMA doing the work</div>
<div dir="ltr" >otherwise.. if will also work to migrate the data, but then data is send throught the Ethernet as well , (as long all those nodes are in the same cluster)</div>
<div dir="ltr" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10pt" ><div dir="ltr" ><div> </div>
<div> </div>
<div>laff</div>
<div> </div>
<div> </div>
<div><div> </div></div></div></div></div></div>
<div dir="ltr" > </div>
<div dir="ltr" > </div>
<blockquote data-history-content-modified="1" dir="ltr" style="border-left:solid #aaaaaa 2px; margin-left:5px; padding-left:5px; direction:ltr; margin-right:0px" >----- Ursprüngliche Nachricht -----<br>Von: "Walter Sklenka" <Walter.Sklenka@EDV-Design.at><br>Gesendet von: gpfsug-discuss-bounces@spectrumscale.org<br>An: "'gpfsug-discuss@spectrumscale.org'" <gpfsug-discuss@spectrumscale.org><br>CC:<br>Betreff: [EXTERNAL] [gpfsug-discuss] alternate path between ESS Servers for Datamigration<br>Datum: Do, 9. Dez 2021 11:04<br> <br><!--Notes ACF
<meta http-equiv="Content-Type" content="text/html; charset=utf8" >--> <!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit" >
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div><p style="margin: 0px;" >Dear spectrum scale users!<o:p></o:p></p>
<p style="margin: 0px;" ><span lang="EN-US" >May I ask you a design question?<o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >We have an IB environment which is very mixed at the moment ( connecX3 … connect-X6 with FDR , even FDR10 and with arrive of ESS5000SC7 now also HDR100 and HDR switches. We still have some big troubles in this fabric when using RDMA , a case at Mellanox and IBM is open . <o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >The environment has 3 old Building blocks 2xESSGL6 and 1x GL4 , from where we want to migrate the data to ess5000 , ( mmdelvdisk +qos) <o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >Due to the current problems with RDMA we though eventually we could try a workaround :<o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >If you are interested there is Maybe you can find the attachment ? <o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >We build 2 separate fabrics , the ess-IO servers attached to both blue and green and all other cluster members and all remote clusters only to fabric blue <o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >The daemon interfaces (IPoIP) are on fabric blue<o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" ><o:p> </o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >It is the aim to setup rdma only on the ess-ioServers in the fabric green , in the blue we must use IPoIB (tcp) <o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >Do you think datamigration would work between ess01,ess02,… to ess07,ess08 via RDMA ?<o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >Or is it principally not possible to make a rdma network only for a subset of a cluster (though this subset would be reachable via other fabric) ?<o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" ><o:p> </o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >Thank you very much for any input !<o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" >Best regards walter <o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" > <o:p></o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" ><o:p> </o:p></span></p>
<p style="margin: 0px;" ><span lang="EN-US" ><o:p> </o:p></span></p>
<p style="margin: 0px;" ><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black;mso-fareast-language:DE-AT" >Mit freundlichen Grüßen<br><b><i>Walter Sklenka</i></b></span><br><b><i><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:gray;mso-fareast-language:DE-AT" >Technical Consultant</span></i></b><span style="color:black;mso-fareast-language:DE-AT" > </span><span style="color:#212121;mso-fareast-language:DE-AT" ><o:p></o:p></span></p>
<p style="margin: 0px;" ><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:black;mso-fareast-language:DE-AT" > </span><span style="color:#212121;mso-fareast-language:DE-AT" ><o:p></o:p></span></p>
<p style="margin: 0px;" ><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-fareast-language:DE-AT" >EDV-Design Informationstechnologie GmbH<br>Giefinggasse 6/1/2, A-1210 Wien<br>Tel: +43 1 29 22 165-31<br>Fax: +43 1 29 22 165-90<br>E-Mail: <a href="mailto:sklenka@edv-design.at" target="_blank"><span style="color:#0563C1" >sklenka@edv-design.at</span></a></span><br><span style="font-size:8.0pt;font-family:"Arial",sans-serif;color:black;mso-fareast-language:DE-AT" >Internet: <a href="http://www.edv-design.at/" target="_blank"><span style="color:#0563C1" >www.edv-design.at</span></a><o:p></o:p></span></p>
<p style="margin: 0px;" ><o:p> </o:p></p></div>
<div id="MIMEAttachInfoDiv" style="display:none" title="pdf|Visio-eodc-2-fabs.pdf" > </div>
<div><font size="2" face="Default Monospace,Courier New,Courier,monospace" >_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a> </font></div></blockquote>
<div dir="ltr" > </div></div><BR>
<BR>