[gpfsug-discuss] alternate path between ESS Servers for Datamigration

[Jan-Frode Myklebust]

I believe this should be a fully working solution. I see no problem
enabling RDMA between a subset of nodes -- just disable verbsRdma on the
nodes you want to use plain IP.


  -jf

On Thu, Dec 9, 2021 at 11:04 AM Walter Sklenka <Walter.Sklenka at edv-design.at>
wrote:

> Dear spectrum scale users!
>
> May I ask you a design question?
>
> We have an IB environment which is very mixed at the moment ( connecX3 …
> connect-X6 with FDR , even FDR10 and with arrive of ESS5000SC7 now also
> HDR100 and HDR switches. We still have some big  troubles in this fabric
> when using RDMA , a case at Mellanox and IBM is open .
>
> The environment has 3 old Building blocks 2xESSGL6 and 1x GL4 , from where
> we want to migrate the data to ess5000 , ( mmdelvdisk +qos)
>
> Due to the current problems with RDMA we though eventually we could try a
> workaround :
>
> If you are interested there is Maybe you can find the attachment ?
>
> We build 2 separate fabrics , the ess-IO servers attached to both blue and
> green and all other cluster members and all remote clusters only to fabric
> blue
>
> The daemon interfaces (IPoIP) are on fabric blue
>
>
>
> It is the aim to setup rdma only on the ess-ioServers in the fabric green
> ,  in the blue we must use IPoIB (tcp)
>
> Do you think datamigration would work between ess01,ess02,… to ess07,ess08
> via RDMA ?
>
> Or is it  principally not possible to make a rdma network only  for a
> subset of a cluster (though this subset would be reachable via other
> fabric) ?
>
>
>
> Thank you very much for any input !
>
> Best regards walter
>
>
>
>
>
>
>
> Mit freundlichen Grüßen
> *Walter Sklenka*
> *Technical Consultant*
>
>
>
> EDV-Design Informationstechnologie GmbH
> Giefinggasse 6/1/2, A-1210 Wien
> Tel: +43 1 29 22 165-31
> Fax: +43 1 29 22 165-90
> E-Mail: sklenka at edv-design.at
> Internet: www.edv-design.at
>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20211209/48861509/attachment-0002.htm>