[gpfsug-discuss] alternate path between ESS Servers for Datamigration

[Walter Sklenka]

Hi Olaf!!

Many thanks
OK well we will do mmvdisk vs delete
 So
#mmvdisk vs delete … -N ess01,ess02….. would be correct , or?

Best regards walter



From: gpfsug-discuss-bounces at spectrumscale.org <gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of Olaf Weiser
Sent: Donnerstag, 9. Dezember 2021 13:04
To: gpfsug-discuss at spectrumscale.org
Cc: gpfsug-discuss at spectrumscale.org
Subject: Re: [gpfsug-discuss] alternate path between ESS Servers for Datamigration

Hallo Walter,
;-)
yes !AND! no ..

for sure , you can specifiy a subset of nodes to use RDMA and other nodes just communicating TCPIP
But that's only half of the truth .

The other half is.. who and how , you are going to migrate/copy the data
in case you 'll use mmrestripe .... you will have to make sure , that only nodes, connected(green) and configured for RDMA  doing the work
otherwise.. if will also work to migrate the data, but then data is send throught the Ethernet as well , (as long all those nodes are in the same cluster)


laff





----- Ursprüngliche Nachricht -----
Von: "Walter Sklenka" <Walter.Sklenka at EDV-Design.at<mailto:Walter.Sklenka at EDV-Design.at>>
Gesendet von: gpfsug-discuss-bounces at spectrumscale.org<mailto:gpfsug-discuss-bounces at spectrumscale.org>
An: "'gpfsug-discuss at spectrumscale.org'" <gpfsug-discuss at spectrumscale.org<mailto:gpfsug-discuss at spectrumscale.org>>
CC:
Betreff: [EXTERNAL] [gpfsug-discuss] alternate path between ESS Servers for Datamigration
Datum: Do, 9. Dez 2021 11:04


Dear spectrum scale users!

May I ask you a design question?

We have an IB environment which is very mixed at the moment ( connecX3 … connect-X6 with FDR , even FDR10 and with arrive of ESS5000SC7 now also HDR100 and HDR switches. We still have some big  troubles in this fabric when using RDMA , a case at Mellanox and IBM is open .

The environment has 3 old Building blocks 2xESSGL6 and 1x GL4 , from where we want to migrate the data to ess5000 , ( mmdelvdisk +qos)

Due to the current problems with RDMA we though eventually we could try a workaround :

If you are interested there is Maybe you can find the attachment ?

We build 2 separate fabrics , the ess-IO servers attached to both blue and green and all other cluster members and all remote clusters only to fabric blue

The daemon interfaces (IPoIP) are on fabric blue



It is the aim to setup rdma only on the ess-ioServers in the fabric green ,  in the blue we must use IPoIB (tcp)

Do you think datamigration would work between ess01,ess02,… to ess07,ess08 via RDMA ?

Or is it  principally not possible to make a rdma network only  for a subset of a cluster (though this subset would be reachable via other fabric) ?



Thank you very much for any input !

Best regards walter







Mit freundlichen Grüßen
Walter Sklenka
Technical Consultant



EDV-Design Informationstechnologie GmbH
Giefinggasse 6/1/2, A-1210 Wien
Tel: +43 1 29 22 165-31
Fax: +43 1 29 22 165-90
E-Mail: sklenka at edv-design.at<mailto:sklenka at edv-design.at>
Internet: www.edv-design.at<http://www.edv-design.at/>



_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20211209/2f08b71c/attachment-0002.htm>