[gpfsug-discuss] DSS-G100 and networking

Jonathan Buzzard jonathan.buzzard at strath.ac.uk
Wed Jul 30 16:41:48 BST 2025


So these servers (at least in their SR630 V2 variant) come with three 
single port ConnectX-6 Dx cards capable of 200Gbps.

The question is why do I need three? My thinking is that a LACP bond 
into a couple of switches doing MLAG (or insert whatever your vendor 
calls it) is ample connectivity? Noting that these are going into a pair 
of SN3700M switches at the full 200Gbps.

So I don't get the purpose of the third card? What am I missing? Extra 
connectivity if you want to do Infiniband as well? Direct link between 
two of them?


JAB.

-- 
Jonathan A. Buzzard                         Tel: +44141-5483420
HPC System Administrator, ARCHIE-WeSt.
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG




More information about the gpfsug-discuss mailing list