<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="elementToProof" style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi Jonathan,</div>
<div class="elementToProof" style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">
Short answer: no.</div>
<div class="elementToProof" style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">
We have a cluster which is mixed infiniband (with RDMA) and plain ethernet.</div>
<div class="elementToProof" style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div class="elementToProof" style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">
You can pick with:</div>
<div class="elementToProof" style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">
mmchconfig verbsRdma=enable -N nodes,...<br>
<br>
</div>
<div class="elementToProof" style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">
depending if RDMA is on or off by default.</div>
<div class="elementToProof"><span style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);"><br>
</span></div>
<div class="elementToProof"><span style="font-family: "Sitka Text", Cochin, serif; font-size: 12pt; color: rgb(0, 0, 0);">Ward</span></div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> gpfsug-discuss <gpfsug-discuss-bounces@gpfsug.org> on behalf of Jonathan Buzzard <jonathan.buzzard@strath.ac.uk><br>
<b>Sent:</b> Wednesday, 17 January 2024 14:28<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@gpfsug.org><br>
<b>Subject:</b> [gpfsug-discuss] RDMA question</font>
<div> </div>
</div>
<div class="BodyFragment"><font size="2"><span style="font-size:11pt;">
<div class="PlainText"><br>
I can't seem to find a straight answer to this. If you wanted to used <br>
RDMA with GPFS does every node need to be using RDMA or could it be that <br>
just a subset use RDMA?<br>
<br>
Obviously the nodes with actual storage attached need to be running <br>
RDMA, but would I need to upgrade things like protocol or GUI nodes etc. <br>
to use RDMA as well?<br>
<br>
<br>
JAB.<br>
<br>
-- <br>
Jonathan A. Buzzard Tel: +44141-5483420<br>
HPC System Administrator, ARCHIE-WeSt.<br>
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG<br>
<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at gpfsug.org<br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a><br>
</div>
</span></font></div>
</body>
</html>