<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
and don't forget ... subnet is used for ... for MROT <br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
<a href="https://www.ibm.com/docs/en/spectrum-scale/5.1.6?topic=configuring-multi-rail-over-tcp-mrot" id="LPlnkOWALinkPreview">https://www.ibm.com/docs/en/spectrum-scale/5.1.6?topic=configuring-multi-rail-over-tcp-mrot</a><br>
</div>
<div class="_Entity _EType_OWALinkPreview _EId_OWALinkPreview _EReadonly_1">
<div id="LPBorder_GTaHR0cHM6Ly93d3cuaWJtLmNvbS9kb2NzL2VuL3NwZWN0cnVtLXNjYWxlLzUuMS42P3RvcGljPWNvbmZpZ3VyaW5nLW11bHRpLXJhaWwtb3Zlci10Y3AtbXJvdA.." class="LPBorder872608" style="width: 100%; margin-top: 16px; margin-bottom: 16px; position: relative; max-width: 800px; min-width: 424px;">
<table id="LPContainer872608" role="presentation" style="padding: 12px 36px 12px 12px; width: 100%; border-width: 1px; border-style: solid; border-color: rgb(200, 200, 200); border-radius: 2px;">
<tbody>
<tr style="border-spacing: 0px;" valign="top">
<td style="width: 100%;">
<div id="LPTitle872608" style="font-size: 21px; font-weight: 300; margin-right: 8px; font-family: "wf_segoe-ui_light", "Segoe UI Light", "Segoe WP Light", "Segoe UI", "Segoe WP", Tahoma, Arial, sans-serif; margin-bottom: 12px;">
<a target="_blank" id="LPUrlAnchor872608" href="https://www.ibm.com/docs/en/spectrum-scale/5.1.6?topic=configuring-multi-rail-over-tcp-mrot" style="text-decoration: none;">Configuring Multi-Rail over TCP (MROT)</a></div>
<div id="LPDescription872608" style="font-size: 14px; max-height: 100px; font-family: "wf_segoe-ui_normal", "Segoe UI", "Segoe WP", Tahoma, Arial, sans-serif; margin-bottom: 12px; margin-right: 8px; overflow: hidden; color: rgb(102, 102, 102);">
IBM Spectrum Scale 5.1.5 introduces the Multi-Rail over TCP (MROT) feature. This feature enables the concurrent use of multiple subnets to communicate with a specified destination, and now allows the concurrent use of multiple physical network interfaces without
requiring bonding to be configured.</div>
<div id="LPMetadata872608" style="font-size: 14px; font-weight: 400; font-family: "wf_segoe-ui_normal", "Segoe UI", "Segoe WP", Tahoma, Arial, sans-serif; color: rgb(166, 166, 166);">
www.ibm.com</div>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<br>
<div class="elementToProof"><br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>Von:</b> gpfsug-discuss <gpfsug-discuss-bounces@gpfsug.org> im Auftrag von Achim Rehor <Achim.Rehor@de.ibm.com><br>
<b>Gesendet:</b> Mittwoch, 3. Mai 2023 16:40<br>
<b>An:</b> gpfsug-discuss@gpfsug.org <gpfsug-discuss@gpfsug.org><br>
<b>Betreff:</b> [EXTERNAL] Re: [gpfsug-discuss] Question about subnets parameter and remote cluster mounts</font>
<div> </div>
</div>
<div class="BodyFragment"><font size="2"><span style="font-size:11pt;">
<div class="PlainText">correct, there is no need to put client and storage into different<br>
subnets, <br>
and it is also not necessary to specify the subnet parameter at all,<br>
when they share the same network. <br>
<br>
The subnets parameter is very helpful, though, if you are using<br>
multiple networks, and want to use specific ones for communication with<br>
one or the other remote cluster.<br>
<br>
-- <br>
Mit freundlichen Grüßen / Kind regards<br>
<br>
Achim Rehor<br>
<br>
Technical Support Specialist Spectrum Scale and ESS (SME)<br>
Advisory Product Services Professional<br>
IBM Systems Storage Support - EMEA<br>
<br>
Achim.Rehor@de.ibm.com +49-170-<br>
4521194 <br>
IBM Deutschland GmbH <br>
Vorsitzender des Aufsichtsrats: Sebastian Krause<br>
Geschäftsführung: Gregor Pillen (Vorsitzender), Nicole Reimer, <br>
Gabriele Schwarenthorer, Christine Rupp, Frank Theisen<br>
Sitz der Gesellschaft: Ehningen / Registergericht:<br>
AmtsgerichtStuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940<br>
<br>
<br>
-----Original Message-----<br>
From: Jaime Pinto <pinto@scinet.utoronto.ca><br>
Reply-To: gpfsug main discussion list <gpfsug-discuss@gpfsug.org><br>
To: gpfsug-discuss@gpfsug.org<br>
Subject: [EXTERNAL] Re: [gpfsug-discuss] Question about subnets<br>
parameter and remote cluster mounts<br>
Date: Wed, 03 May 2023 09:35:35 -0400<br>
<br>
/etc/sysconfig/network-scripts/ifcfg-ib0<br>
<br>
Example:<br>
DEVICE=ib0<br>
NM_CONTROLLED=no<br>
BOOTPROTO=none<br>
ONBOOT=yes<br>
IPADDR=192.168.0.1<br>
NETMASK=255.255.0.0<br>
<br>
There is no need to place storage and client clusters on different<br>
subnets.<br>
Cheers<br>
Jaime<br>
<br>
On 5/3/2023 09:17:56, Leonardo Sala wrote:<br>
> Dear all,<br>
> <br>
> I do have a very naive question about the subnets parameter. I read<br>
> the various docs [*], but it is not clear to me how do best define it<br>
> in my use case. As an example, I have a CL1 storage cluster, and a<br>
> CL2 client cluster that remotely mounts CL1 storage, and they are<br>
> both connected to a private IB network 192.168.0.0. Where should I<br>
> define subnets=192.168.0.0/CL1;CL2 : on CL1, CL2 or both? Some<br>
> directionality seems implied in the docs, but it was not totally<br>
> clear to me...<br>
> <br>
> Thanks a lot!<br>
> <br>
> cheers<br>
> <br>
> leo<br>
> <br>
> [*]<br>
> <br>
> <a href="https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using-">https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=system-using-</a><br>
> remote-access-multiple-network-definitions<br>
> <br>
> <a href="https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication-">https://www.ibm.com/docs/en/spectrum-scale/5.1.7?topic=communication-</a><br>
> using-public-private-ip-addresses-gpfs-nodes<br>
> <br>
> -- <br>
> Paul Scherrer Institut<br>
> Dr. Leonardo Sala<br>
> Group Leader Data Analysis and Research Infrastructure<br>
> Deputy Department Head a.i Science IT Infrastructure and Services<br>
> department<br>
> Science IT Infrastructure and Services department (AWI)<br>
> WHGA/036<br>
> Forschungstrasse 111<br>
> 5232 Villigen PSI<br>
> Switzerland<br>
> <br>
> Phone: +41 56 310 3369<br>
> leonardo.sala@psi.ch<br>
> www.psi.ch<br>
> <br>
> <br>
> _______________________________________________<br>
> gpfsug-discuss mailing list<br>
> gpfsug-discuss at gpfsug.org<br>
> INVALID URI REMOVED<br>
> 3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss-<br>
> 5Fgpfsug.org&d=DwICAg&c=jf_iaSHvJObTbx-<br>
> siA1ZOg&r=RGTETs2tk0Kz_VOpznDVDkqChhnfLapOTkxLvgmR2-<br>
> M&m=a52vwqiBPgfri7y-<br>
> rne9oRxqBKDxxYqKimhVU6ZxaEvmSVBVmMqWrcYU773cCoYM&s=01OGdeEg83s2fYkuf8<br>
> BQqhhMxUWiFPbvyedZrCqSDFc&e= <br>
<br>
---<br>
Jaime Pinto - Storage Analyst<br>
SciNet HPC Consortium - <a href="http://www.scinet.utoronto.ca">www.scinet.utoronto.ca</a><br>
University of Toronto<br>
661 University Ave. (MaRS), Suite 1140<br>
Toronto, ON, M5G1M1<br>
P: 416-978-2755<br>
C: 416-505-1477<br>
<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at gpfsug.org<br>
INVALID URI REMOVED<br>
3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss-<br>
5Fgpfsug.org&d=DwICAg&c=jf_iaSHvJObTbx-<br>
siA1ZOg&r=RGTETs2tk0Kz_VOpznDVDkqChhnfLapOTkxLvgmR2-<br>
M&m=a52vwqiBPgfri7y-<br>
rne9oRxqBKDxxYqKimhVU6ZxaEvmSVBVmMqWrcYU773cCoYM&s=01OGdeEg83s2fYkuf8BQ<br>
qhhMxUWiFPbvyedZrCqSDFc&e= <br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at gpfsug.org<br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a>
<br>
</div>
</span></font></div>
</body>
</html>