[gpfsug-discuss] [EXTERNAL] Re: Connecting IBM ESS 3200 to 10 Gb Ethernet

[Henson Jr.,Larry J]

We replaced two FS900 flash units with 8x8Gb FC on each unit with commodity Dell sever with two ESS3200 using 2x100GbE on each unit/controller and our metadata is 40% faster with 1.8 billion files in the file system.  So it pays to upgrade the speed to as fast as you can afford.

Best Regards,
Larry Henson
IT Engineering Storage Team
Office (832) 750-1403
Cell (713) 702-4896
[cid:image001.png at 01D997A4.BC4C2D80]
From: gpfsug-discuss <gpfsug-discuss-bounces at gpfsug.org> On Behalf Of Alec
Sent: Monday, June 5, 2023 11:41 AM
To: gpfsug main discussion list <gpfsug-discuss at gpfsug.org>
Subject: [EXTERNAL] Re: [gpfsug-discuss] Connecting IBM ESS 3200 to 10 Gb Ethernet

THIS EMAIL IS A PHISHING RISK


Do you trust the sender?
The email address is: gpfsug-discuss-bounces at gpfsug.org<mailto:gpfsug-discuss-bounces at gpfsug.org>
While this email has passed our filters, we need you to review with caution before taking any action.
If the email looks at all suspicious, click the Report a Phish button.


Many network storage engineers simply don't understand bandwidth (or the importance of port groups)...  With an ESS you are talking GIGA*BYTES* per second and storage and networking architects simply see 10Gbe and assume that's good enough.  A 10Gbe connection can do about 1.4GB/s..  100Gbe can do 12.5GB/s.   To the wrong engineer you can explain this until you're blue in the face and they won't get it.  You need to divide Gbe by 8 to get about the GB/s throughput.  Explain to them that a USB-C interface is capable of 10Gbe... So you're throttling millions of dollars in technology to the speed of a consumer grade USB-C interface.  When infact an ESS can drive at least 2x100Gbe to saturation.

I don't have an ESS but a classic SAN array and Spectrum Scale and I can saturate 32*8Gbe fiber connections.

Alec

On Mon, Jun 5, 2023, 8:56 AM Andrew Beattie <abeattie at au1.ibm.com<mailto:abeattie at au1.ibm.com>> wrote:
Prasad,

You would be better off looking at the following:

https://www.nvidia.com/en-au/networking/ethernet/cable-accessories/<https://urldefense.com/v3/__https:/www.nvidia.com/en-au/networking/ethernet/cable-accessories/__;!!PfbeBCCAmug!jmAmqSobWPpE5V4hUEfLxp6yNbcYtZu-9x66128owzvoc1eWOR5z8L4aNjBhpLRuFKNjMzpQ-ggSmAeUZQ$>

This will allow you to adapt from the QSFP+ 100GB transceiver down to a SFP+ 10GB transceiver and then use standard OM4 cable and Cisco 10GB transceivers at the other end.

However I will also comment that using 10GB network for an all flash ESS is a bit like buying an F1 racing car and never taking it out of first gear.

You would honestly be better investing in a single 100GB switch to at least build the ESS cluster at 100Gbit and getting the full potential bandwidth from your investment in NVMe

Otherwise buy a FS5200 + 2 x86 servers and some scale licensing, because you are down rating the ESS3200 to less than 25% of its potential performance


Regards,

Andrew Beattie
Technical Sales Specialist - Storage for Big Data & AI
IBM Australia and New Zealand
P. +61 421 337 927
E. abeattie at au1.ibm.com<mailto:abeattie at au1.ibm.com>
Twitter: AndrewJBeattie
LinkedIn:
________________________________
From: gpfsug-discuss <gpfsug-discuss-bounces at gpfsug.org<mailto:gpfsug-discuss-bounces at gpfsug.org>> on behalf of Prasad Surampudi <prasad.surampudi at theatsgroup.com<mailto:prasad.surampudi at theatsgroup.com>>
Sent: Monday, June 5, 2023 11:24:01 PM
To: gpfsug-discuss at gpfsug.org<mailto:gpfsug-discuss at gpfsug.org> <gpfsug-discuss at gpfsug.org<mailto:gpfsug-discuss at gpfsug.org>>
Subject: [EXTERNAL] [gpfsug-discuss] Connecting IBM ESS 3200 to 10 Gb Ethernet

Does anyone know if we can connect IBM ESS 3200 to a customer 10 Gb ethernet network? If so what cables we need to connect it to a Cisco C93180YC-EX switch? Does it support 100 Gb to 4x10 GB fanout connections? Prasad Surampudi | Sr. Systems
ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.

ZjQcmQRYFpfptBannerEnd



Does anyone know if we can connect IBM ESS 3200 to a customer 10 Gb ethernet network? If so what cables  we need to connect it to a Cisco C93180YC-EX switch? Does it support 100 Gb to 4x10 GB fanout connections?

Prasad Surampudi | Sr. Systems Enginee
prasad.surampudi at theatsgr<mailto:prasad.surampudi at theatsgroup.com>oup.com<mailto:prasad.surampudi at theatsgroup.com> | 302.419.5833

Innovative IT consulting & modern infrastructure solutions
www.theatsgroup.com<https://urldefense.com/v3/__http:/theatsgroup.com__;!!PfbeBCCAmug!jmAmqSobWPpE5V4hUEfLxp6yNbcYtZu-9x66128owzvoc1eWOR5z8L4aNjBhpLRuFKNjMzpQ-giHl4qp_w$>
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org<https://urldefense.com/v3/__http:/gpfsug.org__;!!PfbeBCCAmug!jmAmqSobWPpE5V4hUEfLxp6yNbcYtZu-9x66128owzvoc1eWOR5z8L4aNjBhpLRuFKNjMzpQ-gjmhCxIGA$>
http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org<https://urldefense.com/v3/__http:/gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org__;!!PfbeBCCAmug!jmAmqSobWPpE5V4hUEfLxp6yNbcYtZu-9x66128owzvoc1eWOR5z8L4aNjBhpLRuFKNjMzpQ-gjlkfhRRQ$>

The information contained in this e-mail message may be privileged, confidential, and/or protected from disclosure. This e-mail message may contain protected health information (PHI); dissemination of PHI should comply with applicable federal and state laws. If you are not the intended recipient, or an authorized representative of the intended recipient, any further review, disclosure, use, dissemination, distribution, or copying of this message or any attachment (or the information contained therein) is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender by return e-mail and delete all references to it and its contents from your systems.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20230605/bb5e1439/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 19425 bytes
Desc: image001.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20230605/bb5e1439/attachment-0001.png>