<div dir="ltr"><div>Hi</div><div><br></div><div>We are currently running Spectrum Scale over FDR Infiniband.  We plan on upgrading to EDR since I have not really encountered documentation saying to abandon the lower-latency advantage found in <span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">Infiniband.  Our workloads generally benefit from lower latency.</span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">It looks like, ignoring GPFS, EDR still has higher throughput and lower latency when compared to 100G RoCEE.  </span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><a href="http://sc16.supercomputing.org/sc-archive/tech_poster/poster_files/post149s2-file3.pdf">http://sc16.supercomputing.org/sc-archive/tech_poster/poster_files/post149s2-file3.pdf</a><br></span></div><div><br></div><div>However, I wanted to get feedback on how GPFS performs with 100G Ethernet instead of FDR.</div><div><br></div><div>Thanks very much!</div><div><br></div><div>Doug</div><br clear="all"><div><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div style="font-size:small"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">Thanks,</div><div dir="ltr"><br>Douglas Duckworth, MSc, LFCS<br>HPC System Administrator<br><span style="font-size:12.8px">Scientific Computing Unit</span><br></div><div dir="ltr">Physiology and Biophysics</div><div dir="ltr">Weill Cornell Medicine<div>E: <a href="mailto:doug@med.cornell.edu" target="_blank">doug@med.cornell.edu</a><br>O: 212-746-6305<br>F: 212-746-8690</div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
</div>