<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title></title>
</head>
<body>
<div name="messageBodySection" style="font-size: 14px; font-family: -apple-system, BlinkMacSystemFont, sans-serif;">We do run Singularity + GPFS, on our production HPC clusters.
<div>Most of the time things are fine without any issues.</div>
<div><br /></div>
<div>However, i do see a significant performance loss when running some applications on singularity containers with GPFS.</div>
<div><br /></div>
<div>As of now, the applications that have severe performance issues with singularity on GPFS - seem to be because of “mmap io”. (Deep learning applications)</div>
<div>When i run the same application on bare metal, they seem to have a huge difference in GPFS IO when compared to running on singularity containers.</div>
<div>I am yet to raise a PMR about this with IBM.<br /></div>
<div>I have not seen performance degradation for any other kind of IO, but i am not sure.</div>
</div>
<div name="messageSignatureSection" style="font-size: 14px; font-family: -apple-system, BlinkMacSystemFont, sans-serif;"><br />
Regards,<br />
Lohit</div>
<div name="messageReplySection" style="font-size: 14px; font-family: -apple-system, BlinkMacSystemFont, sans-serif;"><br />
On Apr 26, 2018, 10:35 AM -0400, Nathan Harper <nathan.harper@cfms.org.uk>, wrote:<br />
<blockquote type="cite" style="margin: 5px 5px; padding-left: 10px; border-left: thin solid #1abc9c;">
<div dir="ltr">We are running on a test system at the moment, and haven't run into any issues yet, but so far it's only been 'hello world' and running FIO.
<div><br /></div>
<div>I'm interested to hear about experience with MPI-IO within Singularity.</div>
</div>
<div class="gmail_extra"><br />
<div class="gmail_quote">On 26 April 2018 at 15:20, Oesterlin, Robert <span dir="ltr"><<a href="mailto:Robert.Oesterlin@nuance.com" target="_blank">Robert.Oesterlin@nuance.com</a>></span> wrote:<br />
<blockquote class="gmail_quote" style="margin: 5px 5px; padding-left: 10px; border-left: thin solid #e67e22;">
<div lang="EN-US" link="#0563C1" vlink="#954F72" xml:lang="EN-US">
<div class="m_1223698326895755637WordSection1">
<p class="MsoNormal">Anyone (including IBM) doing any work in this area? I would appreciate hearing from you.<u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><u></u> <u></u></span></p>
<p class="MsoNormal">Bob Oesterlin<u></u><u></u></p>
<p class="MsoNormal">Sr Principal Storage Engineer, Nuance<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<br />
______________________________<wbr />_________________<br />
gpfsug-discuss mailing list<br />
gpfsug-discuss at <a href="http://spectrumscale.org" rel="noreferrer" target="_blank">spectrumscale.org</a><br />
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/<wbr />listinfo/gpfsug-discuss</a><br />
<br /></blockquote>
</div>
<br />
<br clear="all" />
<div><br /></div>
--<br />
<div class="gmail_signature" data-smartmail="gmail_signature">
<div style="color:rgb(34,34,34);background-color:rgb(255,255,255)"><b style="font-family:Arial;font-size:small">Nathan<span style="color:rgb(81,80,88)"> </span>Harper</b><span style="font-family:Arial;font-size:small;color:rgb(0,174,255)"> // </span><font size="2" style="font-family:Arial">IT Systems Lead</font></div>
<div style="color:rgb(34,34,34);background-color:rgb(255,255,255)"><font size="2" style="font-family:Arial"><br /></font></div>
<div style="color:rgb(34,34,34);background-color:rgb(255,255,255)"><a href="https://cfms.org.uk/news-events/events/2018/july/farnborough-international-airshow-2018/" target="_blank"><img style="width:500px;height:105px" src="https://cfms.org.uk/media/267028/fia-email-sig-blue-dark-3.jpg" /></a></div>
<div style="color:rgb(34,34,34);background-color:rgb(255,255,255)"><br />
<font face="Arial" size="1"><strong><span style="color:rgb(0,174,255)">e: </span></strong><a href="mailto:nathan.harper@cfms.org.uk" style="color:rgb(81,80,88)" target="_blank">nathan.harper@cfms.org.uk</a> <span style="color:rgb(0,174,255)"> </span><font color="#222222"> </font><font color="#00AEFF"><b>t</b>:</font><font color="#222222"> 0117 906 1104</font> <font color="#222222"> </font><font color="#00AEFF"><b>m</b>:</font><font color="#222222"> 0787 551 0891 </font><span style="color:rgb(0,174,255)"> <strong>w: </strong></span><a href="http://www.cfms.org.uk/" rel="noreferrer" style="color:rgb(81,80,88)" target="_blank">www.cfms.org.uk</a> <span style="color:rgb(0,174,255)"> </span></font></div>
<div style="color:rgb(34,34,34);background-color:rgb(255,255,255)"><font face="Arial" size="1"><span style="color:rgb(81,80,88)">CFMS Services Ltd</span><span style="color:rgb(0,174,255)"> // </span><span style="color:rgb(81,80,88)">Bristol & Bath Science Park</span> <span style="color:rgb(0,174,255)">//</span> <span style="color:rgb(81,80,88)">Dirac Crescent</span> <span style="color:rgb(0,174,255)">//</span> <span style="color:rgb(81,80,88)">Emersons Green</span> <span style="color:rgb(0,174,255)">//</span> <span style="color:rgb(81,80,88)">Bristol</span> <span style="color:rgb(0,174,255)">//</span> <span style="color:rgb(81,80,88)">BS16 7FR</span> </font></div>
<div style="color:rgb(34,34,34);background-color:rgb(255,255,255)"><font face="Verdana" style="font-size:small"><img src="http://cfms.org.uk/images/logo.png" /> </font></div>
<div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;background-color:rgb(255,255,255)"><span style="font-family:Verdana"><span style="color:rgb(81,80,88);font-size:xx-small">CFMS Services Ltd is registered in England and Wales No 05742022 - a subsidiary of CFMS Ltd</span> <br />
<span style="color:rgb(81,80,88);font-size:xx-small">CFMS Services Ltd registered office // </span></span><font color="#515058" face="Verdana"><span style="font-size:xx-small">43 Queens Square // Bristol // BS1 4QP</span></font></div>
</div>
</div>
_______________________________________________<br />
gpfsug-discuss mailing list<br />
gpfsug-discuss at spectrumscale.org<br />
http://gpfsug.org/mailman/listinfo/gpfsug-discuss<br /></blockquote>
</div>
</body>
</html>