<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div>On Tue, 2018-01-09 at 09:09 +0000, Orlando Richards wrote:</div>
<blockquote type="cite">
<p><font size="-1"><font face="Tahoma">Hi all,</font></font></p>
<p><font size="-1"><font face="Tahoma"><br>
</font></font></p>
<p><font size="-1"><font face="Tahoma">If it helps - 4.2.3-6 compiles and starts fine on the RHEL 7.4 patched kernel: 3.10.0-693.11.6.el7.x86_64.<br>
</font></font></p>
</blockquote>
<div><br>
</div>
<div>We have 4.2.3-4 working fine on CentOS 7.4 with patched kernel 3.10-0-693.11.6.el7.x86_64.
</div>
<div><br>
</div>
<div>So far we have found CentOs 7.4 (patched and unpatched) to be faster than CentOS 7.3, but CentOs 7.4 patched to be slower than unpatched CentOs 7.4. But I've not seen the details as to this testing so can't really give any further details.</div>
<div><br>
</div>
<div>Peter</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<blockquote type="cite">
<p><font size="-1"><font face="Tahoma"></font></font></p>
<p><font size="-1"><font face="Tahoma"><br>
</font></font></p>
<p><font size="-1"><font face="Tahoma">______<br>
Orlando<br>
</font></font></p>
<p><font size="-1"><font face="Tahoma"><br>
</font></font></p>
<p><font size="-1"><font face="Tahoma"></font></font><br>
</p>
<br>
<div class="moz-cite-prefix">On 09/01/2018 03:46, <a class="moz-txt-link-abbreviated" href="mailto:Greg.Lehmann@csiro.au">
Greg.Lehmann@csiro.au</a> wrote:<br>
</div>
<blockquote type="cite" cite="mid:c6627601d1eb402388fd3429996832c6@exch1-cdc.nexus.csiro.au">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US">This had me wondering, so I tried SLES 12 SP3 and thankfully GPFS v5 still runs after the kernel patch and an mmbuildgpl. It was just
a test box I had at the time, so I don’t have any comments on performance.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" lang="EN-US">
<a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss-bounces@spectrumscale.org">
gpfsug-discuss-bounces@spectrumscale.org</a> [<a class="moz-txt-link-freetext" href="mailto:gpfsug-discuss-bounces@spectrumscale.org">mailto:gpfsug-discuss-bounces@spectrumscale.org</a>]
<b>On Behalf Of </b>Peinkofer, Stephan<br>
<b>Sent:</b> Tuesday, 9 January 2018 7:11 AM<br>
<b>To:</b> gpfsug main discussion list <a class="moz-txt-link-rfc2396E" href="mailto:gpfsug-discuss@spectrumscale.org">
<gpfsug-discuss@spectrumscale.org></a><br>
<b>Subject:</b> Re: [gpfsug-discuss] Meltdown, Spectre, and impacts on GPFS<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div id="divtagdefaultwrapper">
<p><span style="font-family:"Calibri",sans-serif;color:black">Dear List,<o:p></o:p></span></p>
<p><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p><span style="font-family:"Calibri",sans-serif;color:black">my very personal experience today, using the patched kernel for SLES 12.1 LTS (</span><span style="font-size:13.0pt;font-family:"Courier
New";color:#0D2C40">3.12.74-60.64.69.1</span><span style="font-family:"Calibri",sans-serif;color:black">)
on one single VM, was that GPFS (4.2.3-4) did not even start (the kernel modules seemed to compile fine using mmbuildgpl). Interestingly, even when I disabled PTI explicitely, using the nopti kernel option, GPFS refused to start with the same error!? <o:p></o:p></span></p>
<p><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<p><span style="font-family:"Calibri",sans-serif;color:black">mmfs.log always showed something like this:<o:p></o:p></span></p>
<p><span style="font-family:"Calibri",sans-serif;color:black">...<o:p></o:p></span></p>
<p><span style="font-family:"Calibri",sans-serif;color:black">/usr/lpp/mmfs/bin/runmmfs[336]: .[213]: loadKernelExt[674]: InsModWrapper[95]: eval: line 1: 3915: Memory fault<o:p></o:p></span></p>
<p><span style="font-family:"Calibri",sans-serif;color:black">...<o:p></o:p></span></p>
<p><span style="font-family:"Calibri",sans-serif;color:black">2018-01-08_09:01:27.520+0100 runmmfs: error in loading or unloading the mmfs kernel extension<o:p></o:p></span></p>
<p><span style="font-family:"Calibri",sans-serif;color:black">...<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">Since I had no time to investigate the issue further and raise a ticket right now, I just downgraded to the previous kernel and everything worked again.
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">As we have to patch at least the login nodes of our HPC clusters asap, I would also appreciate if we could get a statement from IBM how the KPTI patches are expected to interact
with GPFS and if there are any (general) problems, when we can expect updated GPFS packages.<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">Many thanks in advance.<br>
Best Regards, <o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">Stephan Peinkofer<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<div>
<div class="MsoNormal" style="text-align:center" align="center"><span style="font-family:"Calibri",sans-serif;color:black">
<hr size="3" align="center" width="98%">
</span></div>
<div id="divRplyFwdMsg">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:black">
<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" moz-do-not-send="true">
gpfsug-discuss-bounces@spectrumscale.org</a> <<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" moz-do-not-send="true">gpfsug-discuss-bounces@spectrumscale.org</a>> on behalf of Buterbaugh, Kevin L <<a href="mailto:Kevin.Buterbaugh@Vanderbilt.Edu" moz-do-not-send="true">Kevin.Buterbaugh@Vanderbilt.Edu</a>><br>
<b>Sent:</b> Monday, January 8, 2018 5:52 PM<br>
<b>To:</b> gpfsug main discussion list<br>
<b>Subject:</b> Re: [gpfsug-discuss] Meltdown, Spectre, and impacts on GPFS</span><span style="font-family:"Calibri",sans-serif;color:black">
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"> <o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">Hi GPFS Team,
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">Thanks for this response. If it is at all possible I know that we (and I would suspect many others are in this same boat) would greatly appreciate a update from IBM on how a patched
kernel impacts GPFS functionality. Yes, we’d love to know the performance impact of the patches on GPFS, but that pales in significance to knowing whether GPFS version 4.x.x.x will even *start* with the patched kernel(s).<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">Thanks again…<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">Kevin<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><br>
<br>
<o:p></o:p></span></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">On Jan 4, 2018, at 4:55 PM, IBM Spectrum Scale <<a href="mailto:scale@us.ibm.com" moz-do-not-send="true">scale@us.ibm.com</a>> wrote:<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black">Kevin,</span><span style="font-family:"Calibri",sans-serif;color:black"><br>
<br>
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black">The team is aware of Meltdown and Spectre. Due to the late availability of production-ready test patches (they became available today) we started today working on evaluating
the impact of applying these patches. The focus would be both on any potential functional impacts (especially to the kernel modules shipped with GPFS) and on the performance degradation which affects user/kernel mode transitions. Performance characterization
will be complex, as some system calls which may get invoked often by the mmfsd daemon will suddenly become significantly more expensive because of the kernel changes. Depending on the main areas affected, code changes might be possible to alleviate the impact,
by reducing frequency of certain calls, etc. Any such changes will be deployed over time.</span><span style="font-family:"Calibri",sans-serif;color:black"><br>
<br>
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black">At this point, we can't say what impact this will have on stability or Performance on systems running GPFS — until IBM issues an official statement on this topic. We hope to
have some basic answers soon. </span><span style="font-family:"Calibri",sans-serif;color:black"><br>
<br>
<br>
<br>
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black">Regards, The Spectrum Scale (GPFS) team<br>
<br>
------------------------------------------------------------------------------------------------------------------<br>
If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at
<a href="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fdeveloperworks%2Fcommunity%2Fforums%2Fhtml%2Fforum%3Fid%3D11111111-0000-0000-0000-000000000479&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C78bfa7bc56e6403dfa2008d553e510e7%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C636507165938314209&sdata=D%2BormYVXAwlnskLb525U2nuaUXncu5Wgt98V6U4xBZc%3D&reserved=0" moz-do-not-send="true">
https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479</a>.
<br>
<br>
If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries.
<br>
<br>
The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.</span><span style="font-family:"Calibri",sans-serif;color:black"><br>
<br>
<graycol.gif></span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:#424282">"Buterbaugh, Kevin L" ---01/04/2018 01:11:59 PM---Happy New Year everyone, I’m sure that everyone is aware of Meltdown and Spectre by now … we, like m</span><span style="font-family:"Calibri",sans-serif;color:black"><br>
<br>
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:#5F5F5F">From:
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black">"Buterbaugh, Kevin L" <<a href="mailto:Kevin.Buterbaugh@Vanderbilt.Edu" moz-do-not-send="true">Kevin.Buterbaugh@Vanderbilt.Edu</a>></span><span style="font-family:"Calibri",sans-serif;color:black"><br>
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:#5F5F5F">To:
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" moz-do-not-send="true">gpfsug-discuss@spectrumscale.org</a>></span><span style="font-family:"Calibri",sans-serif;color:black"><br>
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:#5F5F5F">Date:
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black">01/04/2018 01:11 PM</span><span style="font-family:"Calibri",sans-serif;color:black"><br>
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:#5F5F5F">Subject:
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black">[gpfsug-discuss] Meltdown, Spectre, and impacts on GPFS</span><span style="font-family:"Calibri",sans-serif;color:black"><br>
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:#5F5F5F">Sent by:
</span><span style="font-size:10.0pt;font-family:"Calibri",sans-serif;color:black"><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" moz-do-not-send="true">gpfsug-discuss-bounces@spectrumscale.org</a></span><span style="font-family:"Calibri",sans-serif;color:black"><o:p></o:p></span></p>
<div class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black">
<hr style="color:#8091A5" size="2" align="left" noshade="noshade" width="100%">
</span></div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-family:"Calibri",sans-serif;color:black"><br>
<br>
<br>
Happy New Year everyone, <br>
<br>
I’m sure that everyone is aware of Meltdown and Spectre by now … we, like many other institutions, will be patching for it at the earliest possible opportunity.<br>
<br>
Our understanding is that the most serious of the negative performance impacts of these patches will be for things like I/O (disk / network) … given that, we are curious if IBM has any plans for a GPFS update that could help mitigate those impacts? Or is there
simply nothing that can be done?<br>
<br>
If there is a GPFS update planned for this we’d be interested in knowing so that we could coordinate the kernel and GPFS upgrades on our cluster.<br>
<br>
Thanks…<br>
<br>
Kevin<br>
<br>
P.S. The “Happy New Year” wasn’t intended as sarcasm … I hope it is a good year for everyone despite how it’s starting out. :-O<br>
<br>
—<br>
Kevin Buterbaugh - Senior System Administrator<br>
Vanderbilt University - Advanced Computing Center for Research and Education<br>
<a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" moz-do-not-send="true">Kevin.Buterbaugh@vanderbilt.edu</a> - (615)875-9633<o:p></o:p></span></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span style="font-family:"Calibri",sans-serif;color:black"><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset> <br>
<pre wrap="">_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
<a class="moz-txt-link-freetext" href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a>
</pre>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<div style="color: rgb(34, 34, 34); font-family: tahoma,
sans-serif; font-size: 12.8px; font-style: normal;
font-variant-ligatures: normal; font-variant-caps: normal;
font-weight: normal; letter-spacing: normal; orphans: 2;
text-align: start; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(255, 255,
255);">
<font color="#000000"><b>Orlando Richards</b></font></div>
<div style="color: rgb(34, 34, 34); font-size: 12.8px; font-style:
normal; font-variant-ligatures: normal; font-variant-caps:
normal; font-weight: normal; letter-spacing: normal; orphans: 2;
text-align: start; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(255, 255,
255); font-family: arial, sans-serif;">
<span style="font-family:
tahoma, sans-serif;">VP Product Development, Pixit Media</span><br>
</div>
<div style="color: rgb(34, 34, 34); font-size: 12.8px; font-style:
normal; font-variant-ligatures: normal; font-variant-caps:
normal; font-weight: normal; letter-spacing: normal; orphans: 2;
text-align: start; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(255, 255,
255); font-family: arial, sans-serif;">
<span style="color:
rgb(102, 102, 102); font-family: tahoma, sans-serif;">07930742808</span><span style="color: rgb(102, 102, 102); font-family: tahoma,
sans-serif;">
</span><font face="tahoma, sans-serif"><font color="#cc0000">|<span class="Apple-converted-space">
</span></font><font color="#666666"><a href="mailto:orichards@pixitmedia.com" target="_blank" style="color: rgb(17, 85, 204);">orichards@pixitmedia.com</a></font></font></div>
<div style="color: rgb(34, 34, 34); font-size: 12.8px; font-style:
normal; font-variant-ligatures: normal; font-variant-caps:
normal; font-weight: normal; letter-spacing: normal; orphans: 2;
text-align: start; text-indent: 0px; text-transform: none;
white-space: normal; widows: 2; word-spacing: 0px;
-webkit-text-stroke-width: 0px; background-color: rgb(255, 255,
255); font-family: arial, sans-serif;">
<font color="#666666"><font face="tahoma, sans-serif"><a href="http://www.pixitmedia.com/" target="_blank" data-saferedirecturl="https://www.google.com/url?hl=en-GB&q=http://www.pixitmedia.com/&source=gmail&ust=1479544280687000&usg=AFQjCNEDsUDuC-v8sl86cvU9RyK7fvWnww" style="color: rgb(17, 85, 204);">www.pixitmedia.com</a>
|</font><font style="font-size: 12.8px;" face="tahoma, sans-serif"> </font><a href="https://twitter.com/PixitMedia?lang=en" target="_blank" data-saferedirecturl="https://www.google.com/url?hl=en-GB&q=https://twitter.com/PixitMedia?lang%3Den&source=gmail&ust=1479544280687000&usg=AFQjCNFqUOUQQoOzdX6X96FZOvuhwuydoQ" style="color: rgb(17, 85, 204); font-size: 12.8px;"><span style="font-size: 12.8px; font-family: tahoma,
sans-serif;">Tw</span><span style="font-size: 12.8px;
font-family: tahoma, sans-serif;">:@pixit<wbr>media</span></a></font></div>
<br>
</div>
<br>
<div><a href="mailto:info@pixitmedia.com" target="_blank"><img src="http://pixitmedia.com/sig/pixitmedia-9-2018.png"></a><br>
<font face="Arial, Helvetica, sans-serif" size="1">This email is confidential in that it is intended for the exclusive attention of the addressee(s) indicated. If you are not the intended recipient, this email should not be read or disclosed to any other person.
Please notify the sender immediately and delete this email from your computer system. Any opinions expressed are not necessarily those of the company from which this email was sent and, whilst to the best of our knowledge no viruses or defects exist, no responsibility
can be accepted for any loss or damage arising from its receipt or subsequent use of this email.</font></div>
<pre>_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a>
</pre>
</blockquote>
<div><span>
<pre>-- <br></pre>
<div style="width: 71ch;">Peter Childs</div>
<div style="width: 71ch;">ITS Research Storage</div>
<div style="width: 71ch;">Queen Mary, University of London</div>
<div style="width: 71ch;"><br>
</div>
</span></div>
</body>
</html>