<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<meta content="text/html; charset=Windows-1252">
</head>
<body>
Yes, we run mmbackup, using a snapshot.<br>
<br>
The scan usally takes an hour, but for the last week has been taking many hours (i saw it take 12 last Tuesday)<br>
<br>
It's speeded up again now back to its normal hour, but the high io jobs accessing the same file from many nodes also look to have come to an end for the time being.<br>
<br>
I was trying to figure out howto control the bad io using mmchqos, to prioritise certain nodes over others but had not worked out if that was possible yet.<br>
<br>
We've only previously seen this problem when we had some bad disks in our storage, which we replaced, I've checked and I can't see that issue currently.<br>
<br>
Thanks for the help.<br>
<br>
<br>
<br>
Peter Childs<br>
Research Storage<br>
ITS Research and Teaching Support<br>
Queen Mary, University of London<br>
<br>
---- Yaron Daniel wrote ----<br>
<br>
<div><span style="font-size:10pt; font-family:sans-serif">Hi</span><br>
<br>
<span style="font-size:10pt; font-family:sans-serif">Do u run mmbackup on snapshot , which is read only ?<br>
</span><br>
<span style="font-size:9pt; font-family:Arial"> </span><br>
<span style="font-size:10pt; font-family:Arial">Regards</span><br>
<span style="font-size:9pt; font-family:Arial"> </span><br>
<table width="780" style="border-collapse:collapse">
<tbody>
<tr height="8">
<td width="780" colspan="4" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<div align="center">
<hr noshade="">
</div>
<br>
<span style="font-size:1pt; font-family:Arial"> </span></td>
</tr>
<tr height="8">
<td width="780" colspan="4" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:1pt; font-family:Arial"> </span></td>
</tr>
<tr height="8">
<td width="516" colspan="2" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:blue; font-family:Arial"><b>Yaron Daniel</b></span></td>
<td width="168" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial"> 94 Em Ha'Moshavot Rd</span></td>
<td width="96" rowspan="3" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<div align="right"><img align="bottom" src="cid:_1_0C9372140C936C60006FF189C22582D1" style="border:0px solid"></div>
</td>
</tr>
<tr height="8">
<td width="516" colspan="2" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:blue; font-family:Arial"><b>Storage Architect – IL Lab Services (Storage)</b></span></td>
<td width="168" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial"> Petach Tiqva, 49527</span></td>
</tr>
<tr height="8">
<td width="516" colspan="2" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:blue; font-family:Arial"><b>IBM Global Markets, Systems HW Sales</b></span></td>
<td width="168" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial"> Israel</span></td>
</tr>
<tr height="8">
<td width="516" colspan="2" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:blue; font-family:Arial"><b> </b></span></td>
<td width="168" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial"> </span></td>
<td width="96" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:9pt; font-family:Arial"> </span></td>
</tr>
<tr height="8">
<td width="90" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial">Phone:</span></td>
<td width="426" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial">+972-3-916-5672</span></td>
<td width="168" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial"> </span></td>
<td width="96" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt"> </span></td>
</tr>
<tr height="8">
<td width="90" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial">Fax:</span></td>
<td width="426" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial">+972-3-916-5672</span></td>
<td width="168" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial"> </span></td>
<td width="96" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt"> </span></td>
</tr>
<tr height="8">
<td width="90" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial">Mobile:</span></td>
<td width="426" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial">+972-52-8395593</span></td>
<td width="168" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial"> </span></td>
<td width="96" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt"> </span></td>
</tr>
<tr height="8">
<td width="90" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial">e-mail:</span></td>
<td width="426" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial">yard@il.ibm.com</span></td>
<td width="168" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial"> </span></td>
<td width="96" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt"> </span></td>
</tr>
<tr height="8">
<td width="516" colspan="2" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<a href="http://www.ibm.com/il/he/"><span style="font-size:10pt; color:blue; font-family:Arial"><u>IBM Israel</u></span></a></td>
<td width="168" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt; color:#5f5f5f; font-family:Arial"> </span></td>
<td width="96" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:10pt"> </span></td>
</tr>
<tr height="8">
<td width="780" colspan="4" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:9pt; color:#5f5f5f; font-family:Arial"> </span></td>
</tr>
<tr height="8">
<td width="780" colspan="4" style="border-style:none none none none; border-color:#000000; border-width:0px 0px 0px 0px; padding:0px 0px">
<span style="font-size:9pt; color:#5f5f5f; font-family:Arial"> </span></td>
</tr>
</tbody>
</table>
<p style="margin-top:0px; margin-bottom:0px"></p>
<br>
<img src="cid:_1_0C9302DC0C92FECC006FF189C22582D1" alt="IBM Storage Strategy and Solutions v1" style="border:0px solid"><img src="cid:_1_0C9304E40C92FECC006FF189C22582D1" alt="IBM Storage Management and Data Protection v1" style="border:0px solid"><img src="cid:_1_0C9306EC0C92FECC006FF189C22582D1" style="border:0px solid"><img src="cid:_1_0C9308F40C92FECC006FF189C22582D1" style="border:0px solid"><span style="font-size:12pt"> </span><img src="cid:_1_0C930B140C92FECC006FF189C22582D1" alt="https://acclaim-production-app.s3.amazonaws.com/images/6c2c3858-6df8-45be-ac2b-f93b8da74e20/Data%2BDriven%2BMulti%2BCloud%2BStrategy%2BV1%2Bver%2B4.png" style="border:0px solid"><span style="font-size:12pt">
</span><img src="cid:_2_0C930D600C92FECC006FF189C22582D1" alt="Related image" style="border:0px solid"><br>
<br>
<br>
<br>
<span style="font-size:9pt; color:#5f5f5f; font-family:sans-serif">From: </span><span style="font-size:9pt; font-family:sans-serif">Peter Childs <p.childs@qmul.ac.uk></span><br>
<span style="font-size:9pt; color:#5f5f5f; font-family:sans-serif">To: </span><span style="font-size:9pt; font-family:sans-serif">"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org></span><br>
<span style="font-size:9pt; color:#5f5f5f; font-family:sans-serif">Date: </span><span style="font-size:9pt; font-family:sans-serif">07/10/2018 05:51 PM</span><br>
<span style="font-size:9pt; color:#5f5f5f; font-family:sans-serif">Subject: </span><span style="font-size:9pt; font-family:sans-serif">[gpfsug-discuss] Same file opened by many nodes / processes</span><br>
<span style="font-size:9pt; color:#5f5f5f; font-family:sans-serif">Sent by: </span><span style="font-size:9pt; font-family:sans-serif">gpfsug-discuss-bounces@spectrumscale.org</span><br>
<hr noshade="">
<br>
<br>
<br>
<tt><span style="font-size:10pt">We have an situation where the same file is being read by around 5000<br>
"jobs" this is an array job in uge with a tc set, so the file in<br>
question is being opened by about 100 processes/jobs at the same time.<br>
<br>
Its a ~200GB file so copying the file locally first is not an easy<br>
answer, and these jobs are causing issues with mmbackup scanning the<br>
file system, in that the scan is taking 3 hours instead of the normal<br>
40-60 minutes.<br>
<br>
This is read only access to the file, I don't know the specifics about<br>
the job.<br>
<br>
It looks like the metanode is moving around a fair amount (given what I<br>
can see from mmfsadm saferdump file)<br>
<br>
I'm wondering if we there is anything we can do to improve things or<br>
that can be tuned within GPFS, I'm don't think we have an issue with<br>
token management, but would increasing maxFileToCache on our token<br>
manager node help say?<br>
<br>
Is there anything else I should look at, to try and attempt to allow<br>
GPFS to share this file better.<br>
<br>
Thanks in advance<br>
<br>
Peter Childs<br>
<br>
-- <br>
Peter Childs<br>
ITS Research Storage<br>
Queen Mary, University of London<br>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
</span></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><span style="font-size:10pt">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><tt><span style="font-size:10pt"><br>
<br>
</span></tt><br>
<br>
<br>
</div>
</body>
</html>