<div dir="ltr">OK slightly ignore that last email. It's still not updating the output but I realise the Stats from line is when they started so probably won't update! :(<div><br></div><div>Still nothing seems to being cached though.<br><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><span style="color:rgb(136,136,136);font-family:arial,helvetica,sans-serif">------------------------------</span><span style="color:rgb(136,136,136);font-family:arial,helvetica,sans-serif">----------------------</span><b style="color:rgb(136,136,136);font-family:arial,helvetica,sans-serif"><br></b></div><b style="color:rgb(136,136,136);font-family:arial,helvetica,sans-serif">Dave Goodbourn</b><br><span style="font-family:arial,helvetica,sans-serif;color:rgb(136,136,136)"><div dir="ltr"><div><font size="1">Head of Systems</font></div><div><font size="1"><b><a href="http://www.milk-vfx.com/" style="color:rgb(17,85,204)" target="_blank">MILK</a> VISUAL EFFECTS</b></font></div></div></span><span style="font-family:arial,helvetica,sans-serif"><img src="http://www.milk-vfx.com/src/milk_email_logo.jpg"><br></span><font size="1" style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(136,136,136)"><div dir="ltr"><div>5th floor, Threeways House,</div><div>40-44 Clipstone Street London, W1W 5DW</div><div>Tel: <a value="+442036978448" style="color:rgb(17,85,204)"><b>+44 (0)20 3697 8448</b></a></div></div></span><span style="color:rgb(136,136,136)">Mob: <a value="+442036978448" style="color:rgb(17,85,204)"><b>+44 (0)7917 411 069</b></a></span></font><br></div></div></div>
<br><div class="gmail_quote">On 5 June 2017 at 14:49, Dave Goodbourn <span dir="ltr"><<a href="mailto:dave@milk-vfx.com" target="_blank">dave@milk-vfx.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Thanks Bob,<div><br></div><div>That pagepool comment has just answered my next question!</div><div><br></div><div>But it doesn't seem to be working. Here's my mmdiag output:</div><div><br></div><div><div>=== mmdiag: lroc ===</div><div>LROC Device(s): '0AF0000259355BA8#/dev/sdb;<wbr>0AF0000259355BA9#/dev/sdc;<wbr>0AF0000259355BAA#/dev/sdd;' status Running</div><div>Cache inodes 1 dirs 1 data 1 Config: maxFile 0 stubFile 0</div><div>Max capacity: 1151997 MB, currently in use: 0 MB</div><div>Statistics from: Mon Jun 5 13:40:50 2017</div><div><br></div><div>Total objects stored 0 (0 MB) recalled 0 (0 MB)</div><div> objects failed to store 0 failed to recall 0 failed to inval 0</div><div> objects queried 0 (0 MB) not found 0 = 0.00 %</div><div> objects invalidated 0 (0 MB)</div><div><br></div><div> Inode objects stored 0 (0 MB) recalled 0 (0 MB) = 0.00 %</div><div> Inode objects queried 0 (0 MB) = 0.00 % invalidated 0 (0 MB)</div><div> Inode objects failed to store 0 failed to recall 0 failed to query 0 failed to inval 0</div><div><br></div><div> Directory objects stored 0 (0 MB) recalled 0 (0 MB) = 0.00 %</div><div> Directory objects queried 0 (0 MB) = 0.00 % invalidated 0 (0 MB)</div><div> Directory objects failed to store 0 failed to recall 0 failed to query 0 failed to inval 0</div><div><br></div><div> Data objects stored 0 (0 MB) recalled 0 (0 MB) = 0.00 %</div><div> Data objects queried 0 (0 MB) = 0.00 % invalidated 0 (0 MB)</div><div> Data objects failed to store 0 failed to recall 0 failed to query 0 failed to inval 0</div><div><br></div><div> agent inserts=0, reads=0</div><div> response times (usec):</div><div> insert min/max/avg=0/0/0</div><div> read min/max/avg=0/0/0</div><div><br></div><div> ssd writeIOs=0, writePages=0</div><div> readIOs=0, readPages=0</div><div> response times (usec):</div><div> write min/max/avg=0/0/0</div><div> read min/max/avg=0/0/0</div></div><div><br></div><div><br></div><div>I've restarted GPFS on that node just in case but that didn't seem to help. I have LROC on a node that DOESN'T have direct access to an NSD so will hopefully cache files that get requested over NFS.</div><div><br></div><div>How often are these stats updated? The Statistics line doesn't seem to update when running the command again.</div><div><br></div><div>Dave,</div><div><div class="gmail_extra"><div><div class="m_6859838774303896874gmail_signature"><div dir="ltr"><div><span style="color:rgb(136,136,136);font-family:arial,helvetica,sans-serif">------------------------------</span><span style="color:rgb(136,136,136);font-family:arial,helvetica,sans-serif"><wbr>----------------------</span><b style="color:rgb(136,136,136);font-family:arial,helvetica,sans-serif"><br></b></div><b style="color:rgb(136,136,136);font-family:arial,helvetica,sans-serif">Dave Goodbourn</b><br><span style="font-family:arial,helvetica,sans-serif;color:rgb(136,136,136)"><div dir="ltr"><div><font size="1">Head of Systems</font></div><div><font size="1"><b><a href="http://www.milk-vfx.com/" style="color:rgb(17,85,204)" target="_blank">MILK</a> VISUAL EFFECTS</b></font></div></div></span><span style="font-family:arial,helvetica,sans-serif"><img src="http://www.milk-vfx.com/src/milk_email_logo.jpg"><br></span><font size="1" style="font-family:arial,helvetica,sans-serif"><span style="color:rgb(136,136,136)"><div dir="ltr"><div>5th floor, Threeways House,</div><div>40-44 Clipstone Street London, W1W 5DW</div><div>Tel: <a value="+442036978448" style="color:rgb(17,85,204)"><b>+44 (0)20 3697 8448</b></a></div></div></span><span style="color:rgb(136,136,136)">Mob: <a value="+442036978448" style="color:rgb(17,85,204)"><b>+44 (0)7917 411 069</b></a></span></font><br></div></div></div>
<br><div class="gmail_quote">On 5 June 2017 at 13:48, Oesterlin, Robert <span dir="ltr"><<a href="mailto:Robert.Oesterlin@nuance.com" target="_blank">Robert.Oesterlin@nuance.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div bgcolor="white" lang="EN-US">
<div class="m_6859838774303896874gmail-m_-5769689153631178415WordSection1">
<p class="MsoNormal">Hi Dave<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I’ve done a large-scale (600 node) LROC deployment here - feel free to reach out if you have questions.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">mmdiag --lroc is about all there is but it does give you a pretty good idea how the cache is performing but you can’t tell which files are cached. Also, watch out that the LROC cached will steal pagepool memory (1% of the LROC cache size)<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">Bob Oesterlin<br>
Sr Principal Storage Engineer, Nuance<br>
<br>
<u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:12pt;font-family:"Times New Roman",serif"><u></u> <u></u></span></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0in 0in">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">From: </span></b><span style="font-size:12pt;color:black"><<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectr<wbr>umscale.org</a>> on behalf of Dave Goodbourn <<a href="mailto:dave@milk-vfx.com" target="_blank">dave@milk-vfx.com</a>><br>
<b>Reply-To: </b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.<wbr>org</a>><br>
<b>Date: </b>Monday, June 5, 2017 at 7:19 AM<br>
<b>To: </b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.<wbr>org</a>><br>
<b>Subject: </b>[EXTERNAL] Re: [gpfsug-discuss] NSD access routes<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:-webkit-standard,serif;color:black">I'm testing out the LROC idea. All seems to be working well, but, is there anyway to monitor what's cached? How full it might be? The performance etc??<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:-webkit-standard,serif;color:black"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:-webkit-standard,serif;color:black">I can see some stats in mmfsadm dump lroc but that's about it.<u></u><u></u></span></p>
</div>
<p class="MsoNormal"><br>
<br>
<u></u><u></u></p>
</div>
</div>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div></div></div>