<div dir="ltr">mmlspdisk all --not-ok does not indicate any failed hard drives.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jul 10, 2019 at 7:22 AM Buterbaugh, Kevin L <<a href="mailto:Kevin.Buterbaugh@vanderbilt.edu">Kevin.Buterbaugh@vanderbilt.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<div style="word-wrap:break-word;line-break:after-white-space">
Hi Damir,
<div><br>
</div>
<div>Have you checked to see whether gssio4 might have a failing internal HD / SSD? Thanks…</div>
<div><br>
</div>
<div>Kevin<br>
<div><br>
<blockquote type="cite">
<div>On Jul 10, 2019, at 7:16 AM, Damir Krstic <<a href="mailto:damir.krstic@gmail.com" target="_blank">damir.krstic@gmail.com</a>> wrote:</div>
<br class="gmail-m_6837999923616735217Apple-interchange-newline">
<div>
<div dir="ltr">
<div dir="ltr">Over last couple of days our reads and writes on our compute cluster are experiencing real slow reads and writes on one of the filesystems in the cluster. We are talking with IBM and have Sev. 1 ticket open, but I figured to ask here
about the warning message we are seeing in GPFS logs.
<div><br>
</div>
<div>The cluster is configured as following:</div>
<div><br>
</div>
<div>4 IO servers in the main gpfs cluster</div>
<div>700+ compute nodes in the gpfs cluster</div>
<div><br>
</div>
<div>home filesystem is slow but projects filesystem seems to be fast. Not many waiters on the IO servers (almost none) but a lot of waiters on the remote cluster.</div>
<div><br>
</div>
<div>The message that is giving us a pause is the following:</div>
<div>
<div style="margin:0px;font-stretch:normal;font-size:11px;line-height:normal;font-family:Menlo">
<span style="font-variant-ligatures:no-common-ligatures">Jul 10 07:05:31 gssio4 mmfs: [N] Writing into file /var/mmfs/gen/LastLeaseRequestSent took 10.5 seconds</span></div>
</div>
<div><span style="font-variant-ligatures:no-common-ligatures"><br>
</span></div>
<div><span style="font-variant-ligatures:no-common-ligatures">Why is taking so long to write to to the local file?</span></div>
<div><span style="font-variant-ligatures:no-common-ligatures"><br>
</span></div>
<div><span style="font-variant-ligatures:no-common-ligatures">Thanks,</span></div>
<div><span style="font-variant-ligatures:no-common-ligatures">Damir</span></div>
<div><br>
</div>
</div>
</div>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" target="_blank">spectrumscale.org</a><br>
<a href="https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7Cede76a6c2bd743c836b708d705307a86%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C1%7C636983578133164831&sdata=ATtqXDDChaZTouZZRkjf%2F79pIK%2Fc1DAwq6KUU%2FKYca4%3D&reserved=0" target="_blank">https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7Cede76a6c2bd743c836b708d705307a86%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C1%7C636983578133164831&sdata=ATtqXDDChaZTouZZRkjf%2F79pIK%2Fc1DAwq6KUU%2FKYca4%3D&reserved=0</a><br>
</div>
</blockquote>
</div>
<br>
</div>
</div>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" rel="noreferrer" target="_blank">spectrumscale.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br>
</blockquote></div>