<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>wow that was it.</p>
<p>
<blockquote type="cite"> mmdiag --lroc<br>
<br>
=== mmdiag: lroc ===<br>
LROC Device(s): '0A6403AA5865389E#/dev/nvme0n1;' status Running<br>
Cache inodes 1 dirs 1 data 1 Config: maxFile 1073741824
stubFile 1073741824<br>
Max capacity: 1526184 MB, currently in use: 0 MB<br>
Statistics from: Thu Dec 29 10:08:58 2016</blockquote>
It is not caching however. I will restart gpfs to see if that
makes it start working.<br>
</p>
<br>
<div class="moz-cite-prefix">On 12/29/16 10:18 AM, Matt Weil wrote:<br>
</div>
<blockquote
cite="mid:d0a76865-6c56-7538-85ea-87c1d26371c8@wustl.edu"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<p><br>
</p>
<br>
<div class="moz-cite-prefix">On 12/29/16 10:09 AM, Sven Oehme
wrote:<br>
</div>
<blockquote
cite="mid:CALssuR3GGL4GcGpG2m=B7naqNQd8WA-6hDTWd7QT-PQ7Zbr45Q@mail.gmail.com"
type="cite">
<div dir="ltr">i agree that is a very long name , given this is
a nvme device it should show up as /dev/nvmeXYZ
<div>i suggest to report exactly that in nsddevices and retry.</div>
<div>i vaguely remember we have some fixed length device name
limitation , but i don't remember what the length is, so
this would be my first guess too that the long name is
causing trouble. <br>
</div>
</div>
</blockquote>
I will try that. I was attempting to not need to write a custom
udev rule for those. Also to keep the names persistent. Rhel 7
has a default rule that makes a sym link in /dev/disk/by-id.<br>
0 lrwxrwxrwx 1 root root 13 Dec 29 10:08
nvme-Dell_Express_Flash_NVMe_SM1715_1.6TB_SFF_______S29GNYAH200016
-> ../../nvme0n1<br>
0 lrwxrwxrwx 1 root root 13 Dec 27 11:20
nvme-Dell_Express_Flash_NVMe_SM1715_1.6TB_SFF_______S29GNYAH300161
-> ../../nvme1n1<br>
<blockquote
cite="mid:CALssuR3GGL4GcGpG2m=B7naqNQd8WA-6hDTWd7QT-PQ7Zbr45Q@mail.gmail.com"
type="cite">
<div dir="ltr">
<div><br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr">On Thu, Dec 29, 2016 at 5:02 PM Aaron Knister
<<a moz-do-not-send="true"
href="mailto:aaron.s.knister@nasa.gov">aaron.s.knister@nasa.gov</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">Interesting.
Thanks Matt. I admit I'm somewhat grasping at straws here.<br
class="gmail_msg">
<br class="gmail_msg">
That's a *really* long device path (and nested too), I
wonder if that's<br class="gmail_msg">
causing issues.<br class="gmail_msg">
<br class="gmail_msg">
What does a "tspreparedisk -S" show on that node?<br
class="gmail_msg">
<br class="gmail_msg">
Also, what does your nsddevices script look like? I'm
wondering if you<br class="gmail_msg">
could have it give back "/dev/dm-XXX" paths instead of
"/dev/disk/by-id"<br class="gmail_msg">
paths if that would help things here.<br class="gmail_msg">
<br class="gmail_msg">
-Aaron<br class="gmail_msg">
<br class="gmail_msg">
On 12/29/16 10:57 AM, Matt Weil wrote:<br class="gmail_msg">
><br class="gmail_msg">
><br class="gmail_msg">
>> ro_cache_S29GNYAH200016 0A6403AA586531E1<br
class="gmail_msg">
>>
/dev/disk/by-id/nvme-Dell_Express_Flash_NVMe_SM1715_1.6TB_SFF_______S29GNYAH200016<br
class="gmail_msg">
>> dmm <a moz-do-not-send="true"
href="http://ces1.gsc.wustl.edu" rel="noreferrer"
class="gmail_msg" target="_blank">ces1.gsc.wustl.edu</a>
server node<br class="gmail_msg">
><br class="gmail_msg">
><br class="gmail_msg">
> On 12/28/16 5:19 PM, Aaron Knister wrote:<br
class="gmail_msg">
>> mmlssnsd -X | grep 0A6403AA58641546<br
class="gmail_msg">
><br class="gmail_msg">
> _______________________________________________<br
class="gmail_msg">
> gpfsug-discuss mailing list<br class="gmail_msg">
> gpfsug-discuss at <a moz-do-not-send="true"
href="http://spectrumscale.org" rel="noreferrer"
class="gmail_msg" target="_blank">spectrumscale.org</a><br
class="gmail_msg">
> <a moz-do-not-send="true"
href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"
rel="noreferrer" class="gmail_msg" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br
class="gmail_msg">
><br class="gmail_msg">
<br class="gmail_msg">
--<br class="gmail_msg">
Aaron Knister<br class="gmail_msg">
NASA Center for Climate Simulation (Code 606.2)<br
class="gmail_msg">
Goddard Space Flight Center<br class="gmail_msg">
<a moz-do-not-send="true" href="tel:%28301%29%20286-2776"
value="+13012862776" class="gmail_msg" target="_blank">(301)
286-2776</a><br class="gmail_msg">
_______________________________________________<br
class="gmail_msg">
gpfsug-discuss mailing list<br class="gmail_msg">
gpfsug-discuss at <a moz-do-not-send="true"
href="http://spectrumscale.org" rel="noreferrer"
class="gmail_msg" target="_blank">spectrumscale.org</a><br
class="gmail_msg">
<a moz-do-not-send="true"
href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"
rel="noreferrer" class="gmail_msg" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br
class="gmail_msg">
</blockquote>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a>
</pre>
</blockquote>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
<a class="moz-txt-link-freetext" href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a>
</pre>
</blockquote>
<br>
</body>
</html>