<HTML><BODY><FONT style='white-space:pre-wrap;font-family: Helvetica Neue, Helvetica, Arial, sans-serif;margin: 1em 0;'>Did you restart the daemon on that node after you fixed it ?<br><br>Sent from IBM Verse</FONT><br><br><div class="domino-section" dir="ltr"><div class="domino-section-head"><span class="domino-section-title"><font color="#424282">Matt Weil --- Re: [gpfsug-discuss] LROC --- </font></span></div><div class="domino-section-body"><br><table width="100%" border="0" cellspacing="0" cellpadding="0"><tr valign="top"><td width="1%" style="width: 96px;"><font size="2" color="#5F5F5F">From:</font></td><td width="100%" style="width: auto;"><font size="2">"Matt Weil" <mweil@wustl.edu></font></td></tr><tr valign="top"><td width="1%" style="width: 96px;"><font size="2" color="#5F5F5F">To:</font></td><td width="100%" style="width: auto;"><font size="2">gpfsug-discuss@spectrumscale.org</font></td></tr><tr valign="top"><td width="1%" style="width: 96px;"><font size="2" color="#5F5F5F">Date:</font></td><td width="100%" style="width: auto;"><font size="2">Wed, Dec 28, 2016 8:52 PM</font></td></tr><tr valign="top"><td width="1%" style="width: 96px;"><font size="2" color="#5F5F5F">Subject:</font></td><td width="100%" style="width: auto;"><font size="2">Re: [gpfsug-discuss] LROC</font></td></tr></table><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br></div><html>  <head>    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">  </head>  <body bgcolor="#FFFFFF" text="#000000">    <p>k got that fixed now shows as status shutdown</p>    <p>      <blockquote type="cite">[root@ces1 ~]# mmdiag --lroc<br>        <br>        === mmdiag: lroc ===<br>        LROC Device(s):
'0A6403AA58641546#/dev/disk/by-id/nvme-Dell_Express_Flash_NVMe_SM1715_1.6TB_SFF_______S29GNYAH200016;'
        status Shutdown<br>        Cache inodes 1 dirs 1 data 1  Config: maxFile 1073741824
        stubFile 1073741824<br>        Max capacity: 0 MB, currently in use: 0 MB<br>        Statistics from: Wed Dec 28 13:49:27 2016<br>      </blockquote>      <br>      <br>    </p>    <br>    <div class="moz-cite-prefix">On 12/28/16 1:06 PM, Sven Oehme wrote:<br>    </div>    <blockquotecite="mid:OF5443C0BD.317BC96D-ONC1258097.0068C3E9-C1258097.0068F30B@notes.na.collabserv.com"
      type="cite">      <meta http-equiv="Content-Type" content="text/html;
        charset=windows-1252">      <p>you have no device configured that's why it doesn't show any
        stats : <br>        <br>        <tt>>>> LROC Device(s): 'NULL' status Idle</tt><br>        <br>        run mmsnsd -X to see if gpfs can see the path to the device.
        most likely it doesn't show up there and you need to adjust your
        nsddevices list to include it , especially if it is a NVME
        device. <br>        <br>        sven<br>        <br>        <br>        ------------------------------------------<br>        Sven Oehme <br>        Scalable Storage Research <br>        email: <a class="moz-txt-link-abbreviated" href="mailto:oehmes@us.ibm.com">oehmes@us.ibm.com</a> <br>        Phone: +1 (408) 824-8904 <br>        IBM Almaden Research Lab <br>        ------------------------------------------<br>        <br>        <img src="cid:cGFydDEuODVDQUIyMjEuNzRDRjFDOERAd3VzdGwuZWR1@6A0545BFED907CAEFE9EA3FA5B673481" alt="Inactive
          hide details for Matt Weil ---12/28/2016 07:02:57 PM---So I
          have minReleaseLevel 4.1.1.0 Is that to old? On 12/28/16 1"
          height="16" border="0" width="16"><font color="#424282">Matt
          Weil ---12/28/2016 07:02:57 PM---So I have minReleaseLevel
          4.1.1.0 Is that to old? On 12/28/16 11:50 AM, Aaron Knister
          wrote:</font><br>        <br>        <font color="#5F5F5F" size="2">From: </font><font size="2">Matt
          Weil <a class="moz-txt-link-rfc2396E" href="mailto:mweil@wustl.edu"><mweil@wustl.edu></a></font><br>        <font color="#5F5F5F" size="2">To: </font><font size="2"><a class="moz-txt-link-rfc2396E" href="mailto:gpfsug-discuss@spectrumscale.org"><gpfsug-discuss@spectrumscale.org></a></font><br>        <font color="#5F5F5F" size="2">Date: </font><font size="2">12/28/2016
          07:02 PM</font><br>        <font color="#5F5F5F" size="2">Subject: </font><font size="2">Re:
          [gpfsug-discuss] LROC</font><br>        <font color="#5F5F5F" size="2">Sent by: </font><font size="2"><a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a></font><br>      </p>      <hr style="color:#8091A5; " align="left" size="2" width="100%"
        noshade="noshade"><br>      <br>      <br>      <tt>So I have minReleaseLevel 4.1.1.0 Is that to old?<br>        <br>        <br>        On 12/28/16 11:50 AM, Aaron Knister wrote:<br>        > Hey Matt,<br>        ><br>        > We ran into a similar thing and if I recall correctly a
        mmchconfig<br>        > --release=LATEST was required to get LROC working which, of
        course,<br>        > would boot your 3.5.0.7 client from the cluster.<br>        ><br>        > -Aaron<br>        ><br>        > On 12/28/16 11:44 AM, Matt Weil wrote:<br>        >> This is enabled on this node but mmdiag it does not
        seem to show it<br>        >> caching.   Did I miss something?  I do have one file
        system in the<br>        >> cluster that is running 3.5.0.7 wondering if that is
        causing this.<br>        >>> [root@ces1 ~]# mmdiag --lroc<br>        >>><br>        >>> === mmdiag: lroc ===<br>        >>> LROC Device(s): 'NULL' status Idle<br>        >>> Cache inodes 1 dirs 1 data 1  Config: maxFile
        1073741824 stubFile<br>        >>> 1073741824<br>        >>> Max capacity: 0 MB, currently in use: 0 MB<br>        >>> Statistics from: Tue Dec 27 11:21:14 2016<br>        >>><br>        >>> Total objects stored 0 (0 MB) recalled 0 (0 MB)<br>        >>>       objects failed to store 0 failed to recall 0
        failed to inval 0<br>        >>>       objects queried 0 (0 MB) not found 0 = 0.00 %<br>        >>>       objects invalidated 0 (0 MB)<br>        >><br>        >> _______________________________________________<br>        >> gpfsug-discuss mailing list<br>        >> gpfsug-discuss at spectrumscale.org<br>        >> </tt><tt><a moz-do-not-send="true"
          href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br>        >><br>        ><br>        <br>        _______________________________________________<br>        gpfsug-discuss mailing list<br>        gpfsug-discuss at spectrumscale.org<br>      </tt><tt><a moz-do-not-send="true"
          href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br>        <br>      </tt><br>      <br>      <br>      <br>      <fieldset class="mimeAttachmentHeader"></fieldset>      <br>      <pre wrap="">_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
<a class="moz-txt-link-freetext" href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></pre>    </blockquote>    <br>  <BR>
</body></html>
</BODY></HTML>