<html>
  <head>
    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <p>no I will do that next.<br>
    </p>
    <br>
    <div class="moz-cite-prefix">On 12/28/16 1:55 PM, Sven Oehme wrote:<br>
    </div>
    <blockquote
cite="mid:OFE774BCE8.D715E8C0-ON00258097.006D6F14-1482954918828@notes.na.collabserv.com"
      type="cite">
      <meta http-equiv="Content-Type" content="text/html;
        charset=windows-1252">
      <font style="white-space:pre-wrap;font-family: Helvetica Neue, Helvetica, Arial, sans-serif;margin: 1em 0;">Did you restart the daemon on that node after you fixed it ?

Sent from IBM Verse</font><br>
      <br>
      <div class="domino-section" dir="ltr">
        <div class="domino-section-head"><span
            class="domino-section-title"><font color="#424282">Matt Weil
              --- Re: [gpfsug-discuss] LROC --- </font></span></div>
        <div class="domino-section-body"><br>
          <table border="0" cellpadding="0" cellspacing="0" width="100%">
            <tbody>
              <tr valign="top">
                <td style="width: 96px;" width="1%"><font
                    color="#5F5F5F" size="2">From:</font></td>
                <td style="width: auto;" width="100%"><font size="2">"Matt
                    Weil" <a class="moz-txt-link-rfc2396E" href="mailto:mweil@wustl.edu"><mweil@wustl.edu></a></font></td>
              </tr>
              <tr valign="top">
                <td style="width: 96px;" width="1%"><font
                    color="#5F5F5F" size="2">To:</font></td>
                <td style="width: auto;" width="100%"><font size="2"><a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a></font></td>
              </tr>
              <tr valign="top">
                <td style="width: 96px;" width="1%"><font
                    color="#5F5F5F" size="2">Date:</font></td>
                <td style="width: auto;" width="100%"><font size="2">Wed,
                    Dec 28, 2016 8:52 PM</font></td>
              </tr>
              <tr valign="top">
                <td style="width: 96px;" width="1%"><font
                    color="#5F5F5F" size="2">Subject:</font></td>
                <td style="width: auto;" width="100%"><font size="2">Re:
                    [gpfsug-discuss] LROC</font></td>
              </tr>
            </tbody>
          </table>
          <hr style="color:#8091A5; " align="left" size="2" width="100%"
            noshade="noshade"><br>
        </div>
        <p>k got that fixed now shows as status shutdown</p>
        <p> </p>
        <blockquote type="cite">[root@ces1 ~]# mmdiag --lroc<br>
          <br>
          === mmdiag: lroc ===<br>
          LROC Device(s):
'0A6403AA58641546#/dev/disk/by-id/nvme-Dell_Express_Flash_NVMe_SM1715_1.6TB_SFF_______S29GNYAH200016;'
          status Shutdown<br>
          Cache inodes 1 dirs 1 data 1  Config: maxFile 1073741824
          stubFile 1073741824<br>
          Max capacity: 0 MB, currently in use: 0 MB<br>
          Statistics from: Wed Dec 28 13:49:27 2016<br>
        </blockquote>
        <br>
        <br>
        <br>
        <div class="moz-cite-prefix">On 12/28/16 1:06 PM, Sven Oehme
          wrote:<br>
        </div>
        <blockquotecite="mid:of5443c0bd.317bc96d-onc1258097.0068c3e9-c1258097.0068f30b@notes.na.collabserv.com"
          type="cite">
          <p>you have no device configured that's why it doesn't show
            any stats : <br>
            <br>
            <tt>>>> LROC Device(s): 'NULL' status Idle</tt><br>
            <br>
            run mmsnsd -X to see if gpfs can see the path to the device.
            most likely it doesn't show up there and you need to adjust
            your nsddevices list to include it , especially if it is a
            NVME device. <br>
            <br>
            sven<br>
            <br>
            <br>
            ------------------------------------------<br>
            Sven Oehme <br>
            Scalable Storage Research <br>
            email: <a moz-do-not-send="true"
              class="moz-txt-link-abbreviated"
              href="mailto:oehmes@us.ibm.com">oehmes@us.ibm.com</a> <br>
            Phone: +1 (408) 824-8904 <br>
            IBM Almaden Research Lab <br>
            ------------------------------------------<br>
            <br>
            <img moz-do-not-send="true"
src="cid:cGFydDEuODVDQUIyMjEuNzRDRjFDOERAd3VzdGwuZWR1@6A0545BFED907CAEFE9EA3FA5B673481"
              alt="Inactive hide details for Matt Weil ---12/28/2016
              07:02:57 PM---So I have minReleaseLevel 4.1.1.0 Is that to
              old? On 12/28/16 1" height="16" border="0" width="16"><font
              color="#424282">Matt Weil ---12/28/2016 07:02:57 PM---So I
              have minReleaseLevel 4.1.1.0 Is that to old? On 12/28/16
              11:50 AM, Aaron Knister wrote:</font><br>
            <br>
            <font color="#5F5F5F" size="2">From: </font><font size="2">Matt
              Weil <a moz-do-not-send="true"
                class="moz-txt-link-rfc2396E"
                href="mailto:mweil@wustl.edu"><mweil@wustl.edu></a></font><br>
            <font color="#5F5F5F" size="2">To: </font><font size="2"><a
                moz-do-not-send="true" class="moz-txt-link-rfc2396E"
                href="mailto:gpfsug-discuss@spectrumscale.org"><gpfsug-discuss@spectrumscale.org></a></font><br>
            <font color="#5F5F5F" size="2">Date: </font><font size="2">12/28/2016
              07:02 PM</font><br>
            <font color="#5F5F5F" size="2">Subject: </font><font
              size="2">Re: [gpfsug-discuss] LROC</font><br>
            <font color="#5F5F5F" size="2">Sent by: </font><font
              size="2"><a moz-do-not-send="true"
                class="moz-txt-link-abbreviated"
                href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a></font><br>
          </p>
          <hr style="color:#8091A5; " align="left" size="2" width="100%"
            noshade="noshade"><br>
          <br>
          <br>
          <tt>So I have minReleaseLevel 4.1.1.0 Is that to old?<br>
            <br>
            <br>
            On 12/28/16 11:50 AM, Aaron Knister wrote:<br>
            > Hey Matt,<br>
            ><br>
            > We ran into a similar thing and if I recall correctly a
            mmchconfig<br>
            > --release=LATEST was required to get LROC working
            which, of course,<br>
            > would boot your 3.5.0.7 client from the cluster.<br>
            ><br>
            > -Aaron<br>
            ><br>
            > On 12/28/16 11:44 AM, Matt Weil wrote:<br>
            >> This is enabled on this node but mmdiag it does not
            seem to show it<br>
            >> caching.   Did I miss something?  I do have one
            file system in the<br>
            >> cluster that is running 3.5.0.7 wondering if that
            is causing this.<br>
            >>> [root@ces1 ~]# mmdiag --lroc<br>
            >>><br>
            >>> === mmdiag: lroc ===<br>
            >>> LROC Device(s): 'NULL' status Idle<br>
            >>> Cache inodes 1 dirs 1 data 1  Config: maxFile
            1073741824 stubFile<br>
            >>> 1073741824<br>
            >>> Max capacity: 0 MB, currently in use: 0 MB<br>
            >>> Statistics from: Tue Dec 27 11:21:14 2016<br>
            >>><br>
            >>> Total objects stored 0 (0 MB) recalled 0 (0 MB)<br>
            >>>       objects failed to store 0 failed to
            recall 0 failed to inval 0<br>
            >>>       objects queried 0 (0 MB) not found 0 =
            0.00 %<br>
            >>>       objects invalidated 0 (0 MB)<br>
            >><br>
            >> _______________________________________________<br>
            >> gpfsug-discuss mailing list<br>
            >> gpfsug-discuss at spectrumscale.org<br>
            >> </tt><tt><a moz-do-not-send="true"
              href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br>
            >><br>
            ><br>
            <br>
            _______________________________________________<br>
            gpfsug-discuss mailing list<br>
            gpfsug-discuss at spectrumscale.org<br>
          </tt><tt><a moz-do-not-send="true"
              href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br>
            <br>
          </tt><br>
          <br>
          <br>
          <br>
          <fieldset class="mimeAttachmentHeader"></fieldset>
          <br>
          <pre wrap="">_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
<a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></pre>
          <br>
          <br>
          <br>
          <fieldset class="mimeAttachmentHeader"></fieldset>
          <br>
          <pre wrap="">_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
<a class="moz-txt-link-freetext" href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a>
</pre>
        </blockquotecite="mid:of5443c0bd.317bc96d-onc1258097.0068c3e9-c1258097.0068f30b@notes.na.collabserv.com"></div>
    </blockquote>
    <br>
  </body>
</html>