<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">ENODEV usually means that the disk device was not found on the server(s) in the server list. In this case c100[5-8] do not apparently have access to
</span>r10f6e8<span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">-Bryan<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> gpfsug-discuss-bounces@spectrumscale.org [mailto:gpfsug-discuss-bounces@spectrumscale.org]
<b>On Behalf Of </b>J. Eric Wonderley<br>
<b>Sent:</b> Wednesday, January 04, 2017 11:55 AM<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject:</b> [gpfsug-discuss] strange mmchnsd error?<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">[root@cl001 ~]# cat chnsd_home_flh<br>
%nsd: nsd=r10f1e5 servers=cl008,cl001,cl002,cl003,cl004,cl005,cl006,cl007<br>
%nsd: nsd=r10f6e5 servers=cl007,cl008,cl001,cl002,cl003,cl004,cl005,cl006<br>
%nsd: nsd=r10f1e6 servers=cl006,cl007,cl008,cl001,cl002,cl003,cl004,cl005<br>
%nsd: nsd=r10f6e6 servers=cl005,cl006,cl007,cl008,cl001,cl002,cl003,cl004<br>
%nsd: nsd=r10f1e7 servers=cl004,cl005,cl006,cl007,cl008,cl001,cl002,cl003<br>
%nsd: nsd=r10f6e7 servers=cl003,cl004,cl005,cl006,cl007,cl008,cl001,cl002<br>
%nsd: nsd=r10f1e8 servers=cl002,cl003,cl004,cl005,cl006,cl007,cl008,cl001<br>
%nsd: nsd=r10f6e8 servers=cl001,cl002,cl003,cl004,cl005,cl006,cl007,cl008<br>
%nsd: nsd=r10f1e9 servers=cl008,cl001,cl002,cl003,cl004,cl005,cl006,cl007<br>
%nsd: nsd=r10f6e9 servers=cl007,cl008,cl001,cl002,cl003,cl004,cl005,cl006<br>
[root@cl001 ~]# mmchnsd -F chnsd_home_flh<br>
mmchnsd: Processing disk r10f6e5<br>
mmchnsd: Processing disk r10f6e6<br>
mmchnsd: Processing disk r10f6e7<br>
mmchnsd: Processing disk r10f6e8<br>
mmchnsd: Node cl005.cl.arc.internal returned ENODEV for disk r10f6e8.<br>
mmchnsd: Node cl006.cl.arc.internal returned ENODEV for disk r10f6e8.<br>
mmchnsd: Node cl007.cl.arc.internal returned ENODEV for disk r10f6e8.<br>
mmchnsd: Node cl008.cl.arc.internal returned ENODEV for disk r10f6e8.<br>
mmchnsd: Error found while processing stanza<br>
%nsd: nsd=r10f6e8 servers=cl001,cl002,cl003,cl004,cl005,cl006,cl007,cl008<br>
mmchnsd: Processing disk r10f1e9<br>
mmchnsd: Processing disk r10f6e9<br>
mmchnsd: Command failed. Examine previous error messages to determine cause.<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I comment out the r10f6e8 line and then it completes?<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I have some sort of fabric san issue:<br>
[root@cl005 ~]# for i in {1..8}; do ssh cl00$i lsscsi -s | grep 38xx | grep 1.97 | wc -l; done<br>
80<br>
80<br>
80<br>
80<br>
68<br>
72<br>
70<br>
72<o:p></o:p></p>
</div>
<p class="MsoNormal">but i'm suprised removing one line allows it to complete.<o:p></o:p></p>
</div>
</div>
<br>
<hr>
<font face="Arial" color="Gray" size="1"><br>
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this
email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness
or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial
product.<br>
</font>
</body>
</html>