<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Helvetica Neue";}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.yiv4648160129msonormal, li.yiv4648160129msonormal, div.yiv4648160129msonormal
{mso-style-name:yiv4648160129msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.yiv4648160129msochpdefault, li.yiv4648160129msochpdefault, div.yiv4648160129msochpdefault
{mso-style-name:yiv4648160129msochpdefault;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.yiv4648160129msonormal1, li.yiv4648160129msonormal1, div.yiv4648160129msonormal1
{mso-style-name:yiv4648160129msonormal1;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.yiv4648160129msochpdefault1, li.yiv4648160129msochpdefault1, div.yiv4648160129msochpdefault1
{mso-style-name:yiv4648160129msochpdefault1;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.yiv4648160129msohyperlink
{mso-style-name:yiv4648160129msohyperlink;}
span.yiv4648160129msohyperlinkfollowed
{mso-style-name:yiv4648160129msohyperlinkfollowed;}
span.yiv4648160129msohyperlink1
{mso-style-name:yiv4648160129msohyperlink1;}
span.yiv4648160129msohyperlinkfollowed1
{mso-style-name:yiv4648160129msohyperlinkfollowed1;}
span.yiv4648160129emailstyle171
{mso-style-name:yiv4648160129emailstyle171;}
span.yiv4648160129emailstyle28
{mso-style-name:yiv4648160129emailstyle28;}
p.yiv4648160129msonormal2, li.yiv4648160129msonormal2, div.yiv4648160129msonormal2
{mso-style-name:yiv4648160129msonormal2;
margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.yiv4648160129msohyperlink2
{mso-style-name:yiv4648160129msohyperlink2;
color:blue;
text-decoration:underline;}
span.yiv4648160129msohyperlinkfollowed2
{mso-style-name:yiv4648160129msohyperlinkfollowed2;
color:purple;
text-decoration:underline;}
p.yiv4648160129msonormal3, li.yiv4648160129msonormal3, div.yiv4648160129msonormal3
{mso-style-name:yiv4648160129msonormal3;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.yiv4648160129msochpdefault2, li.yiv4648160129msochpdefault2, div.yiv4648160129msochpdefault2
{mso-style-name:yiv4648160129msochpdefault2;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.yiv4648160129msonormal11, li.yiv4648160129msonormal11, div.yiv4648160129msonormal11
{mso-style-name:yiv4648160129msonormal11;
margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Times New Roman",serif;}
span.yiv4648160129msohyperlink11
{mso-style-name:yiv4648160129msohyperlink11;
color:#0563C1;
text-decoration:underline;}
span.yiv4648160129msohyperlinkfollowed11
{mso-style-name:yiv4648160129msohyperlinkfollowed11;
color:#954F72;
text-decoration:underline;}
span.yiv4648160129emailstyle1711
{mso-style-name:yiv4648160129emailstyle1711;
color:windowtext;}
p.yiv4648160129msochpdefault11, li.yiv4648160129msochpdefault11, div.yiv4648160129msochpdefault11
{mso-style-name:yiv4648160129msochpdefault11;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.yiv4648160129emailstyle281
{mso-style-name:yiv4648160129emailstyle281;
color:#1F497D;}
span.EmailStyle39
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Generic:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New";color:#1F497D"># grep SG_DISK /var/mmfs/gen/mmsdrfs | cut -f 15 -d ':'<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New";color:#1F497D">generic<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New";color:#1F497D">generic<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New";color:#1F497D">generic<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New";color:#1F497D">generic<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New";color:#1F497D">generic<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Cheers,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">-Bryan<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> gpfsug-discuss-bounces@spectrumscale.org [mailto:gpfsug-discuss-bounces@spectrumscale.org]
<b>On Behalf Of </b>Jim Doherty<br>
<b>Sent:</b> Thursday, January 18, 2018 10:33 AM<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject:</b> Re: [gpfsug-discuss] Question about NSD "Devtype" setting, nsddevices file<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><em><span style="font-size:8.5pt;font-family:"Verdana",sans-serif;color:#333333">Note: External Email</span></em><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" align="center">
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue"">What does the /var/mmfs/gen/mmsdrfs file show?<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:10.0pt;font-family:"Helvetica Neue"">[root@service5 ~]# grep SG_DISK /var/mmfs/gen/mmsdrfs | cut -f 15 -d ':'<br>
dmm<br>
dmm<br>
dmm<br>
dmm<br>
<br>
<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue""><o:p> </o:p></span></p>
</div>
<div id="yahoo_quoted_7228513798">
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">On Thursday, January 18, 2018, 10:49:32 AM EST, Bryan Banister <<a href="mailto:bbanister@jumptrading.com">bbanister@jumptrading.com</a>> wrote:
<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p> </o:p></span></p>
</div>
<div>
<div id="yiv4648160129">
<div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:11.0pt;font-family:"Helvetica Neue";color:#26282A">Hi Jim,</span><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal"><span style="font-size:11.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal"><span style="font-size:11.0pt;font-family:"Helvetica Neue";color:#26282A">Our NSDs are reporting the /dev/mapper/ devices in the `mmlsnsd -X` output, but due to the nsddevices file configuration they are all configured as ‘generic’
Devtype.</span><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal"><span style="font-size:11.0pt;font-family:"Helvetica Neue";color:#26282A">-Bryan</span><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal"><span style="font-size:11.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<div id="yiv4648160129yqt65493">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="yiv4648160129msonormal"><b><span style="font-size:11.0pt;font-family:"Helvetica Neue";color:#26282A">From:</span></b><span style="font-size:11.0pt;font-family:"Helvetica Neue";color:#26282A">
<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a> [<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org">mailto:gpfsug-discuss-bounces@spectrumscale.org</a>]
<b>On Behalf Of </b>Jim Doherty<br>
<b>Sent:</b> Wednesday, January 17, 2018 6:28 PM<br>
<b>To:</b> gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a>><br>
<b>Subject:</b> Re: [gpfsug-discuss] Question about NSD "Devtype" setting, nsddevices file</span><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
</div>
</div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
<p class="yiv4648160129msonormal"><em><span style="font-size:8.5pt;font-family:"Helvetica Neue";color:#26282A">Note: External Email</span></em><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">
<hr size="2" width="100%" align="center">
</span></div>
<div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">Run a mmlsnsd -X I suspect you will see that GPFS is using one of the /dev/sd* "generic" paths to the LUN, not the /dev/mapper/ path. In our case
the device is setup as dmm <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal" style="margin-bottom:12.0pt"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">[root@service5 ~]# mmlsnsd -X<br>
<br>
Disk name NSD volume ID Device Devtype Node name Remarks <br>
---------------------------------------------------------------------------------------------------<br>
volume1 0972B6CD587CD8E0 /dev/dm-0 dmm service5.pok.stglabs.ibm.com server node<br>
volume1 0972B6CD587CD8E0 /dev/dm-0 dmm service6.pok.stglabs.ibm.com server node<br>
volume2 0972B6CE587CD8E4 /dev/dm-4 dmm service5.pok.stglabs.ibm.com server node<br>
volume2 0972B6CE587CD8E4 /dev/dm-3 dmm service6.pok.stglabs.ibm.com server node<br>
volume3 0972B6CD587CD8E7 /dev/dm-1 dmm service5.pok.stglabs.ibm.com server node<br>
volume3 0972B6CD587CD8E7 /dev/dm-2 dmm service6.pok.stglabs.ibm.com server node<br>
volume4 0972B6CE587CF625 /dev/dm-3 dmm service5.pok.stglabs.ibm.com server node<br>
volume4 0972B6CE587CF625 /dev/dm-4 dmm service6.pok.stglabs.ibm.com server node<br>
<br>
[root@service5 ~]# grep volume1 /var/mmfs/gen/mmsdrfs | grep SG_DISK<br>
%%home%%:60_SG_DISKS:gpfs5:1:volume1:0:5001:dataAndMetadata:0972B6CD587CD8E0:nsd:service5.pok.stglabs.ibm.com,service6.pok.stglabs.ibm.com::other::dmm:user:::quorumDisk:ready::system:service5.pok.stglabs.ibm.com,service6.pok.stglabs.ibm.com:::::<br>
[root@service5 ~]# <o:p></o:p></span></p>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">If you run an tspreparedisk -s it will show you all of the paths.
<o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">[root@service5 ~]# tspreparedisk -s | grep 0972B6CD587CD8E0<br>
0972B6CD587CD8E0 /dev/sda generic <br>
0972B6CD587CD8E0 /dev/sdk generic <br>
0972B6CD587CD8E0 /dev/sdu generic <br>
0972B6CD587CD8E0 /dev/sdah generic <br>
0972B6CD587CD8E0 /dev/dm-0 dmm <br>
[root@service5 ~]# <o:p></o:p></span></p>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">Jim<o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
</div>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">Jim<o:p></o:p></span></p>
</div>
<div id="yiv4648160129yahoo_quoted_6842880797">
<div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">On Wednesday, January 17, 2018, 5:12:10 PM EST, Bryan Banister <<a href="mailto:bbanister@jumptrading.com" target="_blank">bbanister@jumptrading.com</a>>
wrote: <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
<div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> <o:p></o:p></span></p>
</div>
<div>
<div id="yiv4648160129">
<div>
<div>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">Hi all,</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">We are reviewing some of our configurations and were not sure what to make of the NSD Device Types that GPFS uses and what, if anything, do they change
about how GPFS accesses/recovers/manages/etc the underlying storage based on this setting.</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">The documentation doesn’t say much about it other than to consult the /usr/lpp/mmfs/bin/mmdevdiscover command (no man page), which has this section:</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># Known disk types currently are:</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">#</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># powerdisk - EMC power path disk</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># vpath - IBM virtual path disk</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># dmm - Device-Mapper Multipath (DMM)</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># dlmfdrv - Hitachi dlm</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># hdisk - AIX hard disk</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># lv - AIX logical volume. Historical usage only.</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># Not allowed as a new device to mmcrnsd.</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># gpt - GPFS partition on Windows disk</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># generic - Device having no unique failover or multipathing</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># characteristic (predominantly Linux devices).</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"># dasd - DASD device (for Linux on z Systems)</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">We have our storage under Linux Device-Mapper Multipath control (two device paths to all storage, active/passive) and are accessible under /dev/mapper,
but the NSD types are current set to ‘generic’ not ‘dmm’. This is configured in the /var/mmfs/etc/nsddevices file:</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">if [[ $osName = Linux ]]</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">then</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> : # Add function to discover disks in the Linux environment.</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> ls -l /dev/mpath/ 2>/dev/null | awk '{print "mpath/"$9 " generic"}'</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> ls -l /dev/mapper/ 2>/dev/null | awk '{print "mapper/"$9 "
<span style="background:yellow">generic</span>"}'</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> ls -1 /dev/vd* 2>/dev/null | awk -F '/' '{print ""$3 " generic"}'</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">fi</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">Can somebody from IBM explain what the correct setting should be and what differences GPFS does with ‘generic’ vs. ‘dmm’ vs. others?</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">Thanks in advance!</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">-Bryan</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
</div>
<p class="yiv4648160129msonormal3"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"> </span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-family:"Helvetica Neue";color:#26282A">
<hr size="2" width="100%" align="center">
</span></div>
<p class="yiv4648160129msonormal3"><span style="font-size:7.5pt;font-family:"Helvetica Neue";color:#26282A"><br>
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this
email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness
or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial
product.</span><span style="font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
</div>
</div>
<p class="yiv4648160129msonormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p> </o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">
<hr size="2" width="100%" align="center">
</span></div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:gray"><br>
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this
email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness
or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial
product.</span><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A"><o:p></o:p></span></p>
</div>
</div>
<div id="yqt41916">
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica Neue";color:#26282A">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<hr>
<font face="Arial" color="Gray" size="1"><br>
Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this
email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness
or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial
product.<br>
</font>
</body>
</html>