<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Actually, we can see all the Volume LUN WWNs such as<div class=""><div class="">3600a098000a11f990000022457cf5091 1:0:0:0 sdb 8:16 14 undef ready DELL </div><div class="">3600a098000a0b4ea000001fd57cf50b2 1:0:0:1 sdc 8:32 9 undef ready DELL </div><div class="">3600a098000a11f990000024457cf576f 1:0:0:10 sdl 8:176 14 undef ready DELL </div><div class=""><br class=""></div><div class="">(45 lines, 11 LUNs from each controller, each showing up twice, plus the boot volume)</div><div class=""><br class=""></div><div class="">My problem involves the ID of the server's host adapter as seen by the 60 drive RAID box.</div><div class=""><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[root@storage043 scsi]# lsscsi -Ht</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[0] megaraid_sas </span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[1] mpt3sas sas:0x51866da05f388a00</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[2] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[3] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[4] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[5] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[6] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[7] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[8] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[9] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[10] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[11] ahci sata:</span></div><div style="margin: 0px; font-size: 17px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[12] mpt3sas sas:0x51866da05cf7b000</span></div></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><br class=""></span></div><div class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Each card [1] and [12] is a dual port card. The address of the second port is not consistent.</span></div><div class=""><br class=""></div><div class="">— ddj</div><div class=""><br class=""></div><div><blockquote type="cite" class=""><div class="">On Jan 20, 2017, at 11:14 AM, J. Eric Wonderley <<a href="mailto:eric.wonderley@vt.edu" class="">eric.wonderley@vt.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class=""><br class="">Maybe multipath is not seeing all of the wwns?<br class=""><div class="gmail_extra"><br class=""></div><div class="gmail_extra">multipath -v3 | grep ^51855 look ok?<br class=""><br class=""></div><div class="gmail_extra">For some unknown reason multipath does not see our sandisk array...we have to add them to the end of /etc/multipath/wwids file<br class=""><br class=""></div><div class="gmail_extra"><br class=""><div class="gmail_quote">On Fri, Jan 20, 2017 at 10:32 AM, David D. Johnson <span dir="ltr" class=""><<a href="mailto:david_johnson@brown.edu" target="_blank" class="">david_johnson@brown.edu</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word" class="">We have most of our GPFS NSD storage set up as pairs of RAID boxes served by failover pairs of servers.<div class="">Most of it is FibreChannel, but the newest four boxes and servers are using dual port SAS controllers.</div><div class="">Just this week, we had one server lose one out of the paths to one of the raid boxes. Took a while</div><div class="">to realize what happened, but apparently the port2 ID changed from 51866da05cf7b001 to</div><div class="">51866da05cf7b002 on the fly, without rebooting. Port1 is still 51866da05cf7b000, which is the card ID (host_add).</div><div class=""><br class=""></div><div class="">We’re running gpfs 4.2.2.1 on RHEL7.2 on these hosts.</div><div class=""><br class=""></div><div class="">Has anyone else seen this kind of behavior? </div><div class="">First noticed these messages, 3 hours 13 minutes after boot:</div><div class=""><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:15:53 storage043 kernel: megasas: Err returned from build_and_issue_cmd</span></div><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:15:53 storage043 kernel: megasas: Err returned from build_and_issue_cmd</span></div><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:15:53 storage043 kernel: megasas: Err returned from build_and_issue_cmd</span></div><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:15:53 storage043 kernel: megasas: Err returned from build_and_issue_cmd</span></div><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:15:53 storage043 kernel: megasas: Err returned from build_and_issue_cmd</span></div><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:15:53 storage043 kernel: megasas: Err returned from build_and_issue_cmd</span></div><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:15:53 storage043 kernel: megasas: Err returned from build_and_issue_cmd</span></div></div><div class=""><span style="font-variant-ligatures:no-common-ligatures" class=""><br class=""></span></div><div class="">The multipath daemon was sending lots of log messages like:</div><div class=""><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:49:22 storage043 multipathd: mpathw: load table [0 4642340864 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:64 1]</span></div><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:49:22 storage043 multipathd: mpathaa: load table [0 4642340864 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:96 1]</span></div><div style="margin:0px;font-size:17px;line-height:normal;font-family:Menlo" class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Jan 10 13:49:22 storage043 multipathd: mpathx: load table [0 4642340864 multipath 3 pg_init_retries 50 queue_if_no_path 1 rdac 1 1 round-robin 0 1 1 8:128 1]</span></div></div><div class=""><span style="font-variant-ligatures:no-common-ligatures" class=""><br class=""></span></div><div class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Currently worked around problem by including 00 01 and 02 for all 8 SAS cards when mapping LUN/volume to host groups.</span></div><div class=""><span style="font-variant-ligatures:no-common-ligatures" class=""><br class=""></span></div><div class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Thanks,</span></div><div class=""><span style="font-variant-ligatures:no-common-ligatures" class=""> — ddj</span></div><div class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Dave Johnson</span></div><div class=""><span style="font-variant-ligatures:no-common-ligatures" class="">Brown University CCV</span></div></div><br class="">______________________________<wbr class="">_________________<br class="">
gpfsug-discuss mailing list<br class="">
gpfsug-discuss at <a href="http://spectrumscale.org/" rel="noreferrer" target="_blank" class="">spectrumscale.org</a><br class="">
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" rel="noreferrer" target="_blank" class="">http://gpfsug.org/mailman/<wbr class="">listinfo/gpfsug-discuss</a><br class="">
<br class=""></blockquote></div><br class=""></div></div>
_______________________________________________<br class="">gpfsug-discuss mailing list<br class="">gpfsug-discuss at <a href="http://spectrumscale.org" class="">spectrumscale.org</a><br class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br class=""></div></blockquote></div><br class=""></div></body></html>