<font size=2 face="sans-serif">Hi Atmane,</font><br><br><font size=2 face="sans-serif">The missing path from old mmlspdisk
(</font><tt><font size=2>/dev/sdob</font></tt><font size=2 face="sans-serif">)
and the log file </font><tt><font size=2>(/dev/sdge</font></tt><font size=2 face="sans-serif">)
do not match. This may be because server was booted after the old mmlspdisk
was taken. The path name are not guarantied across reboot. </font><br><br><font size=2 face="sans-serif">The log is reporting problem with /dev/sdge.
You should check if OS can see path /dev/sdge (use lsscsi). If the
disk is accessible from other path than I don't believe it is problem with
the disk. </font><br><tt><font size=2> </font></tt><br><font size=2 face="sans-serif">Thanks,<br><br>Sandeep Naik<br>Elastic Storage server / GPFS Test <br>ETZ-B, Hinjewadi Pune India<br>(+91) 8600994314</font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">atmane khiredine <a.khiredine@meteo.dz></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">"gpfsug-discuss@spectrumscale.org"
<gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">24/10/2017 02:50 PM</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">[gpfsug-discuss]
GSS GPFS Storage Server show one path for one Disk</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><tt><font size=2>Dear All<br><br><br><br><br><br>we owning a solution for our HPC a GSS gpfs storage server native
raid<br><br>I noticed 3 days ago that a disk shows a single path<br><br>my configuration is as follows<br><br><br><br>GSS configuration: 4 enclosures, 6 SSDs, 2 empty slots, 238 total disks,
0 NVRAM partitions<br><br><br><br>if I search with fdisk I have the following result<br><br>476 disk in GSS0 and GSS1<br><br>with an old file<br><br>cat mmlspdisk.old<br><br>#####<br><br>replacementPriority = 1000<br><br>name = "e3d5s05"<br><br>device = "/dev/sdkt,/dev/sdob" << -<br><br>recoveryGroup = "BB1RGL"<br><br>declusteredArray = "DA2"<br><br>state = "ok"<br><br>userLocation = "Enclosure 2021-20E-SV25262728 Drawer 5 Slot 5"<br><br>userCondition = "normal"<br><br>nPaths = 2 activates 4 total << - while the disk contains the 2 paths<br><br>#####<br><br>ls /dev/sdob<br><br>/Dev/ sdob<br><br>ls /dev/sdkt<br><br>/Dev/sdkt<br><br>mmlspdisk all >> mmlspdisk.log<br><br>vi mmlspdisk.log<br><br>replacementPriority = 1000<br><br>name = "e3d5s05"<br><br>device = "/dev/sdkt" << --- the disk contains 1 path<br><br>recoveryGroup = "BB1RGL"<br><br>declusteredArray = "DA2"<br><br>state = "ok"<br><br>userLocation = "Enclosure 2021-20E-SV25262728 Drawer 5 Slot 5"<br><br>userCondition = "normal"<br><br>nPaths = 1 active 3 total<br><br>here is the result of the log file in GSS1<br><br><br><br>grep e3d5s05 /var/adm/ras/mmfs.log.latest<br><br><br><br>################## START LOG GSS1 #####################<br><br>0 result<br><br>################# END LOG GSS 1 #####################<br><br><br><br>here is the result of the log file in GSS0<br><br><br><br>grep e3d5s05 /var/adm/ras/mmfs.log.latest<br><br><br><br>################# START LOG GSS 0 #####################<br><br>Thu Sep 14 16:35:01.619 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 4673959648 length 4112 err 5.<br><br>Thu Sep 14 16:35:01.620 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Thu Sep 14 16:35:01.787 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Thu Sep 14 16:35:01.788 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Thu Sep 14 16:35:03.709 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Thu Sep 14 17:53:13.209 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 3658399408 length 4112 err 5.<br><br>Thu Sep 14 17:53:13.210 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Thu Sep 14 17:53:15.685 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Thu Sep 14 17:56:10.410 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 796658640 length 4112 err 5.<br><br>Thu Sep 14 17:56:10.411 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Thu Sep 14 17:56:10.593 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on write: sector 738304 length 512 err 5.<br><br>Thu Sep 14 17:56:11.236 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Thu Sep 14 17:56:11.237 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Thu Sep 14 17:56:13.127 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Thu Sep 14 17:59:14.322 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Thu Sep 14 18:02:16.580 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 00:08:01.464 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 682228176 length 4112 err 5.<br><br>Fri Sep 15 00:08:01.465 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Fri Sep 15 00:08:03.391 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Fri Sep 15 00:21:41.785 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 4063038688 length 4112 err 5.<br><br>Fri Sep 15 00:21:41.786 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Fri Sep 15 00:21:42.559 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 00:21:42.560 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Fri Sep 15 00:21:44.336 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Fri Sep 15 00:36:11.899 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 2503485424 length 4112 err 5.<br><br>Fri Sep 15 00:36:11.900 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Fri Sep 15 00:36:12.676 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 00:36:12.677 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Fri Sep 15 00:36:14.458 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Fri Sep 15 00:40:16.038 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 4113538928 length 4112 err 5.<br><br>Fri Sep 15 00:40:16.039 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Fri Sep 15 00:40:16.801 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 00:40:16.802 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Fri Sep 15 00:40:18.307 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Fri Sep 15 00:47:11.468 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 4185195728 length 4112 err 5.<br><br>Fri Sep 15 00:47:11.469 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Fri Sep 15 00:47:12.238 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 00:47:12.239 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Fri Sep 15 00:47:13.995 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Fri Sep 15 00:51:01.323 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 1637135520 length 4112 err 5.<br><br>Fri Sep 15 00:51:01.324 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Fri Sep 15 00:51:01.486 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 00:51:01.487 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Fri Sep 15 00:51:03.437 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Fri Sep 15 00:55:27.595 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 3646618336 length 4112 err 5.<br><br>Fri Sep 15 00:55:27.596 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Fri Sep 15 00:55:27.749 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 00:55:27.750 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Fri Sep 15 00:55:29.675 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Fri Sep 15 00:58:29.900 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 02:15:44.428 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 768931040 length 4112 err 5.<br><br>Fri Sep 15 02:15:44.429 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Fri Sep 15 02:15:44.596 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b03
(ACK/NAK timeout).<br><br>Fri Sep 15 02:15:44.597 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Fri Sep 15 02:15:46.486 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Fri Sep 15 02:18:46.826 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b03
(ACK/NAK timeout).<br><br>Fri Sep 15 02:21:47.317 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 02:24:47.723 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b03
(ACK/NAK timeout).<br><br>Fri Sep 15 02:27:48.152 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Fri Sep 15 02:30:48.392 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b03
(ACK/NAK timeout).<br><br>Sun Sep 24 15:40:18.434 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 2733386136 length 264 err 5.<br><br>Sun Sep 24 15:40:18.435 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Sun Sep 24 15:40:19.326 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Sun Sep 24 15:40:41.619 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on write: sector 3021316920 length 520 err 5.<br><br>Sun Sep 24 15:40:41.620 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Sun Sep 24 15:40:42.446 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Sun Sep 24 15:40:57.977 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on read: sector 4939800712 length 264 err 5.<br><br>Sun Sep 24 15:40:57.978 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Sun Sep 24 15:40:58.133 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b03
(ACK/NAK timeout).<br><br>Sun Sep 24 15:40:58.134 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to error.<br><br>Sun Sep 24 15:40:58.984 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>Sun Sep 24 15:44:00.932 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b03
(ACK/NAK timeout).<br><br>Sun Sep 24 15:47:02.352 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Sun Sep 24 15:50:03.149 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x28 Read (10): Check Condition: skey=0x0b (aborted command) asc/ascq=0x4b04
(NAK received).<br><br>Mon Sep 25 08:31:07.906 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge:
I/O error on write: sector 942033152 length 264 err 5.<br><br>Mon Sep 25 08:31:07.907 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from ok to diagnosing.<br><br>Mon Sep 25 08:31:07.908 2017: [D] Pdisk e3d5s05 of RG BB1RGL path //gss0-ib0/dev/sdge:
SCSI op=0x00 Test Unit Ready: Ioctl or RPC Failed: err=19.<br><br>Mon Sep 25 08:31:07.909 2017: [D] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
status changed from active to noDevice.<br><br>Mon Sep 25 08:31:07.910 2017: [E] Pdisk e3d5s05 of RG BB1RGL path /dev/sdge
failed; location 'SV25262728-5-5'.<br><br>Mon Sep 25 08:31:08.770 2017: [D] Pdisk e3d5s05 of RG BB1RGL state changed
from diagnosing to ok.<br><br>################## END LOG #####################<br><br><br><br>is it a HW or SW problem?<br><br><br><br>thank you<br><br><br><br>Atmane Khiredine<br><br>HPC System Administrator | Office National de la Météorologie<br><br>Tél : +213 21 50 73 93 # 303 | Fax : +213 21 50 79 40 | E-mail : a.khiredine@meteo.dz<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=DXkezTwrVXsEOfvoqY7_DLS86P5FtQszjm9zok6upRU&m=QsMCUxg_qSYCs6Joccb2Brey1phAF_tJFrEnVD6LNoc&s=eSulhfhE2jQnmMrmb9_eoomafxb5xI3KL5Y6n3rH5CE&e="><tt><font size=2>https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwIGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=DXkezTwrVXsEOfvoqY7_DLS86P5FtQszjm9zok6upRU&m=QsMCUxg_qSYCs6Joccb2Brey1phAF_tJFrEnVD6LNoc&s=eSulhfhE2jQnmMrmb9_eoomafxb5xI3KL5Y6n3rH5CE&e=</font></tt></a><tt><font size=2><br><br></font></tt><br><br><BR>