<span style=" font-size:10pt;font-family:sans-serif">Hi</span><br><br><span style=" font-size:10pt;font-family:sans-serif">Just make sure
you have a backup, just in case ...<br></span><br><br><span style=" font-size:9pt;font-family:Arial"> </span><br><span style=" font-size:10pt;font-family:Arial">Regards</span><br><span style=" font-size:9pt;font-family:Arial"> </span><br><table width=780 style="border-collapse:collapse;"><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><br><span style=" font-size:1pt;font-family:Arial"> </span><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:1pt;font-family:Arial"> </span><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:blue;font-family:Arial"><b>Yaron
Daniel</b></span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> 94
Em Ha'Moshavot Rd</span><td width=96 rowspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=right><img align=bottom src=cid:_1_0D3061040D305B50004A0C1FC225822F style="border:0px solid;"></div><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:blue;font-family:Arial"><b>Storage
architect</b></span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> Petach
Tiqva, 49527</span><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:blue;font-family:Arial"><b>IBM
Global Markets, Systems HW Sales</b></span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> Israel</span><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:blue;font-family:Arial"><b> </b></span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> </span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:9pt;font-family:Arial"> </span><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">Phone:</span><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">+972-3-916-5672</span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial"> </span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">Fax:</span><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">+972-3-916-5672</span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">
</span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">Mobile:</span><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">+972-52-8395593</span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">
</span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">e-mail:</span><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">yard@il.ibm.com</span><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">
</span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><a href=http://www.ibm.com/il/he/><span style=" font-size:10pt;color:blue;font-family:Arial"><u>IBM
Israel</u></span></a><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial">
</span><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:10pt"> </span><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial"> </span><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial"> </span></table><p style="margin-top:0px;margin-Bottom:0px"></p><br><img src=cid:_1_0D33C8540D33C444004A0C1FC225822F alt="IBM Storage Strategy and Solutions v1" style="border:0px solid;"><img src=cid:_1_0D33CA5C0D33C444004A0C1FC225822F alt="IBM Storage Management and Data Protection v1" style="border:0px solid;"><img src=cid:_1_0D33CC640D33C444004A0C1FC225822F style="border:0px solid;"><img src=cid:_1_0D33CE6C0D33C444004A0C1FC225822F style="border:0px solid;"><span style=" font-size:12pt">
</span><img src=cid:_2_0D33D08C0D33C444004A0C1FC225822F alt="Related image" style="border:0px solid;"><br><br><br><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">From:
</span><span style=" font-size:9pt;font-family:sans-serif">"Buterbaugh,
Kevin L" <Kevin.Buterbaugh@Vanderbilt.Edu></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">To:
</span><span style=" font-size:9pt;font-family:sans-serif">gpfsug
main discussion list <gpfsug-discuss@spectrumscale.org></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Date:
</span><span style=" font-size:9pt;font-family:sans-serif">02/08/2018
09:49 PM</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Subject:
</span><span style=" font-size:9pt;font-family:sans-serif">Re:
[gpfsug-discuss] hdisk suspend / stop (Buterbaugh, Kevin L)</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Sent
by: </span><span style=" font-size:9pt;font-family:sans-serif">gpfsug-discuss-bounces@spectrumscale.org</span><br><hr noshade><br><br><br><span style=" font-size:12pt">Hi again all, </span><br><br><span style=" font-size:12pt">It sounds like doing the “mmchconfig
unmountOnDiskFail=meta -i” suggested by Steve and Bob followed by using
mmchdisk to stop the disks temporarily is the way we need to go. We
will, as an aside, also run a mmapplypolicy first to pull any files users
have started accessing again back to the “regular” pool before doing
any of this.</span><br><br><span style=" font-size:12pt">Given that this is our “capacity” pool
and files have to have an atime > 90 days to get migrated there in the
1st place I think this is reasonable. Especially since users will
get an I/O error if they happen to try to access one of those NSDs during
the brief maintenance window.</span><br><br><span style=" font-size:12pt">As to naming and shaming the vendor …
I’m not going to do that at this point in time. We’ve been using
their stuff for well over a decade at this point and have had a generally
positive experience with them. In fact, I have spoken with them via
phone since my original post today and they have clarified that the problem
with the mismatched firmware is only an issue because we are a major version
off of what is current due to us choosing to not have a downtime and therefore
not having done any firmware upgrades in well over 18 months.</span><br><br><span style=" font-size:12pt">Thanks, all...</span><br><br><span style=" font-size:12pt">Kevin</span><br><br><span style=" font-size:12pt">On Feb 8, 2018, at 11:17 AM, Steve Xiao
<</span><a href=mailto:sxiao@us.ibm.com><span style=" font-size:12pt;color:blue"><u>sxiao@us.ibm.com</u></span></a><span style=" font-size:12pt">>
wrote:</span><br><br><span style=" font-size:10pt;font-family:sans-serif">You can change
the cluster configuration to online unmount the file system when there
is error accessing metadata. This can be done run the following
command:<br> mmchconfig unmountOnDiskFail=meta -i </span><span style=" font-size:12pt"><br></span><span style=" font-size:10pt;font-family:sans-serif"><br>After this configuration change, you should be able to stop all 5 NSDs
with mmchdisk stop command. While these NSDs are in down state,
any user IO to files resides on these disks will fail but your file system
should state mounted and usable.</span><span style=" font-size:12pt"><br></span><span style=" font-size:10pt;font-family:sans-serif"><br>Steve Y. Xiao</span><tt><span style=" font-size:10pt"><br><br>> Date: Thu, 8 Feb 2018 15:59:44 +0000<br>> From: "Buterbaugh, Kevin L" <</span></tt><a href=mailto:Kevin.Buterbaugh@Vanderbilt.Edu><tt><span style=" font-size:10pt;color:blue"><u>Kevin.Buterbaugh@Vanderbilt.Edu</u></span></tt></a><tt><span style=" font-size:10pt">><br>> To: gpfsug main discussion list <</span></tt><a href="mailto:gpfsug-discuss@spectrumscale.org"><tt><span style=" font-size:10pt;color:blue"><u>gpfsug-discuss@spectrumscale.org</u></span></tt></a><tt><span style=" font-size:10pt">><br>> Subject: [gpfsug-discuss] mmchdisk suspend / stop<br>> Message-ID: <</span></tt><a href="mailto:8DCA682D-9850-4C03-8930-EA6C68B41109@vanderbilt.edu"><tt><span style=" font-size:10pt;color:blue"><u>8DCA682D-9850-4C03-8930-EA6C68B41109@vanderbilt.edu</u></span></tt></a><tt><span style=" font-size:10pt">><br>> Content-Type: text/plain; charset="utf-8"<br>> <br>> Hi All,<br>> <br>> We are in a bit of a difficult situation right now with one of our
<br>> non-IBM hardware vendors (I know, I know, I KNOW - buy IBM hardware!<br>> <grin>) and are looking for some advice on how to deal with
this <br>> unfortunate situation.<br>> <br>> We have a non-IBM FC storage array with dual-?redundant? <br>> controllers. One of those controllers is dead and the vendor
is <br>> sending us a replacement. However, the replacement controller
will <br>> have mis-matched firmware with the surviving controller and - long
<br>> story short - the vendor says there is no way to resolve that <br>> without taking the storage array down for firmware upgrades. <br>> Needless to say there?s more to that story than what I?ve included
<br>> here, but I won?t bore everyone with unnecessary details.<br>> <br>> The storage array has 5 NSDs on it, but fortunately enough they are
<br>> part of our ?capacity? pool ? i.e. the only way a file lands here
is<br>> if an mmapplypolicy scan moved it there because the *access* time
is<br>> greater than 90 days. Filesystem data replication is set to
one.<br>> <br>> So ? what I was wondering if I could do is to use mmchdisk to either<br>> suspend or (preferably) stop those NSDs, do the firmware upgrade,
<br>> and resume the NSDs? The problem I see is that suspend doesn?t
stop<br>> I/O, it only prevents the allocation of new blocks ? so, in theory,
<br>> if a user suddenly decided to start using a file they hadn?t needed
<br>> for 3 months then I?ve got a problem. Stopping all I/O to the
disks<br>> is what I really want to do. However, according to the mmchdisk
man<br>> page stop cannot be used on a filesystem with replication set to one.<br>> <br>> There?s over 250 TB of data on those 5 NSDs, so restriping off of
<br>> them or setting replication to two are not options.<br>> <br>> It is very unlikely that anyone would try to access a file on those
<br>> NSDs during the hour or so I?d need to do the firmware upgrades, but<br>> how would GPFS itself react to those (suspended) disks going away
<br>> for a while? I?m thinking I could be OK if there was just a
way to <br>> actually stop them rather than suspend them. Any undocumented
<br>> options to mmchdisk that I?m not aware of???<br>> <br>> Are there other options - besides buying IBM hardware - that I am
<br>> overlooking? Thanks...<br>> <br>> ?<br>> Kevin Buterbaugh - Senior System Administrator<br>> Vanderbilt University - Advanced Computing Center for Research and
Education<br>> </span></tt><a href=mailto:Kevin.Buterbaugh@vanderbilt.edu><tt><span style=" font-size:10pt;color:blue"><u>Kevin.Buterbaugh@vanderbilt.edu</u></span></tt></a><tt><span style=" font-size:10pt"><</span></tt><a href=mailto:Kevin.Buterbaugh@vanderbilt.edu><tt><span style=" font-size:10pt;color:blue"><u>mailto:Kevin.Buterbaugh@vanderbilt.edu</u></span></tt></a><tt><span style=" font-size:10pt"><br>> > - (615)875-9633<br>> <br>> <br>> <br></span></tt><span style=" font-size:12pt"><br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__spectrumscale.org&d=DwMGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Bn1XE9uK2a9CZQ8qKnJE3Q&m=3yfKUCiWGXtAEPiwlmQNFGTjLx5h3PlCYfUXDBMGJpQ&s=FyRrHzLD4MgOwrBAqX209oNMkUzNcwDOke7kkZiYTFM&e="><span style=" font-size:12pt;color:blue"><u>spectrumscale.org</u></span></a><span style=" font-size:12pt;color:blue"><u><br></u></span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__na01.safelinks.protection.outlook.com_-3Furl-3Dhttp-253A-252F-252Fgpfsug.org-252Fmailman-252Flistinfo-252Fgpfsug-2Ddiscuss-26data-3D02-257C01-257CKevin.Buterbaugh-2540vanderbilt.edu-257C435bd89b3fcc4a94ee5008d56f17e49e-257C5f88b91902e3490fb772327aa8177b95-257C0-257C0-257C636537070783260582-26sdata-3DAbY7rJQecb76rMC-252FlxrthyzHfueQDJTT-252FJuuRCac5g8-253D-26reserved-3D0&d=DwMGaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=Bn1XE9uK2a9CZQ8qKnJE3Q&m=3yfKUCiWGXtAEPiwlmQNFGTjLx5h3PlCYfUXDBMGJpQ&s=DNl2v3nBA7ij3msPm9ykLLyBAK3eRcbNjfuw20WsE58&e="><span style=" font-size:12pt;color:blue"><u>https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=02%7C01%7CKevin.Buterbaugh%40vanderbilt.edu%7C435bd89b3fcc4a94ee5008d56f17e49e%7C5f88b91902e3490fb772327aa8177b95%7C0%7C0%7C636537070783260582&sdata=AbY7rJQecb76rMC%2FlxrthyzHfueQDJTT%2FJuuRCac5g8%3D&reserved=0</u></span></a><br><br><tt><span style=" font-size:10pt">_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></span></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=Bn1XE9uK2a9CZQ8qKnJE3Q&m=3yfKUCiWGXtAEPiwlmQNFGTjLx5h3PlCYfUXDBMGJpQ&s=-pkjeFOUVSDUGgwtKkoYbmGLADk2UHfDbUPiuWSw4gQ&e="><tt><span style=" font-size:10pt">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=Bn1XE9uK2a9CZQ8qKnJE3Q&m=3yfKUCiWGXtAEPiwlmQNFGTjLx5h3PlCYfUXDBMGJpQ&s=-pkjeFOUVSDUGgwtKkoYbmGLADk2UHfDbUPiuWSw4gQ&e=</span></tt></a><tt><span style=" font-size:10pt"><br></span></tt><br><br><BR>