<font size=2 face="sans-serif">HI</font><br><br><font size=2 face="sans-serif">U must remember the following:</font><br><br><font size=2 face="sans-serif">Network vlan should be the same between
2 Main Sites - since the CES IP failover will not work...</font><br><br><font size=2 face="sans-serif">U can define :</font><br><font size=2 face="sans-serif">Site1 - 2 x NSD servers + Quorum </font><br><font size=2 face="sans-serif">Site2 - 2 x NSD servers + Quorum</font><br><br><font size=2 face="sans-serif">GPFS FS replication define with failure
groups. (Latency must be very low in order to have write performance).</font><br><br><font size=2 face="sans-serif">Site3 - 1 x Quorum + Local disk as Tie
Breaker Disk. (Desc Only)</font><br><br><font size=2 face="sans-serif">Hope this help.<br></font><br><font size=1 face="Arial"> </font><p><font size=2 face="Arial">Regards</font><p><font size=1 face="Arial"> </font><p><table width=780 style="border-collapse:collapse;"><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><p><font size=1 face="Arial"> </font><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial"> </font><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=blue face="Arial"><b>Yaron
Daniel</b></font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial"> 94
Em Ha'Moshavot Rd</font><td width=96 rowspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=right><img align=bottom src=cid:_1_0A46A9600A46A3CC001A6070C2257FF7 style="border:0px solid;"></div><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=blue face="Arial"><b>Server,
</b></font><a href="https://w3-03.ibm.com/services/isd/secure/client.wss/Somt?eventType=getHomePage&somtId=115"><font size=2 color=blue face="Arial"><b>Storage
and Data Services</b></font></a><font size=2 color=blue face="Arial"><b>- Team Leader</b></font><font size=1 color=blue face="Arial"><b>
</b></font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial"> Petach
Tiqva, 49527</font><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=blue face="Arial"><b>Global
Technology Services</b></font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial"> Israel</font><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">Phone:</font><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">+972-3-916-5672</font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial"> </font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">Fax:</font><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">+972-3-916-5672</font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">Mobile:</font><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">+972-52-8395593</font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">e-mail:</font><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">yard@il.ibm.com</font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><a href=http://www.ibm.com/il/he/><font size=2 color=blue face="Arial"><u>IBM
Israel</u></font></a><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#5f5f5f face="Arial"> </font><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#5f5f5f face="Arial"> </font></table><br><p><font size=3> </font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">"Ken Hill"
<kenh@us.ibm.com></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">gpfsug main discussion
list <gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">07/21/2016 03:02 AM</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">Re: [gpfsug-discuss]
NDS in Two Site scenario</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=2 face="sans-serif">Yes - it is a cluster.</font><font size=3><br></font><font size=2 face="sans-serif"><br>The sites should NOT be further than a MAN - or Campus network. If you're
looking to do this over a large distance - it would be best to choose another
GPFS solution (Multi-Cluster, AFM, etc).</font><font size=3><br></font><font size=2 face="sans-serif"><br>Regards,</font><font size=3><br></font><font size=3 color=#8f8f8f face="Arial"><b><br>Ken Hill</b></font><font size=2 face="Arial"><br>Technical Sales Specialist | Software Defined Solution Sales<br>IBM Systems</font><p><table width=776 style="border-collapse:collapse;"><tr height=8><td width=774 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><hr><tr height=8><td width=157 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=1 color=#4181c0 face="Arial"><b>Phone:</b></font><font size=1 face="Arial">1-540-207-7270</font><font size=1 color=#4181c0 face="Arial"><b><br>E-mail:</b></font><font size=3 face="Arial"> </font><a href=mailto:kenh@us.ibm.com target=_blank><font size=1 color=#5f5f5f face="Arial"><u>kenh@us.ibm.com</u></font></a><td width=606 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><div align=right><a href="http://www.ibm.com/us-en/"><img src=cid:_4_0A46793C0A46742C001A6070C2257FF7 width=74 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="http://www-03.ibm.com/systems/platformcomputing/products/lsf/"><img src=cid:_4_0A467D880A46742C001A6070C2257FF7 width=31 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="http://www-03.ibm.com/systems/platformcomputing/products/high-performance-services/index.html"><img src=cid:_4_0A4681D40A46742C001A6070C2257FF7 width=28 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="http://www-03.ibm.com/systems/platformcomputing/products/symphony/index.html"><img src=cid:_4_0A4686200A46742C001A6070C2257FF7 width=29 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="http://www-03.ibm.com/systems/storage/spectrum/"><img src=cid:_4_0A468A6C0A46742C001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="http://www-01.ibm.com/software/tivoli/csi/cloud-storage/"><img src=cid:_4_0A468EB80A46742C001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="http://www-01.ibm.com/software/tivoli/csi/backup-recovery/"><img src=cid:_4_0A4693040A46742C001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="http://www-03.ibm.com/systems/storage/tape/ltfs/index.html"><img src=cid:_4_0A4697500A46742C001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="http://www-03.ibm.com/systems/storage/spectrum/"><img src=cid:_4_0CE401000A46742C001A6070C2257FF7 width=27 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="http://www-03.ibm.com/systems/storage/spectrum/scale/"><img src=cid:_4_0CE4054C0A46742C001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3>
</font><a href="https://www.ibm.com/marketplace/cloud/object-storage/us/en-us"><img src=cid:_4_0CE409980A46742C001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3>
</font><font size=1 face="Arial"><br><br>2300 Dulles Station Blvd<br>Herndon, VA 20171-6133<br>United States</font></div><td width=6 valign=top style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"></table><br><font size=3><br><br><br><br><br></font><font size=1 color=#5f5f5f face="sans-serif"><br>From: </font><font size=1 face="sans-serif">"Mark.Bush@siriuscom.com"
<Mark.Bush@siriuscom.com></font><font size=1 color=#5f5f5f face="sans-serif"><br>To: </font><font size=1 face="sans-serif">gpfsug
main discussion list <gpfsug-discuss@spectrumscale.org></font><font size=1 color=#5f5f5f face="sans-serif"><br>Date: </font><font size=1 face="sans-serif">07/20/2016
07:33 PM</font><font size=1 color=#5f5f5f face="sans-serif"><br>Subject: </font><font size=1 face="sans-serif">Re:
[gpfsug-discuss] NDS in Two Site scenario</font><font size=1 color=#5f5f5f face="sans-serif"><br>Sent by: </font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><font size=3><br></font><hr noshade><font size=3><br><br></font><font size=2 face="Calibri"><br>So in this scenario Ken, can server3 see any disks in site1? <br> </font><font size=3 face="Calibri"><b><br>From: </b><gpfsug-discuss-bounces@spectrumscale.org> on behalf of
Ken Hill <kenh@us.ibm.com><b><br>Reply-To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Date: </b>Wednesday, July 20, 2016 at 4:15 PM<b><br>To: </b>gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><b><br>Subject: </b>Re: [gpfsug-discuss] NDS in Two Site scenario</font><font size=3 face="Times New Roman"><br> </font><font size=2 face="sans-serif"><br><br>
Site1
Site2<br>
Server1 (quorum 1)
Server3 (quorum
2)<br>
Server2
Server4</font><font size=3 face="Times New Roman"><br><br><br></font><font size=2 face="sans-serif"><br><br>
SiteX <br>
Server5 (quorum 3)</font><font size=3 face="Times New Roman"><br><br><br></font><font size=2 face="sans-serif"><br><br>You need to set up another site (or server) that is at least power isolated
(if not completely infrastructure isolated) from Site1 or Site2. You would
then set up a quorum node at that site | location. This insures you can
still access your data even if one of your sites go down.<br><br>You can further isolate failure by increasing quorum (odd numbers).<br><br>The way quorum works is: The majority of the quorum nodes need to be up
to survive an outage.<br><br>- With 3 quorum nodes you can have 1 quorum node failures and continue
filesystem operations.<br>- With 5 quorum nodes you can have 2 quorum node failures and continue
filesystem operations.<br>- With 7 quorum nodes you can have 3 quorum node failures and continue
filesystem operations.<br>- etc<br><br>Please see </font><a href="http://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.0/ibmspectrumscale42_content.html?view=kc"><font size=2 color=blue face="sans-serif"><u>http://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.0/ibmspectrumscale42_content.html?view=kc</u></font></a><font size=2 face="sans-serif">for
more information about quorum and tiebreaker disks.</font><font size=3 color=#8f8f8f face="Arial"><b><br><br>Ken Hill</b></font><font size=2 face="Arial"><br>Technical Sales Specialist | Software Defined Solution Sales<br>IBM Systems</font><font size=3 face="Times New Roman"> </font><p><table width=774 style="border-collapse:collapse;"><tr height=8><td width=772 colspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><div align=center><hr></div><tr height=8><td width=157 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=1 color=#4181c0 face="Arial"><b>Phone:</b></font><font size=1 face="Arial">1-540-207-7270</font><font size=1 color=#4181c0 face="Arial"><b><br>E-mail:</b></font><font size=3 face="Arial"> </font><a href=mailto:kenh@us.ibm.com target=_blank><font size=1 color=#5f5f5f face="Arial"><u>kenh@us.ibm.com</u></font></a><td width=605 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><div align=right><a href="http://www.ibm.com/us-en/"><img src=cid:_4_0CE444F00CE440F0001A6070C2257FF7 width=74 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="http://www-03.ibm.com/systems/platformcomputing/products/lsf/"><img src=cid:_4_0CE448BC0CE440F0001A6070C2257FF7 width=31 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="http://www-03.ibm.com/systems/platformcomputing/products/high-performance-services/index.html"><img src=cid:_4_0CE44D080CE440F0001A6070C2257FF7 width=28 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="http://www-03.ibm.com/systems/platformcomputing/products/symphony/index.html"><img src=cid:_4_0CE451540CE440F0001A6070C2257FF7 width=29 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="http://www-03.ibm.com/systems/storage/spectrum/"><img src=cid:_4_0CE455A00CE440F0001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="http://www-01.ibm.com/software/tivoli/csi/cloud-storage/"><img src=cid:_4_0CE459EC0CE440F0001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="http://www-01.ibm.com/software/tivoli/csi/backup-recovery/"><img src=cid:_4_0CE45E380CE440F0001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="http://www-03.ibm.com/systems/storage/tape/ltfs/index.html"><img src=cid:_4_0CE462840CE440F0001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="http://www-03.ibm.com/systems/storage/spectrum/"><img src=cid:_4_0CE466D00CE440F0001A6070C2257FF7 width=27 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="http://www-03.ibm.com/systems/storage/spectrum/scale/"><img src=cid:_4_0CE46B1C0CE440F0001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><a href="https://www.ibm.com/marketplace/cloud/object-storage/us/en-us"><img src=cid:_4_0CE46F680CE440F0001A6070C2257FF7 width=26 height=30 style="border:0px solid;"></a><font size=3 face="Times New Roman">
</font><font size=1 face="Arial"><br><br>2300 Dulles Station Blvd<br>Herndon, VA 20171-6133<br>United States</font></div><td width=6 valign=top style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"></table><p><font size=3 face="Times New Roman"><br><br><br><br></font><font size=1 color=#5f5f5f face="sans-serif"><br><br>From: </font><font size=1 face="sans-serif">"Mark.Bush@siriuscom.com"
<Mark.Bush@siriuscom.com></font><font size=1 color=#5f5f5f face="sans-serif"><br>To: </font><font size=1 face="sans-serif">gpfsug
main discussion list <gpfsug-discuss@spectrumscale.org></font><font size=1 color=#5f5f5f face="sans-serif"><br>Date: </font><font size=1 face="sans-serif">07/20/2016
04:47 PM</font><font size=1 color=#5f5f5f face="sans-serif"><br>Subject: </font><font size=1 face="sans-serif">[gpfsug-discuss]
NDS in Two Site scenario</font><font size=1 color=#5f5f5f face="sans-serif"><br>Sent by: </font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><div align=center><hr noshade></div><p><font size=3 face="Times New Roman"><br><br></font><font size=2 face="Calibri"><br><br>For some reason this concept is a round peg that doesn’t fit the square
hole inside my brain. Can someone please explain the best practice
to setting up two sites same cluster? I get that I would likely have
two NDS nodes in site 1 and two NDS nodes in site two. What I don’t
understand are the failure scenarios and what would happen if I lose one
or worse a whole site goes down. Do I solve this by having scale
replication set to 2 for all my files? I mean a single site I think
I get it’s when there are two datacenters and I don’t want two clusters
typically.<br><br></font><font size=2 color=#002f80 face="Calibri"><br><br>Mark R. Bush</font><font size=2 face="Calibri">| Solutions Architect<br>Mobile: 210.237.8415 | mark.bush@siriuscom.com<br>Sirius Computer Solutions | </font><a href=http://www.siriuscom.com/><font size=2 color=blue face="Calibri"><u>www.siriuscom.com</u></font></a><font size=2 face="Calibri"><br>10100 Reunion Place, Suite 500, San Antonio, TX 78216 </font><font size=3 face="Times New Roman"><br> </font><p><font size=1 face="Cambria">This message (including any attachments)
is intended only for the use of the individual or entity to which it is
addressed and may contain information that is non-public, proprietary,
privileged, confidential, and exempt from disclosure under applicable law.
If you are not the intended recipient, you are hereby notified that any
use, dissemination, distribution, or copying of this communication is strictly
prohibited. This message may be viewed by parties at Sirius Computer Solutions
other than those named in the message header. This message does not contain
an official representation of Sirius Computer Solutions. If you have received
this communication in error, notify Sirius Computer Solutions immediately
and (i) destroy this message if a facsimile or (ii) delete this message
immediately if this is an electronic communication. Thank you. </font><p><a href=http://www.siriuscom.com/><font size=2 color=#0082bf face="Calibri"><b><u>Sirius
Computer Solutions</u></b></font></a><font size=2 face="Courier New">_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font><font size=3 color=blue><u><br></u></font><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><font size=2 color=blue face="Courier New"><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></a><p><font size=3 face="Times New Roman"> </font><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font></tt><font size=3 color=blue><u><br></u></font><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2 color=blue><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></tt></a><p><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size=2><br></font></tt><p><p><BR>