<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">The annoying answer is "it depends”.<div class=""><br class=""></div><div class="">I ran a system with all of the NSDs being visible to all of the NSDs on both sites and that worked well. </div><div class=""><br class=""></div><div class="">However there are lots of questions to answer:</div><div class=""><br class=""></div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Where are the clients going to live? </div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Will you have clients in both sites or just one? </div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Is it dual site working or just DR?</div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Where will the majority of the writes happen? </div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Would you rather that traffic went over the SAN or the IP link?</div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Do you have a SAN link between the 2 sites?</div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Which is faster, the SAN link between sites or the IP link between the sites? </div><div class=""><span class="Apple-tab-span" style="white-space:pre"> </span>Are they the same link? Are they both redundant, which is the most stable?</div><div class=""><br class=""></div><div class="">The answers to these questions would drive the design of the gpfs filesystem.</div><div class=""><br class=""></div><div class="">For example if there are clients on only on site A , you might then make the NSD servers on site A the primary NSD servers for all of the NSDs on site A and site B - then you send the replica blocks over the SAN.</div><div class=""><br class=""></div><div class="">You also could make a matrix of the failure scenarios you want to protect against, the consequences of the failure and the likelihood of failure etc. That will also inform the design.</div><div class=""><br class=""></div><div class="">Does that help?</div><div class=""><br class=""></div><div class="">Vic</div><div class=""><br class=""><div><blockquote type="cite" class=""><div class="">On 21 Jul 2016, at 1:45 pm, <a href="mailto:Mark.Bush@siriuscom.com" class="">Mark.Bush@siriuscom.com</a> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="WordSection1" style="page: WordSection1; font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);"><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">This is where my confusion sits. So if I have two sites, and two NDS Nodes per site with 1 NSD (to keep it simple), do I just present the physical LUN in Site1 to Site1 NDS Nodes and physical LUN in Site2 to Site2 NSD Nodes? Or is it that I present physical LUN in Site1 to all 4 NDS Nodes and the same at Site2? (Assuming SAN and not direct attached in this case). I know I’m being persistent but this for some reason confuses me. <o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">Site1<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">NSD Node1<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""> ---NSD1 ---Physical LUN1 from SAN1<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">NSD Node2<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">Site2<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">NSD Node3 <o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt 0.5in; font-size: 12pt; font-family: 'Times New Roman'; text-indent: 0.5in;" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">---NSD2 –Physical LUN2 from SAN2<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">NSD Node4<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">Or<span class="Apple-converted-space"> </span><o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">Site1<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">NSD Node1<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""> ----NSD1 –Physical LUN1 from SAN1<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""> ----NSD2 –Physical LUN2 from SAN2<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">NSD Node2<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">Site 2<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">NSD Node3 <o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""> ---NSD2 – Physical LUN2 from SAN2<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""> ---NSD1 --Physical LUN1 from SAN1<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">NSD Node4<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">Site 3<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class="">Node5 Quorum<o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""></o:p></span></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 11pt; font-family: Calibri;" class=""><o:p class=""> </o:p></span></div><div style="border-style: solid none none; border-top-color: rgb(181, 196, 223); border-top-width: 1pt; padding: 3pt 0in 0in;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><b class=""><span style="font-family: Calibri;" class="">From:<span class="Apple-converted-space"> </span></span></b><span style="font-family: Calibri;" class=""><<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a>> on behalf of Ken Hill <<a href="mailto:kenh@us.ibm.com" style="color: purple; text-decoration: underline;" class="">kenh@us.ibm.com</a>><br class=""><b class="">Reply-To:<span class="Apple-converted-space"> </span></b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><br class=""><b class="">Date:<span class="Apple-converted-space"> </span></b>Wednesday, July 20, 2016 at 7:02 PM<br class=""><b class="">To:<span class="Apple-converted-space"> </span></b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><br class=""><b class="">Subject:<span class="Apple-converted-space"> </span></b>Re: [gpfsug-discuss] NDS in Two Site scenario<o:p class=""></o:p></span></div></div><div class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><o:p class=""> </o:p></div></div><div class=""><div class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class="">Yes - it is a cluster.</span><br class=""><br class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class="">The sites should NOT be further than a MAN - or Campus network. If you're looking to do this over a large distance - it would be best to choose another GPFS solution (Multi-Cluster, AFM, etc).</span><br class=""><br class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class="">Regards,</span><br class=""><br class=""><b class=""><span style="font-family: Arial; color: rgb(143, 143, 143);" class="">Ken Hill</span></b><span style="font-size: 10pt; font-family: Arial;" class=""><br class="">Technical Sales Specialist | Software Defined Solution Sales<br class="">IBM Systems</span><o:p class=""></o:p></div><table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="776" style="width: 582pt; border-collapse: collapse;"><tbody class=""><tr style="height: 6pt;" class=""><td width="776" colspan="3" style="width: 582pt; padding: 0in; height: 6pt;" class=""><div class="MsoNormal" align="center" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman'; text-align: center;"><hr size="2" width="100%" align="center" class=""></div></td></tr><tr style="height: 6pt;" class=""><td width="159" style="width: 119.25pt; padding: 0in; height: 6pt;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><b class=""><span style="font-size: 7.5pt; font-family: Arial; color: rgb(65, 129, 192);" class="">Phone:</span></b><span style="font-size: 7.5pt; font-family: Arial;" class="">1-540-207-7270<b class=""><span style="color: rgb(65, 129, 192);" class=""><br class="">E-mail:</span></b></span><span style="font-family: Arial;" class=""><span class="Apple-converted-space"> </span></span><a href="mailto:kenh@us.ibm.com" target="_blank" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 7.5pt; font-family: Arial; color: rgb(95, 95, 95);" class="">kenh@us.ibm.com</span></a><o:p class=""></o:p></div></td><td width="616" style="width: 462pt; padding: 0in; height: 6pt;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman'; text-align: right;" class=""><a href="http://www.ibm.com/us-en/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image001.png@01D1E323.CF61AAE0"><image001.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/platformcomputing/products/lsf/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image002.png@01D1E323.CF61AAE0"><image002.png></span></span></a> <a href="http://www-03.ibm.com/systems/platformcomputing/products/high-performance-services/index.html" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image003.png@01D1E323.CF61AAE0"><image003.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/platformcomputing/products/symphony/index.html" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image004.png@01D1E323.CF61AAE0"><image004.png></span></span></a> <a href="http://www-03.ibm.com/systems/storage/spectrum/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image005.png@01D1E323.CF61AAE0"><image005.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-01.ibm.com/software/tivoli/csi/cloud-storage/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image006.png@01D1E323.CF61AAE0"><image006.png></span></span></a> <a href="http://www-01.ibm.com/software/tivoli/csi/backup-recovery/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image007.png@01D1E323.CF61AAE0"><image007.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/storage/tape/ltfs/index.html" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image008.png@01D1E323.CF61AAE0"><image008.png></span></span></a> <a href="http://www-03.ibm.com/systems/storage/spectrum/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image009.png@01D1E323.CF61AAE0"><image009.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/storage/spectrum/scale/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image010.png@01D1E323.CF61AAE0"><image010.png></span></span></a> <a href="https://www.ibm.com/marketplace/cloud/object-storage/us/en-us" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image011.png@01D1E323.CF61AAE0"><image011.png></span></span></a> <br class=""><span style="font-size: 7.5pt; font-family: Arial;" class=""><br class="">2300 Dulles Station Blvd<br class="">Herndon, VA 20171-6133<br class="">United States</span><o:p class=""></o:p></div></td><td width="6" valign="top" style="width: 4.5pt; padding: 0in; height: 6pt;" class=""></td></tr></tbody></table><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class=""><br class=""><br class=""><br class=""><br class=""><br class=""><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">From: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class="">"<a href="mailto:Mark.Bush@siriuscom.com" style="color: purple; text-decoration: underline;" class="">Mark.Bush@siriuscom.com</a>" <<a href="mailto:Mark.Bush@siriuscom.com" style="color: purple; text-decoration: underline;" class="">Mark.Bush@siriuscom.com</a>></span><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">To: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class="">gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>></span><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">Date: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class="">07/20/2016 07:33 PM</span><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">Subject: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class="">Re: [gpfsug-discuss] NDS in Two Site scenario</span><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class="">Sent by: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class=""><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a></span><o:p class=""></o:p></p><div class="MsoNormal" align="center" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman'; text-align: center;"><hr size="2" width="100%" noshade="" align="center" style="color: rgb(170, 170, 170);" class=""></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><br class=""><br class=""><br class=""><span style="font-size: 10pt; font-family: Calibri;" class="">So in this scenario Ken, can server3 see any disks in site1? </span><br class=""><span style="font-size: 10pt; font-family: Calibri;" class=""> </span><br class=""><b class=""><span style="font-family: Calibri;" class="">From:<span class="Apple-converted-space"> </span></span></b><span style="font-family: Calibri;" class=""><<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a>> on behalf of Ken Hill <<a href="mailto:kenh@us.ibm.com" style="color: purple; text-decoration: underline;" class="">kenh@us.ibm.com</a>><b class=""><br class="">Reply-To:<span class="Apple-converted-space"> </span></b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><b class=""><br class="">Date:<span class="Apple-converted-space"> </span></b>Wednesday, July 20, 2016 at 4:15 PM<b class=""><br class="">To:<span class="Apple-converted-space"> </span></b>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><b class=""><br class="">Subject:<span class="Apple-converted-space"> </span></b>Re: [gpfsug-discuss] NDS in Two Site scenario</span><br class=""> <br class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class=""><br class=""> Site1 Site2<br class=""> Server1 (quorum 1) Server3 (quorum 2)<br class=""> Server2 Server4</span><br class=""><br class=""><br class=""><br class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class=""><br class=""> SiteX<span class="Apple-converted-space"> </span><br class=""> Server5 (quorum 3)</span><br class=""><br class=""><br class=""><br class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class=""><br class="">You need to set up another site (or server) that is at least power isolated (if not completely infrastructure isolated) from Site1 or Site2. You would then set up a quorum node at that site | location. This insures you can still access your data even if one of your sites go down.</span><br class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class=""><br class="">You can further isolate failure by increasing quorum (odd numbers).</span><br class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class=""><br class="">The way quorum works is: The majority of the quorum nodes need to be up to survive an outage.<br class=""><br class="">- With 3 quorum nodes you can have 1 quorum node failures and continue filesystem operations.<br class="">- With 5 quorum nodes you can have 2 quorum node failures and continue filesystem operations.<br class="">- With 7 quorum nodes you can have 3 quorum node failures and continue filesystem operations.<br class="">- etc</span><br class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class=""><br class="">Please see<span class="Apple-converted-space"> </span></span><a href="http://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.0/ibmspectrumscale42_content.html?view=kc" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: sans-serif, serif;" class="">http://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.0/ibmspectrumscale42_content.html?view=kc</span></a><span style="font-size: 10pt; font-family: sans-serif, serif;" class="">for more information about quorum and tiebreaker disks.</span><br class=""><b class=""><span style="font-family: Arial; color: rgb(143, 143, 143);" class=""><br class="">Ken Hill</span></b><span style="font-size: 10pt; font-family: Arial;" class=""><br class="">Technical Sales Specialist | Software Defined Solution Sales<br class="">IBM Systems</span><o:p class=""></o:p></div><table class="MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="775" style="width: 581.25pt; border-collapse: collapse;"><tbody class=""><tr style="height: 6pt;" class=""><td width="775" colspan="3" style="width: 581.25pt; padding: 0in; height: 6pt;" class=""><div class="MsoNormal" align="center" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman'; text-align: center;"><hr size="2" width="100%" align="center" class=""></div></td></tr><tr style="height: 6pt;" class=""><td width="158" style="width: 118.5pt; padding: 0in; height: 6pt;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><b class=""><span style="font-size: 7.5pt; font-family: Arial; color: rgb(65, 129, 192);" class="">Phone:</span></b><span style="font-size: 7.5pt; font-family: Arial;" class="">1-540-207-7270<b class=""><span style="color: rgb(65, 129, 192);" class=""><br class="">E-mail:</span></b></span><span style="font-family: Arial;" class=""><span class="Apple-converted-space"> </span></span><a href="mailto:kenh@us.ibm.com" target="_blank" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 7.5pt; font-family: Arial; color: rgb(95, 95, 95);" class="">kenh@us.ibm.com</span></a><o:p class=""></o:p></div></td><td width="611" style="width: 458.25pt; padding: 0in; height: 6pt;" class=""><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman'; text-align: right;" class=""><a href="http://www.ibm.com/us-en/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image012.png@01D1E323.CF61AAE0"><image012.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/platformcomputing/products/lsf/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image013.png@01D1E323.CF61AAE0"><image013.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/platformcomputing/products/high-performance-services/index.html" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image014.png@01D1E323.CF61AAE0"><image014.png></span></span></a> <a href="http://www-03.ibm.com/systems/platformcomputing/products/symphony/index.html" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image015.png@01D1E323.CF61AAE0"><image015.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/storage/spectrum/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image016.png@01D1E323.CF61AAE0"><image016.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-01.ibm.com/software/tivoli/csi/cloud-storage/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image017.png@01D1E323.CF61AAE0"><image017.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-01.ibm.com/software/tivoli/csi/backup-recovery/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image018.png@01D1E323.CF61AAE0"><image018.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/storage/tape/ltfs/index.html" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image019.png@01D1E323.CF61AAE0"><image019.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/storage/spectrum/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image020.png@01D1E323.CF61AAE0"><image020.png></span></span></a> <span class="Apple-converted-space"> </span><a href="http://www-03.ibm.com/systems/storage/spectrum/scale/" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image021.png@01D1E323.CF61AAE0"><image021.png></span></span></a> <span class="Apple-converted-space"> </span><a href="https://www.ibm.com/marketplace/cloud/object-storage/us/en-us" style="color: purple; text-decoration: underline;" class=""><span style="text-decoration: none;" class=""><span id="cid:image022.png@01D1E323.CF61AAE0"><image022.png></span></span></a> <span style="font-size: 7.5pt; font-family: Arial;" class=""><br class=""><br class="">2300 Dulles Station Blvd<br class="">Herndon, VA 20171-6133<br class="">United States</span><o:p class=""></o:p></div></td><td width="6" valign="top" style="width: 4.5pt; padding: 0in; height: 6pt;" class=""></td></tr></tbody></table><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class=""><br class=""><br class=""><br class=""><br class=""><br class=""><span style="font-size: 7.5pt; font-family: sans-serif, serif; color: rgb(95, 95, 95);" class=""><br class="">From: </span><span style="font-size: 7.5pt; font-family: sans-serif, serif;" class="">"<a href="mailto:Mark.Bush@siriuscom.com" style="color: purple; text-decoration: underline;" class="">Mark.Bush@siriuscom.com</a>" <<a href="mailto:Mark.Bush@siriuscom.com" style="color: purple; text-decoration: underline;" class="">Mark.Bush@siriuscom.com</a>><span style="color: rgb(95, 95, 95);" class=""><br class="">To: </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss@spectrumscale.org</a>><span style="color: rgb(95, 95, 95);" class=""><br class="">Date: </span>07/20/2016 04:47 PM<span style="color: rgb(95, 95, 95);" class=""><br class="">Subject: </span>[gpfsug-discuss] NDS in Two Site scenario<span style="color: rgb(95, 95, 95);" class=""><br class="">Sent by: </span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" style="color: purple; text-decoration: underline;" class="">gpfsug-discuss-bounces@spectrumscale.org</a></span><o:p class=""></o:p></p><div class="MsoNormal" align="center" style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman'; text-align: center;"><hr size="2" width="100%" noshade="" align="center" style="color: rgb(170, 170, 170);" class=""></div><div style="margin: 0in 0in 0.0001pt; font-size: 12pt; font-family: 'Times New Roman';" class=""><br class=""><br class=""><br class=""><span style="font-size: 10pt; font-family: Calibri;" class=""><br class="">For some reason this concept is a round peg that doesn’t fit the square hole inside my brain. Can someone please explain the best practice to setting up two sites same cluster? I get that I would likely have two NDS nodes in site 1 and two NDS nodes in site two. What I don’t understand are the failure scenarios and what would happen if I lose one or worse a whole site goes down. Do I solve this by having scale replication set to 2 for all my files? I mean a single site I think I get it’s when there are two datacenters and I don’t want two clusters typically.</span><span style="font-size: 10pt; font-family: MingLiU;" class=""><br class=""><br class=""><br class=""></span><span style="font-size: 10pt; font-family: Calibri; color: rgb(0, 47, 128);" class=""><br class="">Mark R. Bush</span><span style="font-size: 10pt; font-family: Calibri;" class="">| Solutions Architect<br class="">Mobile: 210.237.8415 |<span class="Apple-converted-space"> </span><a href="mailto:mark.bush@siriuscom.com" style="color: purple; text-decoration: underline;" class="">mark.bush@siriuscom.com</a><br class="">Sirius Computer Solutions |<span class="Apple-converted-space"> </span></span><a href="http://www.siriuscom.com/" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: Calibri;" class="">www.siriuscom.com</span></a><span style="font-size: 10pt; font-family: Calibri;" class=""><br class="">10100 Reunion Place, Suite 500, San Antonio, TX 78216<span class="Apple-converted-space"> </span></span><span style="font-family: Calibri;" class=""><br class=""></span> <span class="Apple-converted-space"> </span><o:p class=""></o:p></div><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class=""><span style="font-size: 7.5pt; font-family: Cambria;" class="">This message (including any attachments) is intended only for the use of the individual or entity to which it is addressed and may contain information that is non-public, proprietary, privileged, confidential, and exempt from disclosure under applicable law. If you are not the intended recipient, you are hereby notified that any use, dissemination, distribution, or copying of this communication is strictly prohibited. This message may be viewed by parties at Sirius Computer Solutions other than those named in the message header. This message does not contain an official representation of Sirius Computer Solutions. If you have received this communication in error, notify Sirius Computer Solutions immediately and (i) destroy this message if a facsimile or (ii) delete this message immediately if this is an electronic communication. Thank you.</span><o:p class=""></o:p></p><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class=""><a href="http://www.siriuscom.com/" style="color: purple; text-decoration: underline;" class=""><b class=""><span style="font-size: 10pt; font-family: Calibri; color: rgb(0, 130, 191);" class="">Sirius Computer Solutions</span></b></a><span style="font-size: 10pt; font-family: 'Courier New';" class="">_______________________________________________<br class="">gpfsug-discuss mailing list<br class="">gpfsug-discuss at<span class="Apple-converted-space"> </span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class="">spectrumscale.org</a></span><u class=""><span style="color: blue;" class=""><br class=""></span></u><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline;" class=""><span style="font-size: 10pt; font-family: 'Courier New';" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></a><o:p class=""></o:p></p><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class=""> <tt style="font-family: 'Courier New';" class=""><span style="font-size: 10pt;" class="">_______________________________________________</span></tt><span style="font-size: 10pt; font-family: 'Courier New';" class=""><br class=""><tt style="font-family: 'Courier New';" class="">gpfsug-discuss mailing list</tt><br class=""><tt style="font-family: 'Courier New';" class="">gpfsug-discuss at<span class="Apple-converted-space"> </span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline;" class="">spectrumscale.org</a></tt><br class=""></span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline;" class=""><tt style="font-family: 'Courier New';" class=""><span style="font-size: 10pt;" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</span></tt></a><o:p class=""></o:p></p><p style="margin-right: 0in; margin-left: 0in; font-size: 12pt; font-family: 'Times New Roman';" class=""><o:p class=""> </o:p></p></div></div></div><span style="font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); float: none; display: inline !important;" class="">_______________________________________________</span><br style="font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class=""><span style="font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); float: none; display: inline !important;" class="">gpfsug-discuss mailing list</span><br style="font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class=""><span style="font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255); float: none; display: inline !important;" class="">gpfsug-discuss at<span class="Apple-converted-space"> </span></span><a href="http://spectrumscale.org/" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class="">spectrumscale.org</a><br style="font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class=""><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="color: purple; text-decoration: underline; font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class="">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br style="font-family: Helvetica; font-size: 13px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);" class=""></div></blockquote></div><br class=""></div></body></html>