<font size=2 face="sans-serif">Hi</font><br><br><font size=2 face="sans-serif">So - do u able to have GPFS replication
for the MD Failure Groups ?</font><br><br><font size=2 face="sans-serif">I can see that u have 3 Failure Groups
for Data -1, 2012,2034 , how many Storage Subsystems you have ?</font><br><font size=2 face="sans-serif"><br></font><br><font size=1 face="Arial"> </font><p><font size=2 face="Arial">Regards</font><p><font size=1 face="Arial"> </font><p><table width=780 style="border-collapse:collapse;"><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=center><hr noshade></div><p><font size=1 face="Arial"> </font><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 face="Arial"> </font><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=blue face="Arial"><b>Yaron
Daniel</b></font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial"> 94
Em Ha'Moshavot Rd</font><td width=96 rowspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><div align=right><img align=bottom src=cid:_1_0BAB93100BAB8D7C0072C586C22580A3 style="border:0px solid;"></div><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=blue face="Arial"><b>Server,
</b></font><a href="https://w3-03.ibm.com/services/isd/secure/client.wss/Somt?eventType=getHomePage&somtId=115"><font size=2 color=blue face="Arial"><b>Storage
and Data Services</b></font></a><font size=2 color=blue face="Arial"><b>- Team Leader</b></font><font size=1 color=blue face="Arial"><b>
</b></font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial"> Petach
Tiqva, 49527</font><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=blue face="Arial"><b>Global
Technology Services</b></font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial"> Israel</font><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">Phone:</font><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">+972-3-916-5672</font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial"> </font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">Fax:</font><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">+972-3-916-5672</font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">Mobile:</font><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">+972-52-8395593</font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=90 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">e-mail:</font><td width=426 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">yard@il.ibm.com</font><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=516 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><a href=http://www.ibm.com/il/he/><font size=2 color=blue face="Arial"><u>IBM
Israel</u></font></a><td width=168 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=96 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=2> </font><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#5f5f5f face="Arial"> </font><tr height=8><td width=780 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;"><font size=1 color=#5f5f5f face="Arial"> </font></table><br><p><font size=3> </font><br><br><br><br><font size=1 color=#5f5f5f face="sans-serif">From:
</font><font size=1 face="sans-serif">"J. Eric Wonderley"
<eric.wonderley@vt.edu></font><br><font size=1 color=#5f5f5f face="sans-serif">To:
</font><font size=1 face="sans-serif">gpfsug main discussion
list <gpfsug-discuss@spectrumscale.org></font><br><font size=1 color=#5f5f5f face="sans-serif">Date:
</font><font size=1 face="sans-serif">01/09/2017 10:48 PM</font><br><font size=1 color=#5f5f5f face="sans-serif">Subject:
</font><font size=1 face="sans-serif">Re: [gpfsug-discuss]
replication and no failure groups</font><br><font size=1 color=#5f5f5f face="sans-serif">Sent by:
</font><font size=1 face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr noshade><br><br><br><font size=3>Hi Yaron:<br></font><br><font size=3>This is the filesystem:</font><br><font size=3><br>[root@cl005 net]# mmlsdisk work<br>disk driver
sector failure holds holds
storage<br>name type
size group metadata data status
availability pool<br>------------ -------- ------ ----------- -------- ----- ------------- ------------
------------<br>nsd_a_7 nsd
512 -1 No
Yes ready up
system <br>nsd_b_7 nsd
512 -1 No
Yes ready up
system <br>nsd_c_7 nsd
512 -1 No
Yes ready up
system <br>nsd_d_7 nsd
512 -1 No
Yes ready up
system <br>nsd_a_8 nsd
512 -1 No
Yes ready up
system <br>nsd_b_8 nsd
512 -1 No
Yes ready up
system <br>nsd_c_8 nsd
512 -1 No
Yes ready up
system <br>nsd_d_8 nsd
512 -1 No
Yes ready up
system <br>nsd_a_9 nsd
512 -1 No
Yes ready up
system <br>nsd_b_9 nsd
512 -1 No
Yes ready up
system <br>nsd_c_9 nsd
512 -1 No
Yes ready up
system <br>nsd_d_9 nsd
512 -1 No
Yes ready up
system <br>nsd_a_10 nsd
512 -1 No
Yes ready up
system <br>nsd_b_10 nsd
512 -1 No
Yes ready up
system <br>nsd_c_10 nsd
512 -1 No
Yes ready up
system <br>nsd_d_10 nsd
512 -1 No
Yes ready up
system <br>nsd_a_11 nsd
512 -1 No
Yes ready up
system <br>nsd_b_11 nsd
512 -1 No
Yes ready up
system <br>nsd_c_11 nsd
512 -1 No
Yes ready up
system <br>nsd_d_11 nsd
512 -1 No
Yes ready up
system <br>nsd_a_12 nsd
512 -1 No
Yes ready up
system <br>nsd_b_12 nsd
512 -1 No
Yes ready up
system <br>nsd_c_12 nsd
512 -1 No
Yes ready up
system <br>nsd_d_12 nsd
512 -1 No
Yes ready up
system <br>work_md_pf1_1 nsd 512
200 Yes No ready
up system
<br>jbf1z1 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf2z1 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf3z1 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf4z1 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf5z1 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf6z1 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf7z1 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf8z1 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf1z2 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf2z2 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf3z2 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf4z2 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf5z2 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf6z2 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf7z2 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf8z2 nsd
4096 2012 No
Yes ready up
sas_ssd4T <br>jbf1z3 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf2z3 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf3z3 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf4z3 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf5z3 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf6z3 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf7z3 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf8z3 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf1z4 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf2z4 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf3z4 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf4z4 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf5z4 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf6z4 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf7z4 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>jbf8z4 nsd
4096 2034 No
Yes ready up
sas_ssd4T <br>work_md_pf1_2 nsd 512
200 Yes No ready
up system
<br>work_md_pf1_3 nsd 512
200 Yes No ready
up system
<br>work_md_pf1_4 nsd 512
200 Yes No ready
up system
<br>work_md_pf2_5 nsd 512
199 Yes No ready
up system
<br>work_md_pf2_6 nsd 512
199 Yes No ready
up system
<br>work_md_pf2_7 nsd 512
199 Yes No ready
up system
<br>work_md_pf2_8 nsd 512
199 Yes No ready
up system
<br>[root@cl005 net]# mmlsfs work -R -r -M -m -K<br>flag
value
description<br>------------------- ------------------------ -----------------------------------<br> -R
2
Maximum number of data replicas<br> -r
2
Default number of data replicas<br> -M
2
Maximum number of metadata replicas<br> -m
2
Default number of metadata replicas<br> -K
whenpossible
Strict replica allocation option<br></font><br><br><font size=3>On Mon, Jan 9, 2017 at 3:34 PM, Yaron Daniel <</font><a href=mailto:YARD@il.ibm.com target=_blank><font size=3 color=blue><u>YARD@il.ibm.com</u></font></a><font size=3>>
wrote:</font><br><font size=2 face="sans-serif">Hi</font><font size=3><br></font><font size=2 face="sans-serif"><br>1) Yes in case u have only 1 Failure group - replication will not work.</font><font size=3><br></font><font size=2 face="sans-serif"><br>2) Do you have 2 Storage Systems ? When using GPFS replication write
stay the same - but read can be double - since it read from 2 Storage systems</font><font size=3><br></font><font size=2 face="sans-serif"><br>Hope this help - what do you try to achive , can you share your env setup
?</font><font size=3><br></font><font size=1 face="Arial"><br> </font><br><font size=2 face="Arial">Regards</font><p><font size=1 face="Arial"> </font><p><table width=780 style="border-collapse:collapse;"><tr height=8><td width=778 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><div align=center><hr noshade></div><p><font size=1 face="Arial"> </font><tr height=8><td width=778 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=1 face="Arial"> </font><tr height=8><td width=511 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=blue face="Arial"><b>Yaron
Daniel</b></font><td width=166 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial"> 94
Em Ha'Moshavot Rd</font><td width=95 rowspan=3 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><div align=right><img align=bottom src=cid:_1_0CFB2F380CFB2B640072C586C22580A3 width=87 height=30 style="border:0px solid;"></div><tr height=8><td width=511 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=blue face="Arial"><b>Server,
</b></font><a href="https://w3-03.ibm.com/services/isd/secure/client.wss/Somt?eventType=getHomePage&somtId=115" target=_blank><font size=2 color=blue face="Arial"><b><u>Storage
and Data Services</u></b></font></a><font size=2 color=blue face="Arial"><b>-
Team Leader</b></font><font size=1 color=blue face="Arial"><b> </b></font><td width=166 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial"> Petach
Tiqva, 49527</font><tr height=8><td width=511 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=blue face="Arial"><b>Global
Technology Services</b></font><td width=166 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial"> Israel</font><tr height=8><td width=89 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial">Phone:</font><td width=420 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><a href="tel:+972%203-916-5672" target=_blank><font size=2 color=blue face="Arial"><u>+972-3-916-5672</u></font></a><td width=166 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial"> </font><td width=95 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2> </font><tr height=8><td width=89 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial">Fax:</font><td width=420 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><a href="tel:+972%203-916-5672" target=_blank><font size=2 color=blue face="Arial"><u>+972-3-916-5672</u></font></a><td width=166 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=95 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2> </font><tr height=8><td width=89 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial">Mobile:</font><td width=420 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><a href="tel:+972%2052-839-5593" target=_blank><font size=2 color=blue face="Arial"><u>+972-52-8395593</u></font></a><td width=166 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=95 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2> </font><tr height=8><td width=89 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial">e-mail:</font><td width=420 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><a href=mailto:yard@il.ibm.com target=_blank><font size=2 color=blue face="Arial"><u>yard@il.ibm.com</u></font></a><td width=166 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=95 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2> </font><tr height=8><td width=511 colspan=2 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><a href=http://www.ibm.com/il/he/ target=_blank><font size=2 color=blue face="Arial"><u>IBM
Israel</u></font></a><td width=166 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2 color=#5f5f5f face="Arial">
</font><td width=95 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=2> </font><tr height=8><td width=778 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=1 color=#5f5f5f face="Arial"> </font><tr height=8><td width=778 colspan=4 style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:1px 1px;"><font size=1 color=#5f5f5f face="Arial"> </font></table><br><p><font size=3> <br><br><br></font><font size=1 color=#5f5f5f face="sans-serif"><br>From: </font><font size=1 face="sans-serif">Brian
Marshall <</font><a href=mailto:mimarsh2@vt.edu target=_blank><font size=1 color=blue face="sans-serif"><u>mimarsh2@vt.edu</u></font></a><font size=1 face="sans-serif">></font><font size=1 color=#5f5f5f face="sans-serif"><br>To: </font><font size=1 face="sans-serif">gpfsug
main discussion list <</font><a href="mailto:gpfsug-discuss@spectrumscale.org" target=_blank><font size=1 color=blue face="sans-serif"><u>gpfsug-discuss@spectrumscale.org</u></font></a><font size=1 face="sans-serif">></font><font size=1 color=#5f5f5f face="sans-serif"><br>Date: </font><font size=1 face="sans-serif">01/09/2017
10:17 PM</font><font size=1 color=#5f5f5f face="sans-serif"><br>Subject: </font><font size=1 face="sans-serif">[gpfsug-discuss]
replication and no failure groups</font><font size=1 color=#5f5f5f face="sans-serif"><br>Sent by: </font><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target=_blank><font size=1 color=blue face="sans-serif"><u>gpfsug-discuss-bounces@spectrumscale.org</u></font></a><p><hr noshade><br><font size=3><br><br><br>All,<br><br>If I have a filesystem with replication set to 2 and 1 failure group:<br><br>1) I assume replication won't actually happen, correct?<br><br>2) Will this impact performance i.e cut write performance in half even
though it really only keeps 1 copy?<br><br>End goal - I would like a single storage pool within the filesystem to
be replicated without affecting the performance of all other pools(which
only have a single failure group)<br><br>Thanks,<br>Brian Marshall</font><br><font size=3>VT - ARC</font><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </font></tt><a href=http://spectrumscale.org/ target=_blank><tt><font size=2 color=blue><u>spectrumscale.org</u></font></tt></a><font size=3 color=blue><u><br></u></font><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target=_blank><tt><font size=2 color=blue><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></tt></a><font size=3><br><br><br></font><p><font size=3><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </font><a href=http://spectrumscale.org/ target=_blank><font size=3 color=blue><u>spectrumscale.org</u></font></a><font size=3 color=blue><u><br></u></font><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target=_blank><font size=3 color=blue><u>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</u></font></a><font size=3><br></font><br><tt><font size=2>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><font size=2>http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></tt></a><tt><font size=2><br></font></tt><br><br><BR>