<div dir="ltr"><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small">Thanks for participating in the discussion.</div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small">Immediately after replication I am getting the error documented below, I have moved the mmsdrfs file (upon deleting the previous filesystem definitions, because I have managed to configure exactly equal my source and target clusters). Even then, I am getting the following error:<br></div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small">GPFS: 6027-419 Failed to read a file system descriptor.</div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small">There is an input or output error.</div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small">mmlsfs: 6027-1639 Command failed. Examine previous <br></div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small"><br></div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small">That's the same error that upon first replicating without taking any other action. I think I am missing something really important but still dont know what it is.<br></div><div class="gmail_default" style="font-family:tahoma,sans-serif;font-size:small"><br></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><img src="https://docs.google.com/uc?export=download&id=1qBobw7lgHUL5kvclOrp0EeujITqmX4ZE&revid=0B2nrOyWM3zSNeVA3M1VXN1U2bzJncmxQSVV0cDFiOGUyYXVRPQ"><br></div></div></div></div></div>
<br><div class="gmail_quote">2018-01-26 15:21 GMT-05:00 Glen Corneau <span dir="ltr"><<a href="mailto:gcorneau@us.ibm.com" target="_blank">gcorneau@us.ibm.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><font face="sans-serif" size="2">Scale will walk across all discovered disks
upon start time and attempt to read the NSD identifiers from the disks.
Once it finds them, it makes a local map file that correlates the
NSD id and the hdiskX identifier. The names do not have to be the
same as either the source cluster or even from node-to-node.</font><br><br><font face="sans-serif" size="2">The main thing to keep in mind is to
keep the file system definitions in sync between the source and destination
clusters. The "syncFSconfig" user exit is the best way
to do it because it's automatic. You generally shouldn't be shuffling
the mmsdrfs file between sites, that's what the "mmfsctl syncFSconfig"
does for you, on a per-file system basis.</font><br><br><font face="sans-serif" size="2">GPFS+AIX customers have been using this
kind of storage replication for over 10 years, it's business as usual.</font><br><font face="sans-serif" size="2"><br>------------------<br>Glen Corneau<br>Power Systems</font><br><font face="sans-serif" size="2">Washington Systems Center<br><a href="mailto:gcorneau@us.ibm.com" target="_blank">gcorneau@us.ibm.com</a></font><br><br><img src="cid:_2_D7919B38D79198B0006FAB8086258221" style="border:0px solid"><br><br><br><br><font face="sans-serif" color="#5f5f5f" size="1">From:
</font><font face="sans-serif" size="1">Harold Morales <<a href="mailto:hmorales@optimizeit.co" target="_blank">hmorales@optimizeit.co</a>></font><br><font face="sans-serif" color="#5f5f5f" size="1">To:
</font><font face="sans-serif" size="1">gpfsug main discussion
list <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.<wbr>org</a>></font><br><font face="sans-serif" color="#5f5f5f" size="1">Date:
</font><font face="sans-serif" size="1">01/26/2018 12:30 PM</font><br><font face="sans-serif" color="#5f5f5f" size="1">Subject:
</font><font face="sans-serif" size="1">Re: [gpfsug-discuss]
storage-based replication for Spectrum Scale</font><br><font face="sans-serif" color="#5f5f5f" size="1">Sent by:
</font><font face="sans-serif" size="1"><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@<wbr>spectrumscale.org</a></font><br><hr noshade><span class=""><br><br><br><font face="Tahoma" size="2">Hi Alex, This set up seems close to what
I am trying to achieve.</font><br><br><font face="Tahoma" size="2">With regards to this kind of replication:
any prereqs need to be met in the target environment for this to work?
for example, should disk devices naming on AIX be the same as in the source
environment? when importing the mmsdrfs file, how is Scale going to know
which disks should it assign to the cluster? by their hdisk name alone?</font><br><br><font face="Tahoma" size="2">Thanks again,</font><br><br><br><br></span><span class=""><font size="3">2018-01-24 2:30 GMT-05:00 Alex Levin <</font><a href="mailto:alevin@gmail.com" target="_blank"><font color="blue" size="3"><u>alevin@gmail.com</u></font></a><font size="3">>:</font><br><font size="2">Hi, </font><br><br><font size="2">We are using a similar type of replication.</font><br><font size="2">I assume the site B is the cold site prepared for DR</font><br><br><font size="2">The storage layer is EMC VMAX and the LUNs are replicated with
SRDF.</font><br><font size="2">All LUNs ( NSDs ) of the gpfs filesystem are in the
same VMAX replication group to ensure consistency.</font><br><br><font size="2">The cluster name, IP addresses , hostnames of the
cluster nodes are different on another site - it can be a pre-configured
cluster without gpfs filesystems or with another filesystem.</font><br><font size="2">Same names and addresses shouldn't be a problem.</font><br><br><font size="2">Additionally to the replicated LUNs/NSDs you need to deliver
copy of /var/mmfs/gen/mmsdrfs file from A to B site.</font><br><font size="2">There is no need to replicate it in real-time, only after
the change of the cluster configuration.</font><br><br><font size="2">To activate site B - present replicated LUNs
to the nodes in the DR cluster and run mmimportfs as
"mmimportfs fs_name -i copy_of_mmsdrfs"</font><br><br><font size="2">Tested with multiples LUNs and filesystems on various
workloads - seems to be working </font><br><br><font size="2">--Alex</font><br><br><br><br></span><span class=""><font size="3">On Wed, Jan 24, 2018 at 1:33 AM, Harold Morales <</font><a href="mailto:hmorales@optimizeit.co" target="_blank"><font color="blue" size="3"><u>hmorales@optimizeit.co</u></font></a><font size="3">>
wrote:</font><br><font face="Tahoma" size="2">Thanks for answering.</font><br><br><font face="Tahoma" size="2">Essentially, the idea being explored is
to replicate LUNs between identical storage hardware (HP 3PAR volumesrein)
on both sites. There is an IP connection between storage boxes but not
between servers on both sites, there is a dark fiber connecting both sites.
Here they dont want to explore the idea of a scaled-based.</font><br><br><font size="3"><br>______________________________<wbr>_________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__spectrumscale.org&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=d-vphLEe_UlGazP6RdYAyyAA3Qv5S9IRVNuO1i9vjJc&m=VbfWaftYSVjx8fMb2vHGBi6XUhDJOsKf_dKOX3J8s1A&s=7mUgkiF6PXf-djg8ue9FAFIqhNyoSzE6wYaIK_jmSPQ&e=" target="_blank"><font color="blue" size="3"><u>spectrumscale.org</u></font></a><font color="blue" size="3"><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=d-vphLEe_UlGazP6RdYAyyAA3Qv5S9IRVNuO1i9vjJc&m=VbfWaftYSVjx8fMb2vHGBi6XUhDJOsKf_dKOX3J8s1A&s=p2mGvPrlPLO1oyEh-GeVJiVS49opBwwCFs-FKQrQ7rc&e=" target="_blank"><font color="blue" size="3"><u>http://gpfsug.org/mailman/<wbr>listinfo/gpfsug-discuss</u></font></a><font size="3"><br></font><br><br><font size="3"><br>______________________________<wbr>_________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at </font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__spectrumscale.org&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=d-vphLEe_UlGazP6RdYAyyAA3Qv5S9IRVNuO1i9vjJc&m=VbfWaftYSVjx8fMb2vHGBi6XUhDJOsKf_dKOX3J8s1A&s=7mUgkiF6PXf-djg8ue9FAFIqhNyoSzE6wYaIK_jmSPQ&e=" target="_blank"><font color="blue" size="3"><u>spectrumscale.org</u></font></a><font color="blue" size="3"><u><br></u></font><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwMFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=d-vphLEe_UlGazP6RdYAyyAA3Qv5S9IRVNuO1i9vjJc&m=VbfWaftYSVjx8fMb2vHGBi6XUhDJOsKf_dKOX3J8s1A&s=p2mGvPrlPLO1oyEh-GeVJiVS49opBwwCFs-FKQrQ7rc&e=" target="_blank"><font color="blue" size="3"><u>http://gpfsug.org/mailman/<wbr>listinfo/gpfsug-discuss</u></font></a><font size="3"><br></font><br><tt><font size="2">______________________________<wbr>_________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at <a href="http://spectrumscale.org" target="_blank">spectrumscale.org</a><br></font></tt></span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=d-vphLEe_UlGazP6RdYAyyAA3Qv5S9IRVNuO1i9vjJc&m=VbfWaftYSVjx8fMb2vHGBi6XUhDJOsKf_dKOX3J8s1A&s=p2mGvPrlPLO1oyEh-GeVJiVS49opBwwCFs-FKQrQ7rc&e=" target="_blank"><tt><font size="2">https://urldefense.proofpoint.<wbr>com/v2/url?u=http-3A__gpfsug.<wbr>org_mailman_listinfo_gpfsug-<wbr>2Ddiscuss&d=DwICAg&c=jf_<wbr>iaSHvJObTbx-siA1ZOg&r=d-<wbr>vphLEe_<wbr>UlGazP6RdYAyyAA3Qv5S9IRVNuO1i9<wbr>vjJc&m=<wbr>VbfWaftYSVjx8fMb2vHGBi6XUhDJOs<wbr>Kf_dKOX3J8s1A&s=<wbr>p2mGvPrlPLO1oyEh-<wbr>GeVJiVS49opBwwCFs-FKQrQ7rc&e=</font></tt></a><tt><font size="2"><br></font></tt><br><br><br><br>______________________________<wbr>_________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" rel="noreferrer" target="_blank">spectrumscale.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/<wbr>listinfo/gpfsug-discuss</a><br>
<br></blockquote></div><br></div>