<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto">If there are cluster nodes up, restore from the running nodes instead of the file. I think it’s -p, but look at the manual page.<br><br><div dir="ltr">-- <div>Stephen Ulmer</div><div><br></div><div>Sent from a mobile device; please excuse auto-correct silliness.</div></div><div dir="ltr"><br><blockquote type="cite">On Jul 29, 2022, at 11:20 AM, shao feng <shaof777@gmail.com> wrote:<br><br></blockquote></div><blockquote type="cite"><div dir="ltr"><div dir="ltr">Thanks Olaf<br><div><br></div><div>I've setup the mmsdr backup as <a href="https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=exits-mmsdrbackup-user-exit">https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=exits-mmsdrbackup-user-exit</a>, since my cluster is CCR enabled, it generate a CCR backup file,</div><div>but when trying to restore from this file, it require quorum nodes to shutdown? Is it possible to restore without touching quorum nodes?</div><div><br></div><div>[root@tofail ~]# mmsdrrestore -F CCRBackup.986.2022.07.29.23.06.19.myquorum.tar.gz<br>Restoring a CCR backup archive is a cluster-wide operation.<br>The -a flag is required.<br>mmsdrrestore: Command failed. Examine previous error messages to determine cause.</div><div><br>[root@tofail ~]# mmsdrrestore -F CCRBackup.986.2022.07.29.23.06.19.myquorum.tar.gz -a<br>Restoring CCR backup<br>Verifying that GPFS is inactive on quorum nodes<br>mmsdrrestore: GPFS is still active on myquorum<br>mmsdrrestore: Unexpected error from mmsdrrestore: CCR restore failed. Return code: 192<br>mmsdrrestore: Command failed. Examine previous error messages to determine cause.<br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jul 28, 2022 at 3:14 PM Olaf Weiser <<a href="mailto:olaf.weiser@de.ibm.com">olaf.weiser@de.ibm.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div id="gmail-m_1987661547635238404signature_bookmark" style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Hi - <br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
assuming, you'll run it withou ECE ?!? ... just with replication on the file system level
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
ba aware, every time a node goes offline, you 'll have to restart the disks in your filesystem .. This causes a complete scan of the meta data to detect files with missing updates / replication<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
apart from that to your Q :<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
you may consider to backup mmsdr <br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
additionally, take a look to mmsdrrestore, in case you want to restore a nodes's SDR configuration
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div id="gmail-m_1987661547635238404appendonsend"></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
quick and dirty.. save the content of /var/mmfs may also help you <br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
during the node is "gone".. of course.. the disk is down , after restore of SDR / node's config .. it should be able to start ..
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
the rest runs as usual <br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<hr style="display:inline-block;width:98%">
<div id="gmail-m_1987661547635238404divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>Von:</b> gpfsug-discuss <<a href="mailto:gpfsug-discuss-bounces@gpfsug.org" target="_blank">gpfsug-discuss-bounces@gpfsug.org</a>> im Auftrag von shao feng <<a href="mailto:shaof777@gmail.com" target="_blank">shaof777@gmail.com</a>><br>
<b>Gesendet:</b> Donnerstag, 28. Juli 2022 09:02<br>
<b>An:</b> gpfsug main discussion list <<a href="mailto:gpfsug-discuss@gpfsug.org" target="_blank">gpfsug-discuss@gpfsug.org</a>><br>
<b>Betreff:</b> [EXTERNAL] [gpfsug-discuss] add local nsd back to cluster?</font>
<div> </div>
</div>
<div>
<div style="font-size:1px;color:rgb(255,255,255);line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;display:none">
Hi all, I am planning to implement a cluster with a bunch of old x86 machines, the disks are not connected to nodes via the SAN network, instead each x86 machine has some local attached disks. The question is regarding node failure, for example
</div>
<div style="font-size:1px;color:rgb(255,255,255);line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;display:none">
ZjQcmQRYFpfptBannerStart</div>
<div dir="ltr" id="gmail-m_1987661547635238404x_pfptBannergb4eldm" style="opacity:1;max-width:none;max-height:none;display:block;text-align:left;margin:16px 0px;padding:8px 16px;border-radius:4px;min-width:200px;background-color:rgb(208,216,220);border-top:4px solid rgb(144,164,174)" lang="en">
<div id="gmail-m_1987661547635238404x_pfptBannergb4eldm" style="opacity:1;background-color:rgb(208,216,220);max-height:none;float:left;display:block;margin:0px 0px 1px;max-width:600px">
<div id="gmail-m_1987661547635238404x_pfptBannergb4eldm" style="opacity:1;max-width:none;max-height:none;display:block;background-color:rgb(208,216,220);color:rgb(0,0,0);font-family:Arial,sans-serif;font-weight:bold;font-size:14px;line-height:18px">
This Message Is From an External Sender </div>
<div id="gmail-m_1987661547635238404x_pfptBannergb4eldm" style="font-weight:normal;opacity:1;max-width:none;max-height:none;display:block;background-color:rgb(208,216,220);color:rgb(0,0,0);font-family:Arial,sans-serif;font-size:12px;line-height:18px;margin-top:2px">
This message came from outside your organization. </div>
</div>
<div style="height:0px;clear:both;display:block;line-height:0;font-size:0.01px">
</div>
</div>
<div style="font-size:1px;color:rgb(255,255,255);line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;display:none">
ZjQcmQRYFpfptBannerEnd</div>
<div dir="ltr">Hi all,
<div><br>
</div>
<div>I am planning to implement a cluster with a bunch of old x86 machines, the disks are not connected to nodes via the SAN network, instead each x86 machine has some local attached disks.</div>
<div>The question is regarding node failure, for example only the operating system disk fails and the nsd disks are good. In that case I plan to replace the failing OS disk with a new one and install the OS on it and re-attach these nsd disks to that node,
my question is: will this work? how can I add a nsd back to the cluster without restoring data from other replicas since the data/metadata is actually not corrupted on nsd.<br>
</div>
<div><br>
</div>
<div>Best regards,</div>
</div>
</div>
</div>
_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://gpfsug.org" rel="noreferrer" target="_blank">gpfsug.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</a><br>
</blockquote></div>
<span>_______________________________________________</span><br><span>gpfsug-discuss mailing list</span><br><span>gpfsug-discuss at gpfsug.org</span><br><span>http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org</span><br></div></blockquote></body></html>