<html><body><p>Please open a PMR for the not working "recall to resident". Some investigation is needed here. Thanks.<br><br><br>Greetings, Dominic.<br><br><br><img width="16" height="16" src="cid:1__=4EBB0ABBDF8DE3818f9e8a93df938690918c4EB@" border="0" alt="Inactive hide details for gpfsug-discuss-request---07.09.2016 23:23:51---Send gpfsug-discuss mailing list submissions to gpfsu"><font color="#424282">gpfsug-discuss-request---07.09.2016 23:23:51---Send gpfsug-discuss mailing list submissions to gpfsug-discuss@spectrumscale.org</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">gpfsug-discuss-request@spectrumscale.org</font><br><font size="2" color="#5F5F5F">To: </font><font size="2">gpfsug-discuss@spectrumscale.org</font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">07.09.2016 23:23</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">gpfsug-discuss Digest, Vol 56, Issue 14</font><br><font size="2" color="#5F5F5F">Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><tt>Send gpfsug-discuss mailing list submissions to<br> gpfsug-discuss@spectrumscale.org<br><br>To subscribe or unsubscribe via the World Wide Web, visit<br> </tt><tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br>or, via email, send a message with subject or body 'help' to<br> gpfsug-discuss-request@spectrumscale.org<br><br>You can reach the person managing the list at<br> gpfsug-discuss-owner@spectrumscale.org<br><br>When replying, please edit your Subject line so it is more specific<br>than "Re: Contents of gpfsug-discuss digest..."<br>Today's Topics:<br><br> 1. Re: Remote cluster mount failing (Yuri L Volobuev)<br> 2. Weirdness with 'mmces address add' (Valdis Kletnieks)<br> 3. Re: DMAPI - Unmigrate file to Regular state (Lukas Hejtmanek)<br> 4. Weirdness with 'mmces address add' (Michael L Taylor)<br> 5. Re: Weirdness with 'mmces address add' (Valdis.Kletnieks@vt.edu)<br></tt><font color="#800080"><br>----- Message from "Yuri L Volobuev" <volobuev@us.ibm.com> on Wed, 7 Sep 2016 09:58:07 -0700 -----</font><table border="0" cellspacing="0" cellpadding="0"><tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">To:</font></b></div></td><td width="391" valign="middle"><font size="4">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font></td></tr>
<tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">Subject:</font></b></div></td><td width="391" valign="middle"><font size="4">Re: [gpfsug-discuss] Remote cluster mount failing</font></td></tr></table><font size="4">It's unclear what's wrong. I'd have two main suspects: (1) TLS protocol version confusion, due to a difference in GSKit version and/or configuration (e.g. NIST SP800 compliance) on two sides (2) firewall. TLS issues are usually messy and tedious to work though. I'd recommend opening a PMR to facilitate debug data collection and analysis. A lot of gory detail may be needed to figure out what's going on.<br><br>yuri<br><br></font><img src="cid:1__=4EBB0ABBDF8DE3818f9e8a93df938690918c4EB@" width="16" height="16" alt="Inactive hide details for "Simon Thompson (Research Computing - IT Services)" ---09/07/2016 05:37:11 AM---Hi All, I'm trying to"><font size="4" color="#424282">"Simon Thompson (Research Computing - IT Services)" ---09/07/2016 05:37:11 AM---Hi All, I'm trying to get some multi cluster thing working between two of our GPFS</font><font size="4"><br></font><font color="#5F5F5F"><br>From: </font>"Simon Thompson (Research Computing - IT Services)" <S.J.Thompson@bham.ac.uk><font color="#5F5F5F"><br>To: </font>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org>, <font color="#5F5F5F"><br>Date: </font>09/07/2016 05:37 AM<font color="#5F5F5F"><br>Subject: </font>[gpfsug-discuss] Remote cluster mount failing<font color="#5F5F5F"><br>Sent by: </font>gpfsug-discuss-bounces@spectrumscale.org<font size="4"><br></font><hr width="100%" size="2" align="left" noshade><font size="4"><br><br></font><tt><font size="4"><br>Hi All,<br><br>I'm trying to get some multi cluster thing working between two of our GPFS<br>clusters.<br><br>In the "client" cluster, when trying to mount the "remote" cluster, I get:<br><br># mmmount gpfs<br>Wed 7 Sep 13:33:06 BST 2016: mmmount: Mounting file systems ...<br>mount: mount /dev/gpfs on /gpfs failed: Connection timed out<br>mmmount: Command failed. Examine previous error messages to determine<br>cause.<br><br><br>And in the log file:<br>Wed Sep 7 13:33:07.481 2016: [N] The client side TLS handshake with node<br>10.0.0.182 was cancelled: connection reset by peer (return code 420).<br>Wed Sep 7 13:33:07.486 2016: [N] The client side TLS handshake with node<br>10.0.0.181 was cancelled: connection reset by peer (return code 420).<br>Wed Sep 7 13:33:07.487 2016: [E] Failed to join remote cluster<br>GPFS_STORAGE.CLUSTER<br>Wed Sep 7 13:33:07.488 2016: [W] Command: err 78: mount<br>GPFS_STORAGE.CLUSTER:gpfs<br>Wed Sep 7 13:33:07.489 2016: Connection timed out<br><br>In the remote cluster, I see:<br><br>Wed Sep 7 13:33:07.487 2016: [W] The TLS handshake with node 10.0.0.222<br>failed with error 447 (server side).<br>Wed Sep 7 13:33:07.488 2016: [X] Connection from 10.10.0.35 <c0p174><br>refused, authentication failed<br>Wed Sep 7 13:33:07.489 2016: [E] Killing connection from 10.10.0.35, err<br>703<br>Wed Sep 7 13:33:07.490 2016: Operation not permitted<br><br><br><br>Weirdly though on other nodes in the client cluster this succeeds fine and<br>can mount, so I think I got all the bits in the mmauth and mmremotecluster<br>configured correctly.<br><br>Any suggestions?<br><br>Thanks<br><br>Simon<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</font></tt><tt><u><font size="4" color="#0000FF"><br></font></u></tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><u><font size="4" color="#0000FF">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></u></tt></a><tt><font size="4"><br></font></tt><font size="4"><br><br></font><font color="#800080"><br>----- Message from Valdis Kletnieks <Valdis.Kletnieks@vt.edu> on Wed, 07 Sep 2016 14:45:43 -0400 -----</font><table border="0" cellspacing="0" cellpadding="0"><tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">To:</font></b></div></td><td width="326" valign="middle"><font size="4">gpfsug-discuss@spectrumscale.org</font></td></tr>
<tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">Subject:</font></b></div></td><td width="326" valign="middle"><font size="4">[gpfsug-discuss] Weirdness with 'mmces address add'</font></td></tr></table><tt>We're in the middle of deploying Spectrum Archive, and I've hit a<br>snag. We assigned some floating IP addresses, which now need to<br>be changed. So I look at the mmces manpage, and it looks like I need<br>to add the new addresses, and delete the old ones.<br><br>We're on GPFS 4.2.1.0, if that matters...<br><br>What 'man mmces' says:<br><br>1. To add an address to a specified node, issue this command:<br><br> mmces address add --ces-node node1 --ces-ip 10.1.2.3<br><br>(and at least 6 or 8 more uses of an IP address).<br><br>What happens when I try it: (And yes, we have an 'isb' ces-group defined with<br>addresses in it already)<br><br># mmces address add --ces-group isb --ces-ip 172.28.45.72<br>Cannot resolve 172.28.45.72; Name or service not known<br>mmces address add: Incorrect value for --ces-ip option<br>Usage:<br> mmces address add [--ces-node Node] [--attribute Attribute] [--ces-group Group]<br> {--ces-ip {IP[,IP...]}<br><br>Am I missing some special sauce? (My first guess is that it's complaining<br>because there's no PTR in the DNS for that address yet - but if it was going<br>to do DNS lookups, it should be valid to give a hostname rather than an IP<br>address (and nowhere in the manpage does it even *hint* that --ces-ip can<br>be anything other than a list of IP addresses).<br><br>Or is it time for me to file a PMR?<br><br><br></tt><font color="#800080"><br>----- Message from Lukas Hejtmanek <xhejtman@ics.muni.cz> on Wed, 7 Sep 2016 22:11:11 +0200 -----</font><table border="0" cellspacing="0" cellpadding="0"><tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">To:</font></b></div></td><td width="391" valign="middle"><font size="4">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font></td></tr>
<tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">Subject:</font></b></div></td><td width="391" valign="middle"><font size="4">Re: [gpfsug-discuss] DMAPI - Unmigrate file to Regular state</font></td></tr></table><tt>On Tue, Sep 06, 2016 at 02:04:36PM +0200, Dominic Mueller-Wicke01 wrote:<br>> Hi Miroslav,<br>> <br>> please use the command: > dsmrecall -resident -detail <file name><br>> or use it with file lists<br><br>well, it looks like <br><br> Client Version 7, Release 1, Level 4.4<br><br>leaks file descriptors:<br><br>09/07/2016 21:03:07 ANS1587W Unable to read extended attributes for object<br>/exports/tape_tape/VO_metacentrum/home/jfeit/atlases/atlases/novo3/atlases/images/.svn/prop-base<br>due to errno: 24, reason: Too many open files<br><br>after about 15 minutes of run, I can see 88 opened files in /proc/$PID/fd<br><br>when using:<br>dsmrecall -R -RESid -D /path/*<br><br>is it something known fixed in newer versions?<br><br>-- <br>Lukáš Hejtmánek<br><br></tt><font color="#800080"><br>----- Message from "Michael L Taylor" <taylorm@us.ibm.com> on Wed, 7 Sep 2016 13:40:13 -0700 -----</font><table border="0" cellspacing="0" cellpadding="0"><tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">To:</font></b></div></td><td width="326" valign="middle"><font size="4">gpfsug-discuss@spectrumscale.org</font></td></tr>
<tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">Subject:</font></b></div></td><td width="326" valign="middle"><font size="4">[gpfsug-discuss] Weirdness with 'mmces address add'</font></td></tr></table><font size="4">Can't be for certain this is what you're hitting but reverse DNS lookup is documented the KC:<br></font><u><font size="4" color="#0000FF"><br></font></u><a href="http://www.ibm.com/support/knowledgecenter/STXKQY_4.2.1/com.ibm.spectrum.scale.v4r21.doc/bl1ins_protocolnodeipfurtherconfig.htm"><u><font size="4" color="#0000FF">http://www.ibm.com/support/knowledgecenter/STXKQY_4.2.1/com.ibm.spectrum.scale.v4r21.doc/bl1ins_protocolnodeipfurtherconfig.htm</font></u></a><font size="4"><br>Note: </font><font size="5">All CES IPs must have an associated hostname and reverse DNS lookup must be configured for each. For more information, see </font><i><font size="5">Adding export IPs</font></i><font size="5"> in </font><a href="http://www.ibm.com/support/knowledgecenter/en/STXKQY_4.2.1/com.ibm.spectrum.scale.v4r21.doc/bl1ins_deployingprotocolstasks.htm?view=kc"><u><font size="5" color="#0000FF">Deploying protocols</font></u></a><font size="5">. </font><font size="4"><br></font><u><font size="4" color="#0000FF"><br></font></u><a href="http://www.ibm.com/support/knowledgecenter/STXKQY_4.2.1/com.ibm.spectrum.scale.v4r21.doc/bl1ins_deployingprotocolstasks.htm"><u><font size="4" color="#0000FF">http://www.ibm.com/support/knowledgecenter/STXKQY_4.2.1/com.ibm.spectrum.scale.v4r21.doc/bl1ins_deployingprotocolstasks.htm</font></u></a><font size="5"><br>Note: Export IPs must have an associated hostname and reverse DNS lookup must be configured for each. </font><font size="4"><br><br>Can you make sure the IPs have reverse DNS lookup and try again?<br>Will get the mmces man page updated for address add <br><br></font><font color="#800080"><br>----- Message from Valdis.Kletnieks@vt.edu on Wed, 07 Sep 2016 17:23:30 -0400 -----</font><table border="0" cellspacing="0" cellpadding="0"><tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">To:</font></b></div></td><td width="391" valign="middle"><font size="4">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font></td></tr>
<tr valign="top"><td width="55" valign="middle"><div align="right"><b><font size="4">Subject:</font></b></div></td><td width="391" valign="middle"><font size="4">Re: [gpfsug-discuss] Weirdness with 'mmces address add'</font></td></tr></table><tt>On Wed, 07 Sep 2016 13:40:13 -0700, "Michael L Taylor" said:<br><br>> Can't be for certain this is what you're hitting but reverse DNS lookup is<br>> documented the KC:<br><br>> Note: All CES IPs must have an associated hostname and reverse DNS lookup<br>> must be configured for each. For more information, see Adding export IPs in<br>> Deploying protocols.<br><br>Bingo. That was it. Since the DNS will take a while to fix, I fed<br>the appropriate entries to /etc/hosts and it worked fine.<br><br>I got thrown for a loop because if there is enough code to do that checking,<br>it should be able to accept a hostname as well (RFE time? :)<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></tt><tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br></tt><br><br><BR>
</body></html>