<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div>Until IBM provides a solution, here is my workaround. Add it so it runs before the gpfs script, I call it from our custom xcat diskless boot scripts. Based on rhel7, not fully systemd integrated. YMMV!</div><div><br></div><div>Regards, </div><div> — ddj</div><div>——-</div><div>[ddj@storage041 ~]$ cat /etc/init.d/ibready </div><div>#! /bin/bash</div><div>#</div><div># chkconfig: 2345 06 94</div><div># /etc/rc.d/init.d/ibready</div><div># written in 2016 David D Johnson (ddj <at> <a href="http://brown.edu">brown.edu</a>)</div><div>#</div><div>### BEGIN INIT INFO</div><div># Provides: ibready</div><div># Required-Start:</div><div># Required-Stop:</div><div># Default-Stop:</div><div># Description: Block until infiniband is ready</div><div># Short-Description: Block until infiniband is ready</div><div>### END INIT INFO</div><div><br></div><div>RETVAL=0</div><div>if [[ -d /sys/class/infiniband ]] </div><div>then</div><div> IBDEVICE=$(dirname $(grep -il infiniband /sys/class/infiniband/*/ports/1/link* | head -n 1))</div><div>fi</div><div># See how we were called.</div><div>case "$1" in</div><div> start)</div><div> if [[ -n $IBDEVICE && -f $IBDEVICE/state ]]</div><div> then</div><div> echo -n "Polling for InfiniBand link up: "</div><div> for (( count = 60; count > 0; count-- ))</div><div> do</div><div> if grep -q ACTIVE $IBDEVICE/state</div><div> then</div><div> echo ACTIVE</div><div> break</div><div> fi</div><div> echo -n "."</div><div> sleep 5</div><div> done</div><div> if (( count <= 0 ))</div><div> then</div><div> echo DOWN - $0 timed out</div><div> fi</div><div> fi</div><div> ;;</div><div> stop|restart|reload|force-reload|condrestart|try-restart)</div><div> ;;</div><div> status)</div><div> if [[ -n $IBDEVICE && -f $IBDEVICE/state ]]</div><div> then</div><div> echo "$IBDEVICE is $(< $IBDEVICE/state) $(< $IBDEVICE/rate)"</div><div> else</div><div> echo "No IBDEVICE found"</div><div> fi</div><div> ;;</div><div> *)</div><div> echo "Usage: ibready {start|stop|status|restart|reload|force-reload|condrestart|try-restart}"</div><div> exit 2</div><div>esac</div><div>exit ${RETVAL}</div><div>————</div><br><div id="AppleMailSignature"> -- ddj<div>Dave Johnson</div></div><div><br>On Mar 8, 2018, at 6:10 AM, Caubet Serrabou Marc (PSI) <<a href="mailto:marc.caubet@psi.ch">marc.caubet@psi.ch</a>> wrote:<br><br></div><blockquote type="cite"><div>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">Hi all,<br>
<div><br>
with autoload = yes we do not ensure that GPFS will be started after the IB link becomes up. Is there a way to force GPFS waiting to start until IB ports are up? This can be probably done by adding something like After=network-online.target and Wants=network-online.target
in the systemd file but I would like to know if this is natively possible from the GPFS configuration.<br>
<br>
Thanks a lot,<br>
Marc <br>
<div class="BodyFragment"><font size="2"><span style="font-size:10pt;">
<div class="PlainText">_________________________________________<br>
Paul Scherrer Institut <br>
High Performance Computing<br>
Marc Caubet Serrabou<br>
WHGA/036<br>
5232 Villigen PSI<br>
Switzerland<br>
<br>
Telephone: +41 56 310 46 67<br>
E-Mail: <a href="mailto:marc.caubet@psi.ch">marc.caubet@psi.ch</a></div>
</span></font></div>
</div>
</div>
</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>gpfsug-discuss mailing list</span><br><span>gpfsug-discuss at <a href="http://spectrumscale.org">spectrumscale.org</a></span><br><span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></span><br></div></blockquote></body></html>