[gpfsug-discuss] Node expulsion from GPFS Cluster

Jez Tucker Jez.Tucker at rushes.co.uk
Wed Jan 16 19:58:20 GMT 2013

I have something amazingly similar with

My node is on a remote subnet a couple of switches away past a router. Again, ping etc. is all good, no tx/rx errors but node is expelled by local subnet nodes.
Some nodes more common than the others. Do you also find that to be the case?

I think it could well be worth checking future GPFS version changelogs.


From: Barry Evans [mailto:bevans at canditmedia.co.uk]
Sent: Wednesday, January 16, 2013 04:09 PM
To: gpfsug main discussion list <gpfsug-discuss at gpfsug.org>
Subject: Re: [gpfsug-discuss] Node expulsion from GPFS Cluster

Hi Linda,

A couple of questions -

* How many clusters in total?
* How many subnets in total and if more than 2 are they all fully routable to each other?
* Do you run any firewall on the server or clients that would be blocking 1191 from/to anywhere?


On 16 Jan 2013, at 16:00, Linda Dewar <linda at epcc.ed.ac.uk<mailto:linda at epcc.ed.ac.uk>> wrote:


Just wondering if anyone else has seen anything like this.

I am using GPFS

I have a multicluster setup with NSD servers and TSM servers (running RHEL 6.2) in a Server cluster and clients (some running SUSE 11 SP1 and some running RHEL 6.2) in a Client cluster.

All clients in both clusters are connected to a IBM BNT G8200 switch

Nodes in the Client cluster are regularly expelled from the cluster, either  at the request of other nodes in the Client cluster, or nodes in the Server cluster. This means that GPFS is shut down on the expelled node and filesystems unmounted . Obviously inconvenient to the users.

Basic connectivity (ie response to ping) between nodes is unaffected at the times of the node expulsions. We are looking at using Wireshark to investigate what appears to be some sort of network connectivity problem.

Does any of this sound familiar to anyone else, and does anyone have any suggestions as to what we should be looking for?

Many thanks,


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

gpfsug-discuss mailing list
gpfsug-discuss at gpfsug.org<mailto:gpfsug-discuss at gpfsug.org>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20130116/1bfd6f86/attachment-0003.htm>

More information about the gpfsug-discuss mailing list