[gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) (IBM Spectrum Scale)
Brunet Pierre-Marie
pierre-marie.brunet at cnes.fr
Fri Jul 27 14:56:04 BST 2018
Hi Scale Team,
I know but I can't reproduce the problem with a simple kernel NFS server on a RH7.5 with a local filesystem for instance.
It seems to be linked somehow with GPFS 4.2.3-9... I don't know what is the behavior with previous release.
But as I said, the downgrade to RHE7.4 has solved the problem... vicious bug for sure.
Regards,
PM
--
HPC center
French space agency
-----Message d'origine-----
De : gpfsug-discuss-bounces at spectrumscale.org <gpfsug-discuss-bounces at spectrumscale.org> De la part de gpfsug-discuss-request at spectrumscale.org
Envoyé : vendredi 27 juillet 2018 14:22
À : gpfsug-discuss at spectrumscale.org
Objet : gpfsug-discuss Digest, Vol 78, Issue 68
Send gpfsug-discuss mailing list submissions to
gpfsug-discuss at spectrumscale.org
To subscribe or unsubscribe via the World Wide Web, visit
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
or, via email, send a message with subject or body 'help' to
gpfsug-discuss-request at spectrumscale.org
You can reach the person managing the list at
gpfsug-discuss-owner at spectrumscale.org
When replying, please edit your Subject line so it is more specific than "Re: Contents of gpfsug-discuss digest..."
Today's Topics:
1. Re: GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) (IBM Spectrum Scale)
2. Re: GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil) (Lukas Hejtmanek)
----------------------------------------------------------------------
Message: 1
Date: Fri, 27 Jul 2018 06:56:02 -0500
From: "IBM Spectrum Scale" <scale at us.ibm.com>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil)
Message-ID:
<OF5FF984EE.F4BE79C7-ON852582D7.004142CC-862582D7.00418E3C at notes.na.collabserv.com>
Content-Type: text/plain; charset="iso-8859-1"
errno 521 is EBADHANDLE (a Linux NFS error); it is not from spectrum scale.
/* Defined for the NFSv3 protocol */
#define EBADHANDLE 521 /* Illegal NFS file handle */
Regards, The Spectrum Scale (GPFS) team
------------------------------------------------------------------------------------------------------------------
If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479.
If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact
1-800-237-5511 in the United States or your local IBM Service Center in other countries.
The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team.
From: Brunet Pierre-Marie <pierre-marie.brunet at cnes.fr>
To: "gpfsug-discuss at spectrumscale.org"
<gpfsug-discuss at spectrumscale.org>
Date: 07/26/2018 07:17 PM
Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil)
Sent by: gpfsug-discuss-bounces at spectrumscale.org
Hi,
We are facing the same issue : we just upgrade our cluster to GPFS 4.2.3-9 and RHEL 7.5 with 4 gateways servers executing Kernel NFS...
=> random "Unknown error 521" on NFS clients.
Thanks to this thread we decided to downgrade to RHEL 7.4 and (fingers crossed !) up to now, it seems to work properly.
Is there any official recommendation from IBM on this problem ?
Regards,
PM
--
HPC center
French space agency
-----Message d'origine-----
De?: gpfsug-discuss-bounces at spectrumscale.org
<gpfsug-discuss-bounces at spectrumscale.org> De la part de gpfsug-discuss-request at spectrumscale.org
Envoy??: jeudi 14 juin 2018 13:00
??: gpfsug-discuss at spectrumscale.org
Objet?: gpfsug-discuss Digest, Vol 77, Issue 19
Send gpfsug-discuss mailing list submissions to
gpfsug-discuss at spectrumscale.org
To subscribe or unsubscribe via the World Wide Web, visit
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
or, via email, send a message with subject or body 'help' to
gpfsug-discuss-request at spectrumscale.org
You can reach the person managing the list at
gpfsug-discuss-owner at spectrumscale.org
When replying, please edit your Subject line so it is more specific than
"Re: Contents of gpfsug-discuss digest..."
Today's Topics:
1. Re: GPFS 4.2.3-9 and RHEL 7.5 (Tomer Perry)
2. Re: GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil)
----------------------------------------------------------------------
Message: 1
Date: Wed, 13 Jun 2018 17:45:44 +0300
From: "Tomer Perry" <TOMP at il.ibm.com>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5
Message-ID:
<OF826A0F69.C86BD2AB-ONC22582AB.0050FE8E-C22582AB.00511712 at notes.na.collabserv.com>
Content-Type: text/plain; charset="iso-8859-1"
Please open a service ticket
Regards,
Tomer Perry
Scalable I/O Development (Spectrum Scale)
email: tomp at il.ibm.com
1 Azrieli Center, Tel Aviv 67021, Israel
Global Tel: +1 720 3422758
Israel Tel: +972 3 9188625
Mobile: +972 52 2554625
From: Lukas Hejtmanek <xhejtman at ics.muni.cz>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date: 13/06/2018 13:14
Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5
Sent by: gpfsug-discuss-bounces at spectrumscale.org
On Wed, Jun 13, 2018 at 12:48:14PM +0300, Tomer Perry wrote:
> knfs is supported - with or without the cNFS feature ( cNFS will add
> HA
> to NFS on top of GPFS -
>
https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.1/com.ibm.spectrum.scale.v5r01.doc/bl1adv_cnfs.htm
> ).
>
> knfs and cNFS can't coexist with CES in the same environment.
well, I use knfs and no CNFS n RHEL 7.5 and getting mentioned issues.
--
Luk?? Hejtm?nek
Linux Administrator only because
Full Time Multitasking Ninja
is not an official job title
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <
http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180613/3cf6fbce/attachment-0001.html
>
------------------------------
Message: 2
Date: Wed, 13 Jun 2018 15:14:53 +0000
From: "Wilson, Neil" <neil.wilson at metoffice.gov.uk>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5
Message-ID:
<VI1PR01MB3869195DA7652219D5E3C6FDC67E0 at VI1PR01MB3869.eurprd01.prod.exchangelabs.com>
Content-Type: text/plain; charset="utf-8"
We are running a cNFS on GPFS 4.2.3-9 on 7.4 and kernel version
3.10.0-693.21.1.el7.x86_64 and are not having any errors.
So it's probably just GPFS not being ready for 7.5 yet.
Neil.
Neil Wilson? Senior IT Practitioner
Storage, Virtualisation and Mainframe Team?? IT Services Met Office FitzRoy Road Exeter Devon EX1 3PB United Kingdom
-----Original Message-----
From: gpfsug-discuss-bounces at spectrumscale.org
<gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of Jonathan Buzzard
Sent: 13 June 2018 10:33
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5
On Wed, 2018-06-13 at 11:10 +0200, Lukas Hejtmanek wrote:
> Hello,
>
> did anyone encountered an error with RHEL 7.5 kernel 3.10.0-
> 862.3.2.el7.x86_64 and the latest GPFS 4.2.3-9 with kernel NFS?
>
> I'm getting random errors: Unknown error 521. It means EBADHANDLE.
> Not sure whether it is due to kernel or GPFS.
>
GPFS being not supported on 7.5 at this time would be the starting point. I am also under the impression that kernel NFS was not supported either it's Ganesha or nothing.
The interim fix is probably to downgrade to a 7.4 kernel. Certainly in the past that has worked for me.
JAB.
--
Jonathan A. Buzzard?????????????????????????Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt.
University of Strathclyde, John Anderson Building, Glasgow. G4 0NG
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
------------------------------
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
End of gpfsug-discuss Digest, Vol 77, Issue 19
**********************************************
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180727/09b0c32c/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180727/09b0c32c/attachment-0001.gif>
------------------------------
Message: 2
Date: Fri, 27 Jul 2018 14:06:11 +0200
From: Lukas Hejtmanek <xhejtman at ics.muni.cz>
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil)
Message-ID: <20180727120611.aunjlxht33vp7txf at ics.muni.cz>
Content-Type: text/plain; charset=utf8
Hello,
no it is not. It's a bug in GPFS vfs layer, efix has been already released.
On Fri, Jul 27, 2018 at 06:56:02AM -0500, IBM Spectrum Scale wrote:
>
> errno 521 is EBADHANDLE (a Linux NFS error); it is not from spectrum scale.
>
>
> /* Defined for the NFSv3 protocol */
> #define EBADHANDLE 521 /* Illegal NFS file handle */
>
>
> Regards, The Spectrum Scale (GPFS) team
>
> ----------------------------------------------------------------------
> --------------------------------------------
>
> If you feel that your question can benefit other users of Spectrum
> Scale (GPFS), then please post it to the public IBM developerWroks
> Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479.
>
>
> If your query concerns a potential software error in Spectrum Scale
> (GPFS) and you have an IBM software maintenance contract please
> contact
> 1-800-237-5511 in the United States or your local IBM Service Center
> in other countries.
>
> The forum is informally monitored as time permits and should not be
> used for priority messages to the Spectrum Scale (GPFS) team.
>
>
>
> From: Brunet Pierre-Marie <pierre-marie.brunet at cnes.fr>
> To: "gpfsug-discuss at spectrumscale.org"
> <gpfsug-discuss at spectrumscale.org>
> Date: 07/26/2018 07:17 PM
> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil)
> Sent by: gpfsug-discuss-bounces at spectrumscale.org
>
>
>
> Hi,
>
> We are facing the same issue : we just upgrade our cluster to GPFS
> 4.2.3-9 and RHEL 7.5 with 4 gateways servers executing Kernel NFS...
> => random "Unknown error 521" on NFS clients.
>
> Thanks to this thread we decided to downgrade to RHEL 7.4 and (fingers
> crossed !) up to now, it seems to work properly.
>
> Is there any official recommendation from IBM on this problem ?
>
> Regards,
> PM
> --
> HPC center
> French space agency
>
> -----Message d'origine-----
> De?: gpfsug-discuss-bounces at spectrumscale.org
> <gpfsug-discuss-bounces at spectrumscale.org> De la part de
> gpfsug-discuss-request at spectrumscale.org
> Envoy??: jeudi 14 juin 2018 13:00
> ??: gpfsug-discuss at spectrumscale.org
> Objet?: gpfsug-discuss Digest, Vol 77, Issue 19
>
> Send gpfsug-discuss mailing list submissions to
> gpfsug-discuss at spectrumscale.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
> or, via email, send a message with subject or body 'help' to
> gpfsug-discuss-request at spectrumscale.org
>
> You can reach the person managing the list at
> gpfsug-discuss-owner at spectrumscale.org
>
> When replying, please edit your Subject line so it is more specific
> than
> "Re: Contents of gpfsug-discuss digest..."
>
>
> Today's Topics:
>
> 1. Re: GPFS 4.2.3-9 and RHEL 7.5 (Tomer Perry)
> 2. Re: GPFS 4.2.3-9 and RHEL 7.5 (Wilson, Neil)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Wed, 13 Jun 2018 17:45:44 +0300
> From: "Tomer Perry" <TOMP at il.ibm.com>
> To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5
> Message-ID:
>
> <OF826A0F69.C86BD2AB-ONC22582AB.0050FE8E-C22582AB.00511712 at notes.na.co
> llabserv.com>
>
>
> Content-Type: text/plain; charset="iso-8859-1"
>
> Please open a service ticket
>
>
> Regards,
>
> Tomer Perry
> Scalable I/O Development (Spectrum Scale)
> email: tomp at il.ibm.com
> 1 Azrieli Center, Tel Aviv 67021, Israel
> Global Tel: +1 720 3422758
> Israel Tel: +972 3 9188625
> Mobile: +972 52 2554625
>
>
>
>
> From: Lukas Hejtmanek <xhejtman at ics.muni.cz>
> To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
> Date: 13/06/2018 13:14
> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5
> Sent by: gpfsug-discuss-bounces at spectrumscale.org
>
>
>
> On Wed, Jun 13, 2018 at 12:48:14PM +0300, Tomer Perry wrote:
> > knfs is supported - with or without the cNFS feature ( cNFS will
> > add HA
>
> > to NFS on top of GPFS -
> >
> https://www.ibm.com/support/knowledgecenter/en/STXKQY_5.0.1/com.ibm.sp
> ectrum.scale.v5r01.doc/bl1adv_cnfs.htm
>
>
> > ).
> >
> > knfs and cNFS can't coexist with CES in the same environment.
>
> well, I use knfs and no CNFS n RHEL 7.5 and getting mentioned issues.
>
> --
> Luk?? Hejtm?nek
>
> Linux Administrator only because
> Full Time Multitasking Ninja
> is not an official job title
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
>
>
>
>
>
>
> -------------- next part -------------- An HTML attachment was
> scrubbed...
> URL: <
> http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20180613/3cf6fb
> ce/attachment-0001.html
> >
>
> ------------------------------
>
> Message: 2
> Date: Wed, 13 Jun 2018 15:14:53 +0000
> From: "Wilson, Neil" <neil.wilson at metoffice.gov.uk>
> To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5
> Message-ID:
>
> <VI1PR01MB3869195DA7652219D5E3C6FDC67E0 at VI1PR01MB3869.eurprd01.prod.ex
> changelabs.com>
>
>
> Content-Type: text/plain; charset="utf-8"
>
> We are running a cNFS on GPFS 4.2.3-9 on 7.4 and kernel version
> 3.10.0-693.21.1.el7.x86_64 and are not having any errors.
> So it's probably just GPFS not being ready for 7.5 yet.
>
> Neil.
>
> Neil Wilson? Senior IT Practitioner
> Storage, Virtualisation and Mainframe Team?? IT Services Met Office
> FitzRoy Road Exeter Devon EX1 3PB United Kingdom
>
>
> -----Original Message-----
> From: gpfsug-discuss-bounces at spectrumscale.org
> <gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of Jonathan
> Buzzard
> Sent: 13 June 2018 10:33
> To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
> Subject: Re: [gpfsug-discuss] GPFS 4.2.3-9 and RHEL 7.5
>
> On Wed, 2018-06-13 at 11:10 +0200, Lukas Hejtmanek wrote:
> > Hello,
> >
> > did anyone encountered an error with RHEL 7.5 kernel 3.10.0-
> > 862.3.2.el7.x86_64 and the latest GPFS 4.2.3-9 with kernel NFS?
> >
> > I'm getting random errors: Unknown error 521. It means EBADHANDLE.
> > Not sure whether it is due to kernel or GPFS.
> >
>
> GPFS being not supported on 7.5 at this time would be the starting
> point. I am also under the impression that kernel NFS was not
> supported either it's Ganesha or nothing.
>
> The interim fix is probably to downgrade to a 7.4 kernel. Certainly in
> the past that has worked for me.
>
> JAB.
>
> --
> Jonathan A. Buzzard?????????????????????????Tel: +44141-5483420 HPC
> System Administrator, ARCHIE-WeSt.
> University of Strathclyde, John Anderson Building, Glasgow. G4 0NG
>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
>
> ------------------------------
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
>
>
> End of gpfsug-discuss Digest, Vol 77, Issue 19
> **********************************************
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
>
>
>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
--
Luk?? Hejtm?nek
Linux Administrator only because
Full Time Multitasking Ninja
is not an official job title
------------------------------
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
End of gpfsug-discuss Digest, Vol 78, Issue 68
**********************************************
More information about the gpfsug-discuss
mailing list