From cabrillo at ifca.unican.es Thu Sep 2 07:47:12 2021 From: cabrillo at ifca.unican.es (Iban Cabrillo) Date: Thu, 2 Sep 2021 08:47:12 +0200 (CEST) Subject: [gpfsug-discuss] gpfsgui java cannot start Message-ID: <1675029176.1332615.1630565232533.JavaMail.zimbra@ifca.unican.es> Hi Guys, After a copuple of weeks working, i can not start gpfsgui after upgrade to 5.1.1 I get this java error at logs: ......... Sep 2 08:38:47 gpfsgui java: [AUDIT ] CWWKG0028A: Processing included configuration resource: /opt/ibm/wlp/usr/servers/gpfsgui/httpsKeystore.xml Sep 2 08:38:53 gpfsgui java: WARNING: An illegal reflective access operation has occurred Sep 2 08:38:53 gpfsgui java: WARNING: Illegal reflective access by org.apache.aries.jndi.startup.Activator (file:/opt/ibm/wlp/lib/com.ibm.ws.org.apache.aries.jndi.core_1.1.44.jar) to field javax.naming.spi.NamingManager.initctx_factory_builder Sep 2 08:38:53 gpfsgui java: WARNING: Please consider reporting this to the maintainers of org.apache.aries.jndi.startup.Activator Sep 2 08:38:53 gpfsgui java: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations ........................ Sep 2 08:32:27 gpfsgui java: file: /var/lib/mmfs/gui/user.repo.json Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/ibm/api/explorer/ Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/api/explorer/ Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/api/docs/ Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/ibm/api/ Sep 2 08:32:33 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/ Sep 2 08:32:36 gpfsgui java: Loggers initialized Sep 2 08:32:58 gpfsgui java: [AUDIT ] CWWKZ0022W: Application / has not started in 30.001 seconds. Sep 2 08:33:03 gpfsgui java: [AUDIT ] CWWKF0012I: The server installed the following features: [apiDiscovery-1.0, appSecurity-2.0, distributedMap-1.0, federatedRegistry-1.0, jaxrs-1.1, jdbc-4.0, jndi-1.0, json-1.0, jsp-2.2, ldapRegistry-3.0, servlet-3.0, ssl-1.0, usr:FsccUserRepo]. Sep 2 08:33:03 gpfsgui java: [AUDIT ] CWWKF0011I: The gpfsgui server is ready to run a smarter planet. The gpfsgui server started in 46.086 seconds. Sep 2 08:33:30 gpfsgui java: Features: [GPFS, POSTGRES, GPFS_CLUSTER] Sep 2 08:33:30 gpfsgui java: Using the GSSApplicationManagerBehavior Sep 2 08:33:30 gpfsgui java: GPFS GUI Version:5.1.1-0 Sep 2 08:33:30 gpfsgui java: GPFS GUI Build Date: 20210401-1619 Sep 2 08:33:30 gpfsgui java: (Startup) 2021-09-02 08:33:30.705 Start Backend initialization. Sep 2 08:33:30 gpfsgui java: (Startup) 144ms Database initialized. Sep 2 08:35:09 gpfsgui java: Detected Platform GPFS with mmlsconfig, because the nsdRAIDTracks parameter is not set. Sep 2 08:35:09 gpfsgui java: Successfully detected platform GPFS. Sep 2 08:36:50 gpfsgui java: (Startup) 199452ms Database version checked. Sep 2 08:36:50 gpfsgui ccrChangedCallback.sh: GPFS CCR update event received: 'root ccrFileChange _gui.settings 320' Sep 2 08:37:16 gpfsgui systemd: gpfsgui.service start operation timed out. Terminating. Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKE0085I: The server gpfsgui is stopping because the JVM is exiting. Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKE1100I: Waiting for up to 30 seconds for the server to quiesce. Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/ibm/api/explorer/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/api/docs/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/ibm/api/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/api/explorer/ Sep 2 08:37:46 gpfsgui java: [WARNING ] CWWKE1102W: The quiesce operation did not complete. The server will now stop. Sep 2 08:37:46 gpfsgui java: [WARNING ] CWWKE1106W: 2 shutdown operations did not complete during the quiesce period. Sep 2 08:37:46 gpfsgui java: [WARNING ] CWWKE1107W: 4 threads did not complete during the quiesce period. Sep 2 08:38:10 gpfsgui java: PreferencesToJsonMigrator: The non cluster related entities are currently initialized by another GUI, will retry in 5000 milliseconds. Sep 2 08:38:10 gpfsgui java: Backend/CLI/REST started. Sep 2 08:38:10 gpfsgui java: Context initialized. ..... ..... Sep 2 08:40:00 gpfsgui mmfs: [N] Purged 9023 CCR request(s) due to err: 895 (Maximal number of requests in operation queue reached (Check for request jam)) since 2021-09-02_08:22:47.580+0200 Any advice will be welcomed. regards, I -------------- next part -------------- An HTML attachment was scrubbed... URL: From juergen.hannappel at desy.de Thu Sep 2 16:31:43 2021 From: juergen.hannappel at desy.de (Hannappel, Juergen) Date: Thu, 2 Sep 2021 17:31:43 +0200 (CEST) Subject: [gpfsug-discuss] Serial number of [EG]SS nodes Message-ID: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Hi, on an ESS node with power cpu I can get the serial number from /proc/device-tree/system-id which is very useful sometimes On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there is no such pseudo-file. Is there a simple way to get at the serial number? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 1711 bytes Desc: S/MIME Cryptographic Signature URL: From abeattie at au1.ibm.com Thu Sep 2 16:50:53 2021 From: abeattie at au1.ibm.com (Andrew Beattie) Date: Thu, 2 Sep 2021 15:50:53 +0000 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: I?m not sure for the Lenovo But the GUI hardware details tabs has MTM and serial information for all the ESS nodes. Regards Andrew > On 3 Sep 2021, at 01:39, Hannappel, Juergen wrote: > > ?Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From S.J.Thompson at bham.ac.uk Thu Sep 2 16:53:37 2021 From: S.J.Thompson at bham.ac.uk (Simon Thompson) Date: Thu, 2 Sep 2021 15:53:37 +0000 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: <0ADEDB80-E348-42D5-B9A2-DC4357EF2474@bham.ac.uk> Depends if it was filled in at install time, but mmlscomp might hold the data (on both ESS and DSS systems)? I guess that is where the GUI reads the data from also? Simon From: on behalf of "abeattie at au1.ibm.com" Reply to: "gpfsug-discuss at spectrumscale.org" Date: Thursday, 2 September 2021 at 16:51 To: "gpfsug-discuss at spectrumscale.org" Subject: Re: [gpfsug-discuss] Serial number of [EG]SS nodes I?m not sure for the Lenovo But the GUI hardware details tabs has MTM and serial information for all the ESS nodes. Regards Andrew > On 3 Sep 2021, at 01:39, Hannappel, Juergen wrote: > > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From sadaniel at us.ibm.com Thu Sep 2 17:07:06 2021 From: sadaniel at us.ibm.com (Steven Daniels) Date: Thu, 2 Sep 2021 10:07:06 -0600 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <0ADEDB80-E348-42D5-B9A2-DC4357EF2474@bham.ac.uk> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> <0ADEDB80-E348-42D5-B9A2-DC4357EF2474@bham.ac.uk> Message-ID: If xcat is on gss, then you can run nodels and use the node name for lsdef -t node To: "gpfsug main discussion list" Date: 09/02/2021 09:53 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] Serial number of [EG]SS nodes Sent by: gpfsug-discuss-bounces at spectrumscale.org Depends if it was filled in at install time, but mmlscomp might hold the data (on both ESS and DSS systems)? I guess that is where the GUI reads the data from also? Simon From: on behalf of "abeattie at au1.ibm.com" Reply to: "gpfsug-discuss at spectrumscale.org" Date: Thursday, 2 September 2021 at 16:51 To: "gpfsug-discuss at spectrumscale.org" Subject: Re: [gpfsug-discuss] Serial number of [EG]SS nodes I?m not sure for the Lenovo But the GUI hardware details tabs has MTM and serial information for all the ESS nodes. Regards Andrew > On 3 Sep 2021, at 01:39, Hannappel, Juergen wrote: > > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: opencits-d.jpg Type: image/jpeg Size: 182862 bytes Desc: not available URL: From UWEFALKE at de.ibm.com Thu Sep 2 17:14:56 2021 From: UWEFALKE at de.ibm.com (Uwe Falke) Date: Thu, 2 Sep 2021 18:14:56 +0200 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Hi, J?rgen, try the command dmidecode lists a bunch of information, somewhere should be the serial of the system. Mit freundlichen Gr??en / Kind regards Dr. Uwe Falke IT Specialist Hybrid Cloud Infrastructure / Technology Consulting & Implementation Services +49 175 575 2877 Mobile Rochlitzer Str. 19, 09111 Chemnitz, Germany uwefalke at de.ibm.com IBM Services IBM Data Privacy Statement IBM Deutschland Business & Technology Services GmbH Gesch?ftsf?hrung: Sven Schooss, Stefan Hierl Sitz der Gesellschaft: Ehningen Registergericht: Amtsgericht Stuttgart, HRB 17122 From: "Hannappel, Juergen" To: "gpfsug main discussion list" Date: 02/09/2021 17:40 Subject: [EXTERNAL] [gpfsug-discuss] Serial number of [EG]SS nodes Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, on an ESS node with power cpu I can get the serial number from /proc/device-tree/system-id which is very useful sometimes On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there is no such pseudo-file. Is there a simple way to get at the serial number? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 [attachment "smime.p7s" deleted by Uwe Falke/Germany/IBM] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss From spectrumscale at kiranghag.com Thu Sep 2 18:32:31 2021 From: spectrumscale at kiranghag.com (KG) Date: Thu, 2 Sep 2021 23:02:31 +0530 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: did you try "lshw -C system" On Thu, Sep 2, 2021 at 9:09 PM Hannappel, Juergen wrote: > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Achim.Rehor at de.ibm.com Thu Sep 2 19:38:04 2021 From: Achim.Rehor at de.ibm.com (Achim Rehor) Date: Thu, 2 Sep 2021 20:38:04 +0200 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Hi Juergen, topsummary does contain the serial number of th ESS3K Mit freundlichen Gr??en / Kind regards Achim Rehor Remote Technical Support Engineer Storage IBM Systems Storage Support - EMEA Storage Competence Center (ESCC) Spectrum Scale / Elastic Storage Server ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland Am Weiher 24 65451 Kelsterbach Phone: +49-170-4521194 E-Mail: Achim.Rehor at de.ibm.com ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Sebastian Krause Gesch?ftsf?hrung: Gregor Pillen (Vorsitzender), Agnes Heftberger, Norbert Janzen, Markus Koerner, Christian Noll, Nicole Reimer Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940 gpfsug-discuss-bounces at spectrumscale.org wrote on 02/09/2021 17:31:43: > From: "Hannappel, Juergen" > To: "gpfsug main discussion list" > Date: 02/09/2021 17:39 > Subject: [EXTERNAL] [gpfsug-discuss] Serial number of [EG]SS nodes > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > [attachment "smime.p7s" deleted by Achim Rehor/Germany/IBM] > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss From ewahl at osc.edu Thu Sep 2 20:18:12 2021 From: ewahl at osc.edu (Wahl, Edward) Date: Thu, 2 Sep 2021 19:18:12 +0000 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Does 'rinv |grep -i serial ' work on the x86? Ed Wahl OSC ________________________________ From: gpfsug-discuss-bounces at spectrumscale.org on behalf of Hannappel, Juergen Sent: Thursday, September 2, 2021 11:31 AM To: gpfsug main discussion list Subject: [gpfsug-discuss] Serial number of [EG]SS nodes Hi, on an ESS node with power cpu I can get the serial number from /proc/device-tree/system-id which is very useful sometimes On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there is no such pseudo-file. Is there a simple way to get at the serial number? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 -------------- next part -------------- An HTML attachment was scrubbed... URL: From jonathan.buzzard at strath.ac.uk Thu Sep 2 21:46:56 2021 From: jonathan.buzzard at strath.ac.uk (Jonathan Buzzard) Date: Thu, 2 Sep 2021 21:46:56 +0100 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: On 02/09/2021 17:14, Uwe Falke wrote: > > Hi, J?rgen, > > try the command > dmidecode > > lists a bunch of information, somewhere should be the serial of the > system. > You can cut the amount of information down by specifying the type of information you want, so usually dmidecode -t system will display the information with the serial number of the machine. This is my preferred choice as it is usually installed by default. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG From sannaik2 at in.ibm.com Wed Sep 8 04:31:52 2021 From: sannaik2 at in.ibm.com (Sandeep Naik1) Date: Wed, 8 Sep 2021 09:01:52 +0530 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Hi Jurgen, You can cut it even further :-) to get only serial number. dmidecode -s system-serial-number Thanks, Sandeep From: "Jonathan Buzzard" To: gpfsug-discuss at spectrumscale.org Date: 03/09/2021 02:17 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] Serial number of [EG]SS nodes Sent by: gpfsug-discuss-bounces at spectrumscale.org On 02/09/2021 17:14, Uwe Falke wrote: > > Hi, J?rgen, > > try the command > dmidecode > > lists a bunch of information, somewhere should be the serial of the > system. > You can cut the amount of information down by specifying the type of information you want, so usually dmidecode -t system will display the information with the serial number of the machine. This is my preferred choice as it is usually installed by default. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From jon at well.ox.ac.uk Mon Sep 20 10:58:02 2021 From: jon at well.ox.ac.uk (Jon Diprose) Date: Mon, 20 Sep 2021 09:58:02 +0000 Subject: [gpfsug-discuss] nfs krb5p performance Message-ID: Hello, We have just started using the nfs protocol with SECTYPE=krb5p and are a little surprised by the performance impact - looks like down to a third of that of SECTYPE=krb5. Would any of you using krb5p be kind enough to share your estimates of impact? Not sure if we have a misconfiguration of setup or expectation. Thanks, Jon -- Dr. Jonathan Diprose Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN From mzp at us.ibm.com Mon Sep 20 13:44:32 2021 From: mzp at us.ibm.com (Madhav Ponamgi1) Date: Mon, 20 Sep 2021 08:44:32 -0400 Subject: [gpfsug-discuss] gpfsug-discuss Digest, Vol 116, Issue 6 In-Reply-To: References: Message-ID: There are 3 flavors of NFS Kerberos (I'm only going to address NFS 4.x): Krb5 - encrypts authentication Krtbi - encrypts authentication and provides checksums (reducing man-in-the-middle attacks) Krb5p - End-to-end encryption with integrity checking The Krb5p protocol provides ultimate security but comes at a cost where all NFS packets will be encrypted (mount authenticated) and with checksums. This can add considerable overhead (for example, using AES-256 is similar to SMB3 signing and sealing). There are AES-NI off-loading engines to reduce this overhead. So it is not surprising to see significant performance drop when using Krb5p versus Krb5. --- Madhav Ponamgi mzp at us.ibm.com (215) 794-6987 http://www.ibm.biz/FOSDesignEngine https://fileobjectsolutiondesignstudio.ibm.com/ Tech Sales Website: w3.ibm.com/w3publisher/ww_storage_tech_sales From: gpfsug-discuss-request at spectrumscale.org To: gpfsug-discuss at spectrumscale.org Date: 09/20/2021 07:00 AM Subject: [EXTERNAL] gpfsug-discuss Digest, Vol 116, Issue 6 Sent by: gpfsug-discuss-bounces at spectrumscale.org Send gpfsug-discuss mailing list submissions to gpfsug-discuss at spectrumscale.org To subscribe or unsubscribe via the World Wide Web, visit http://gpfsug.org/mailman/listinfo/gpfsug-discuss or, via email, send a message with subject or body 'help' to gpfsug-discuss-request at spectrumscale.org You can reach the person managing the list at gpfsug-discuss-owner at spectrumscale.org When replying, please edit your Subject line so it is more specific than "Re: Contents of gpfsug-discuss digest..." Today's Topics: 1. nfs krb5p performance (Jon Diprose) ---------------------------------------------------------------------- Message: 1 Date: Mon, 20 Sep 2021 09:58:02 +0000 From: Jon Diprose To: "gpfsug-discuss at spectrumscale.org" Subject: [gpfsug-discuss] nfs krb5p performance Message-ID: Content-Type: text/plain; charset="us-ascii" Hello, We have just started using the nfs protocol with SECTYPE=krb5p and are a little surprised by the performance impact - looks like down to a third of that of SECTYPE=krb5. Would any of you using krb5p be kind enough to share your estimates of impact? Not sure if we have a misconfiguration of setup or expectation. Thanks, Jon -- Dr. Jonathan Diprose Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN ------------------------------ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss End of gpfsug-discuss Digest, Vol 116, Issue 6 ********************************************** -------------- next part -------------- An HTML attachment was scrubbed... URL: From jon at well.ox.ac.uk Mon Sep 20 14:40:17 2021 From: jon at well.ox.ac.uk (Jon Diprose) Date: Mon, 20 Sep 2021 13:40:17 +0000 Subject: [gpfsug-discuss] gpfsug-discuss Digest, Vol 116, Issue 6 In-Reply-To: References: , Message-ID: Thanks Madhav. I am aware of that, and find myself with a need for krb5p - and a disappointed user. I am hoping for some rough quantification of the expected impact of turning on end-to-ed encryption so I know whether what I get is all there is or whether I need to keep digging. I know that Spectrum Scale uses the AES-NI instructions (if available) for its own end-to-end encryption. I am less clear on whether AES-NI is used by ganesha for krb5p. Both ends have cpus that indicate support of AES-NI to the OS. I can, and with apologies for it being a pdf, point you at a paper on AES-NI performance: http://www.sce.carleton.ca/faculty/huang/iccae-2020.pdf which shows that their Intel i5-8250U test platform (which is probably disappointingly close in single-thread performance to my 6212U-based servers) will happily push around 900MB/s using AES-NI accelaration, but only around 110MB/s without. The higher number wouldn't be the bottleneck in my setup. The lower number is pretty close to what I am seeing. Unfortunately I can't tell whether AES-NI is actually being used, or find any options that might control its use. Do you have any numbers to indicate what throughput I might expect to get for krb5p, and what hit that might be over krb5? Or any suggestions for checking whether AES-NI is actually in use? Thanks, Jon -- Dr. Jonathan Diprose > Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN ________________________________ From: gpfsug-discuss-bounces at spectrumscale.org [gpfsug-discuss-bounces at spectrumscale.org] on behalf of Madhav Ponamgi1 [mzp at us.ibm.com] Sent: 20 September 2021 13:44 To: gpfsug-discuss at spectrumscale.org Subject: Re: [gpfsug-discuss] gpfsug-discuss Digest, Vol 116, Issue 6 There are 3 flavors of NFS Kerberos (I'm only going to address NFS 4.x): Krb5 - encrypts authentication Krtbi - encrypts authentication and provides checksums (reducing man-in-the-middle attacks) Krb5p - End-to-end encryption with integrity checking The Krb5p protocol provides ultimate security but comes at a cost where all NFS packets will be encrypted (mount authenticated) and with checksums. This can add considerable overhead (for example, using AES-256 is similar to SMB3 signing and sealing). There are AES-NI off-loading engines to reduce this overhead. So it is not surprising to see significant performance drop when using Krb5p versus Krb5. --- Madhav Ponamgi mzp at us.ibm.com (215) 794-6987 http://www.ibm.biz/FOSDesignEngine https://fileobjectsolutiondesignstudio.ibm.com/ Tech Sales Website: w3.ibm.com/w3publisher/ww_storage_tech_sales From: gpfsug-discuss-request at spectrumscale.org To: gpfsug-discuss at spectrumscale.org Date: 09/20/2021 07:00 AM Subject: [EXTERNAL] gpfsug-discuss Digest, Vol 116, Issue 6 Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Send gpfsug-discuss mailing list submissions to gpfsug-discuss at spectrumscale.org To subscribe or unsubscribe via the World Wide Web, visit http://gpfsug.org/mailman/listinfo/gpfsug-discuss or, via email, send a message with subject or body 'help' to gpfsug-discuss-request at spectrumscale.org You can reach the person managing the list at gpfsug-discuss-owner at spectrumscale.org When replying, please edit your Subject line so it is more specific than "Re: Contents of gpfsug-discuss digest..." Today's Topics: 1. nfs krb5p performance (Jon Diprose) ---------------------------------------------------------------------- Message: 1 Date: Mon, 20 Sep 2021 09:58:02 +0000 From: Jon Diprose To: "gpfsug-discuss at spectrumscale.org" Subject: [gpfsug-discuss] nfs krb5p performance Message-ID: Content-Type: text/plain; charset="us-ascii" Hello, We have just started using the nfs protocol with SECTYPE=krb5p and are a little surprised by the performance impact - looks like down to a third of that of SECTYPE=krb5. Would any of you using krb5p be kind enough to share your estimates of impact? Not sure if we have a misconfiguration of setup or expectation. Thanks, Jon -- Dr. Jonathan Diprose Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN ------------------------------ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss End of gpfsug-discuss Digest, Vol 116, Issue 6 ********************************************** -------------- next part -------------- An HTML attachment was scrubbed... URL: From committee at io500.org Wed Sep 22 16:34:06 2021 From: committee at io500.org (IO500 Committee) Date: Wed, 22 Sep 2021 09:34:06 -0600 Subject: [gpfsug-discuss] =?utf-8?q?IO500_SC=E2=80=9921_Call_for_Submissio?= =?utf-8?q?n?= Message-ID: Stabilization period: Friday, 17th September - Friday, 1st October Submission deadline: Monday, 1st November 2021 AoE The IO500 [1] is now accepting and encouraging submissions for the upcoming 9th semi-annual IO500 list, in conjunction with SC'21. Once again, we are also accepting submissions to the 10 Node Challenge to encourage the submission of small-scale results. The new ranked lists will be announced via live-stream at a virtual session during "The IO500 and the Virtual Institute of I/O" BoF [3]. We hope to see many new results. What's New Since ISC21, the IO500 follows a two-staged approach. First, there will be a two-week stabilization period during which we encourage the community to verify that the benchmark runs properly on a variety of storage systems. During this period the benchmark may be updated based upon feedback from the community. The final benchmark will then be released. We expect that submissions compliant with the rules made during the stabilization period will be valid as a final submission unless a significant defect is found. We are now creating a more detailed schema to describe the hardware and software of the system under test and provide the first set of tools to ease capturing of this information for inclusion with the submission. Further details will be released on the submission page [2]. We are evaluating the inclusion of optional test phases for additional key workloads - split easy/hard find phases, 4KB and 1MB random read/write phases, and concurrent metadata operations. This is called an extended run. At the moment, we collect the information to verify that additional phases do not significantly impact the results of the standard IO500 run. We encourage every participant to submit results from both a standard run and an extended run to facilitate comparisons between the existing and new benchmark phases. In a future release, we may include some or all of these results as part of the standard benchmark. The extended results are not currently included in the scoring of any ranked list. Background The benchmark suite is designed to be easy to run and the community has multiple active support channels to help with any questions. Please note that submissions of all sizes are welcome; the site has customizable sorting, so it is possible to submit on a small system and still get a very good per-client score, for example. Additionally, the list is about much more than just the raw rank; all submissions help the community by collecting and publishing a wider corpus of data. More details below. Following the success of the Top500 in collecting and analyzing historical trends in supercomputer technology and evolution, the IO500 was created in 2017, published its first list at SC17, and has grown continually since then. The need for such an initiative has long been known within High-Performance Computing; however, defining appropriate benchmarks has long been challenging. Despite this challenge, the community, after long and spirited discussion, finally reached a consensus on a suite of benchmarks and a metric for resolving the scores into a single ranking. The multi-fold goals of the benchmark suite are as follows: Maximizing simplicity in running the benchmark suite Encouraging optimization and documentation of tuning parameters for performance Allowing submitters to highlight their "hero run" performance numbers Forcing submitters to simultaneously report performance for challenging IO patterns. Specifically, the benchmark suite includes a hero-run of both IOR and MDTest configured, however, possible to maximize performance and establish an upper-bound for performance. It also includes an IOR and MDTest run with highly constrained parameters forcing a difficult usage pattern in an attempt to determine a lower-bound. Finally, it includes a namespace search as this has been determined to be a highly sought-after feature in HPC storage systems that has historically not been well-measured. Submitters are encouraged to share their tuning insights for publication. The goals of the community are also multi-fold: Gather historical data for the sake of analysis and to aid predictions of storage futures Collect tuning data to share valuable performance optimizations across the community Encourage vendors and designers to optimize for workloads beyond "hero runs" Establish bounded expectations for users, procurers, and administrators 10 Node I/O Challenge The 10 Node Challenge is conducted using the regular IO500 benchmark, however, with the rule that exactly 10 client nodes must be used to run the benchmark. You may use any shared storage with any number of servers. When submitting for the IO500 list, you can opt-in for "Participate in the 10 compute node challenge only", then we will not include the results in the ranked list. Other 10-node node submissions will be included in the full list and in the ranked list. We will announce the result in a separate derived list and in the full list but not on the ranked IO500 list [2]. ------------------------------------ Birds-of-a-feather Once again, we encourage you to submit [2], to join our community, and to attend our BoF "The IO500 and the Virtual Institute of I/O" [3], where we will announce the new IO500 and 10 node challenge lists. The current list includes results from twenty different storage system types and 70 institutions. We hope that the upcoming list grows even more. We look forward to answering any questions or concerns you might have. [1] https://io500.org/ [2] https://io500.org/submission [3] https://io500.org/pages/bof-sc21 -- The IO500 Committee From cabrillo at ifca.unican.es Thu Sep 2 07:47:12 2021 From: cabrillo at ifca.unican.es (Iban Cabrillo) Date: Thu, 2 Sep 2021 08:47:12 +0200 (CEST) Subject: [gpfsug-discuss] gpfsgui java cannot start Message-ID: <1675029176.1332615.1630565232533.JavaMail.zimbra@ifca.unican.es> Hi Guys, After a copuple of weeks working, i can not start gpfsgui after upgrade to 5.1.1 I get this java error at logs: ......... Sep 2 08:38:47 gpfsgui java: [AUDIT ] CWWKG0028A: Processing included configuration resource: /opt/ibm/wlp/usr/servers/gpfsgui/httpsKeystore.xml Sep 2 08:38:53 gpfsgui java: WARNING: An illegal reflective access operation has occurred Sep 2 08:38:53 gpfsgui java: WARNING: Illegal reflective access by org.apache.aries.jndi.startup.Activator (file:/opt/ibm/wlp/lib/com.ibm.ws.org.apache.aries.jndi.core_1.1.44.jar) to field javax.naming.spi.NamingManager.initctx_factory_builder Sep 2 08:38:53 gpfsgui java: WARNING: Please consider reporting this to the maintainers of org.apache.aries.jndi.startup.Activator Sep 2 08:38:53 gpfsgui java: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations ........................ Sep 2 08:32:27 gpfsgui java: file: /var/lib/mmfs/gui/user.repo.json Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/ibm/api/explorer/ Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/api/explorer/ Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/api/docs/ Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/ibm/api/ Sep 2 08:32:33 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/ Sep 2 08:32:36 gpfsgui java: Loggers initialized Sep 2 08:32:58 gpfsgui java: [AUDIT ] CWWKZ0022W: Application / has not started in 30.001 seconds. Sep 2 08:33:03 gpfsgui java: [AUDIT ] CWWKF0012I: The server installed the following features: [apiDiscovery-1.0, appSecurity-2.0, distributedMap-1.0, federatedRegistry-1.0, jaxrs-1.1, jdbc-4.0, jndi-1.0, json-1.0, jsp-2.2, ldapRegistry-3.0, servlet-3.0, ssl-1.0, usr:FsccUserRepo]. Sep 2 08:33:03 gpfsgui java: [AUDIT ] CWWKF0011I: The gpfsgui server is ready to run a smarter planet. The gpfsgui server started in 46.086 seconds. Sep 2 08:33:30 gpfsgui java: Features: [GPFS, POSTGRES, GPFS_CLUSTER] Sep 2 08:33:30 gpfsgui java: Using the GSSApplicationManagerBehavior Sep 2 08:33:30 gpfsgui java: GPFS GUI Version:5.1.1-0 Sep 2 08:33:30 gpfsgui java: GPFS GUI Build Date: 20210401-1619 Sep 2 08:33:30 gpfsgui java: (Startup) 2021-09-02 08:33:30.705 Start Backend initialization. Sep 2 08:33:30 gpfsgui java: (Startup) 144ms Database initialized. Sep 2 08:35:09 gpfsgui java: Detected Platform GPFS with mmlsconfig, because the nsdRAIDTracks parameter is not set. Sep 2 08:35:09 gpfsgui java: Successfully detected platform GPFS. Sep 2 08:36:50 gpfsgui java: (Startup) 199452ms Database version checked. Sep 2 08:36:50 gpfsgui ccrChangedCallback.sh: GPFS CCR update event received: 'root ccrFileChange _gui.settings 320' Sep 2 08:37:16 gpfsgui systemd: gpfsgui.service start operation timed out. Terminating. Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKE0085I: The server gpfsgui is stopping because the JVM is exiting. Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKE1100I: Waiting for up to 30 seconds for the server to quiesce. Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/ibm/api/explorer/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/api/docs/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/ibm/api/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/api/explorer/ Sep 2 08:37:46 gpfsgui java: [WARNING ] CWWKE1102W: The quiesce operation did not complete. The server will now stop. Sep 2 08:37:46 gpfsgui java: [WARNING ] CWWKE1106W: 2 shutdown operations did not complete during the quiesce period. Sep 2 08:37:46 gpfsgui java: [WARNING ] CWWKE1107W: 4 threads did not complete during the quiesce period. Sep 2 08:38:10 gpfsgui java: PreferencesToJsonMigrator: The non cluster related entities are currently initialized by another GUI, will retry in 5000 milliseconds. Sep 2 08:38:10 gpfsgui java: Backend/CLI/REST started. Sep 2 08:38:10 gpfsgui java: Context initialized. ..... ..... Sep 2 08:40:00 gpfsgui mmfs: [N] Purged 9023 CCR request(s) due to err: 895 (Maximal number of requests in operation queue reached (Check for request jam)) since 2021-09-02_08:22:47.580+0200 Any advice will be welcomed. regards, I -------------- next part -------------- An HTML attachment was scrubbed... URL: From juergen.hannappel at desy.de Thu Sep 2 16:31:43 2021 From: juergen.hannappel at desy.de (Hannappel, Juergen) Date: Thu, 2 Sep 2021 17:31:43 +0200 (CEST) Subject: [gpfsug-discuss] Serial number of [EG]SS nodes Message-ID: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Hi, on an ESS node with power cpu I can get the serial number from /proc/device-tree/system-id which is very useful sometimes On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there is no such pseudo-file. Is there a simple way to get at the serial number? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 1711 bytes Desc: S/MIME Cryptographic Signature URL: From abeattie at au1.ibm.com Thu Sep 2 16:50:53 2021 From: abeattie at au1.ibm.com (Andrew Beattie) Date: Thu, 2 Sep 2021 15:50:53 +0000 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: I?m not sure for the Lenovo But the GUI hardware details tabs has MTM and serial information for all the ESS nodes. Regards Andrew > On 3 Sep 2021, at 01:39, Hannappel, Juergen wrote: > > ?Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From S.J.Thompson at bham.ac.uk Thu Sep 2 16:53:37 2021 From: S.J.Thompson at bham.ac.uk (Simon Thompson) Date: Thu, 2 Sep 2021 15:53:37 +0000 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: <0ADEDB80-E348-42D5-B9A2-DC4357EF2474@bham.ac.uk> Depends if it was filled in at install time, but mmlscomp might hold the data (on both ESS and DSS systems)? I guess that is where the GUI reads the data from also? Simon From: on behalf of "abeattie at au1.ibm.com" Reply to: "gpfsug-discuss at spectrumscale.org" Date: Thursday, 2 September 2021 at 16:51 To: "gpfsug-discuss at spectrumscale.org" Subject: Re: [gpfsug-discuss] Serial number of [EG]SS nodes I?m not sure for the Lenovo But the GUI hardware details tabs has MTM and serial information for all the ESS nodes. Regards Andrew > On 3 Sep 2021, at 01:39, Hannappel, Juergen wrote: > > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From sadaniel at us.ibm.com Thu Sep 2 17:07:06 2021 From: sadaniel at us.ibm.com (Steven Daniels) Date: Thu, 2 Sep 2021 10:07:06 -0600 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <0ADEDB80-E348-42D5-B9A2-DC4357EF2474@bham.ac.uk> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> <0ADEDB80-E348-42D5-B9A2-DC4357EF2474@bham.ac.uk> Message-ID: If xcat is on gss, then you can run nodels and use the node name for lsdef -t node To: "gpfsug main discussion list" Date: 09/02/2021 09:53 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] Serial number of [EG]SS nodes Sent by: gpfsug-discuss-bounces at spectrumscale.org Depends if it was filled in at install time, but mmlscomp might hold the data (on both ESS and DSS systems)? I guess that is where the GUI reads the data from also? Simon From: on behalf of "abeattie at au1.ibm.com" Reply to: "gpfsug-discuss at spectrumscale.org" Date: Thursday, 2 September 2021 at 16:51 To: "gpfsug-discuss at spectrumscale.org" Subject: Re: [gpfsug-discuss] Serial number of [EG]SS nodes I?m not sure for the Lenovo But the GUI hardware details tabs has MTM and serial information for all the ESS nodes. Regards Andrew > On 3 Sep 2021, at 01:39, Hannappel, Juergen wrote: > > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: opencits-d.jpg Type: image/jpeg Size: 182862 bytes Desc: not available URL: From UWEFALKE at de.ibm.com Thu Sep 2 17:14:56 2021 From: UWEFALKE at de.ibm.com (Uwe Falke) Date: Thu, 2 Sep 2021 18:14:56 +0200 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Hi, J?rgen, try the command dmidecode lists a bunch of information, somewhere should be the serial of the system. Mit freundlichen Gr??en / Kind regards Dr. Uwe Falke IT Specialist Hybrid Cloud Infrastructure / Technology Consulting & Implementation Services +49 175 575 2877 Mobile Rochlitzer Str. 19, 09111 Chemnitz, Germany uwefalke at de.ibm.com IBM Services IBM Data Privacy Statement IBM Deutschland Business & Technology Services GmbH Gesch?ftsf?hrung: Sven Schooss, Stefan Hierl Sitz der Gesellschaft: Ehningen Registergericht: Amtsgericht Stuttgart, HRB 17122 From: "Hannappel, Juergen" To: "gpfsug main discussion list" Date: 02/09/2021 17:40 Subject: [EXTERNAL] [gpfsug-discuss] Serial number of [EG]SS nodes Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, on an ESS node with power cpu I can get the serial number from /proc/device-tree/system-id which is very useful sometimes On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there is no such pseudo-file. Is there a simple way to get at the serial number? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 [attachment "smime.p7s" deleted by Uwe Falke/Germany/IBM] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss From spectrumscale at kiranghag.com Thu Sep 2 18:32:31 2021 From: spectrumscale at kiranghag.com (KG) Date: Thu, 2 Sep 2021 23:02:31 +0530 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: did you try "lshw -C system" On Thu, Sep 2, 2021 at 9:09 PM Hannappel, Juergen wrote: > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Achim.Rehor at de.ibm.com Thu Sep 2 19:38:04 2021 From: Achim.Rehor at de.ibm.com (Achim Rehor) Date: Thu, 2 Sep 2021 20:38:04 +0200 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Hi Juergen, topsummary does contain the serial number of th ESS3K Mit freundlichen Gr??en / Kind regards Achim Rehor Remote Technical Support Engineer Storage IBM Systems Storage Support - EMEA Storage Competence Center (ESCC) Spectrum Scale / Elastic Storage Server ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland Am Weiher 24 65451 Kelsterbach Phone: +49-170-4521194 E-Mail: Achim.Rehor at de.ibm.com ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Sebastian Krause Gesch?ftsf?hrung: Gregor Pillen (Vorsitzender), Agnes Heftberger, Norbert Janzen, Markus Koerner, Christian Noll, Nicole Reimer Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940 gpfsug-discuss-bounces at spectrumscale.org wrote on 02/09/2021 17:31:43: > From: "Hannappel, Juergen" > To: "gpfsug main discussion list" > Date: 02/09/2021 17:39 > Subject: [EXTERNAL] [gpfsug-discuss] Serial number of [EG]SS nodes > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > [attachment "smime.p7s" deleted by Achim Rehor/Germany/IBM] > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss From ewahl at osc.edu Thu Sep 2 20:18:12 2021 From: ewahl at osc.edu (Wahl, Edward) Date: Thu, 2 Sep 2021 19:18:12 +0000 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Does 'rinv |grep -i serial ' work on the x86? Ed Wahl OSC ________________________________ From: gpfsug-discuss-bounces at spectrumscale.org on behalf of Hannappel, Juergen Sent: Thursday, September 2, 2021 11:31 AM To: gpfsug main discussion list Subject: [gpfsug-discuss] Serial number of [EG]SS nodes Hi, on an ESS node with power cpu I can get the serial number from /proc/device-tree/system-id which is very useful sometimes On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there is no such pseudo-file. Is there a simple way to get at the serial number? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 -------------- next part -------------- An HTML attachment was scrubbed... URL: From jonathan.buzzard at strath.ac.uk Thu Sep 2 21:46:56 2021 From: jonathan.buzzard at strath.ac.uk (Jonathan Buzzard) Date: Thu, 2 Sep 2021 21:46:56 +0100 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: On 02/09/2021 17:14, Uwe Falke wrote: > > Hi, J?rgen, > > try the command > dmidecode > > lists a bunch of information, somewhere should be the serial of the > system. > You can cut the amount of information down by specifying the type of information you want, so usually dmidecode -t system will display the information with the serial number of the machine. This is my preferred choice as it is usually installed by default. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG From sannaik2 at in.ibm.com Wed Sep 8 04:31:52 2021 From: sannaik2 at in.ibm.com (Sandeep Naik1) Date: Wed, 8 Sep 2021 09:01:52 +0530 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Hi Jurgen, You can cut it even further :-) to get only serial number. dmidecode -s system-serial-number Thanks, Sandeep From: "Jonathan Buzzard" To: gpfsug-discuss at spectrumscale.org Date: 03/09/2021 02:17 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] Serial number of [EG]SS nodes Sent by: gpfsug-discuss-bounces at spectrumscale.org On 02/09/2021 17:14, Uwe Falke wrote: > > Hi, J?rgen, > > try the command > dmidecode > > lists a bunch of information, somewhere should be the serial of the > system. > You can cut the amount of information down by specifying the type of information you want, so usually dmidecode -t system will display the information with the serial number of the machine. This is my preferred choice as it is usually installed by default. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From jon at well.ox.ac.uk Mon Sep 20 10:58:02 2021 From: jon at well.ox.ac.uk (Jon Diprose) Date: Mon, 20 Sep 2021 09:58:02 +0000 Subject: [gpfsug-discuss] nfs krb5p performance Message-ID: Hello, We have just started using the nfs protocol with SECTYPE=krb5p and are a little surprised by the performance impact - looks like down to a third of that of SECTYPE=krb5. Would any of you using krb5p be kind enough to share your estimates of impact? Not sure if we have a misconfiguration of setup or expectation. Thanks, Jon -- Dr. Jonathan Diprose Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN From mzp at us.ibm.com Mon Sep 20 13:44:32 2021 From: mzp at us.ibm.com (Madhav Ponamgi1) Date: Mon, 20 Sep 2021 08:44:32 -0400 Subject: [gpfsug-discuss] gpfsug-discuss Digest, Vol 116, Issue 6 In-Reply-To: References: Message-ID: There are 3 flavors of NFS Kerberos (I'm only going to address NFS 4.x): Krb5 - encrypts authentication Krtbi - encrypts authentication and provides checksums (reducing man-in-the-middle attacks) Krb5p - End-to-end encryption with integrity checking The Krb5p protocol provides ultimate security but comes at a cost where all NFS packets will be encrypted (mount authenticated) and with checksums. This can add considerable overhead (for example, using AES-256 is similar to SMB3 signing and sealing). There are AES-NI off-loading engines to reduce this overhead. So it is not surprising to see significant performance drop when using Krb5p versus Krb5. --- Madhav Ponamgi mzp at us.ibm.com (215) 794-6987 http://www.ibm.biz/FOSDesignEngine https://fileobjectsolutiondesignstudio.ibm.com/ Tech Sales Website: w3.ibm.com/w3publisher/ww_storage_tech_sales From: gpfsug-discuss-request at spectrumscale.org To: gpfsug-discuss at spectrumscale.org Date: 09/20/2021 07:00 AM Subject: [EXTERNAL] gpfsug-discuss Digest, Vol 116, Issue 6 Sent by: gpfsug-discuss-bounces at spectrumscale.org Send gpfsug-discuss mailing list submissions to gpfsug-discuss at spectrumscale.org To subscribe or unsubscribe via the World Wide Web, visit http://gpfsug.org/mailman/listinfo/gpfsug-discuss or, via email, send a message with subject or body 'help' to gpfsug-discuss-request at spectrumscale.org You can reach the person managing the list at gpfsug-discuss-owner at spectrumscale.org When replying, please edit your Subject line so it is more specific than "Re: Contents of gpfsug-discuss digest..." Today's Topics: 1. nfs krb5p performance (Jon Diprose) ---------------------------------------------------------------------- Message: 1 Date: Mon, 20 Sep 2021 09:58:02 +0000 From: Jon Diprose To: "gpfsug-discuss at spectrumscale.org" Subject: [gpfsug-discuss] nfs krb5p performance Message-ID: Content-Type: text/plain; charset="us-ascii" Hello, We have just started using the nfs protocol with SECTYPE=krb5p and are a little surprised by the performance impact - looks like down to a third of that of SECTYPE=krb5. Would any of you using krb5p be kind enough to share your estimates of impact? Not sure if we have a misconfiguration of setup or expectation. Thanks, Jon -- Dr. Jonathan Diprose Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN ------------------------------ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss End of gpfsug-discuss Digest, Vol 116, Issue 6 ********************************************** -------------- next part -------------- An HTML attachment was scrubbed... URL: From jon at well.ox.ac.uk Mon Sep 20 14:40:17 2021 From: jon at well.ox.ac.uk (Jon Diprose) Date: Mon, 20 Sep 2021 13:40:17 +0000 Subject: [gpfsug-discuss] gpfsug-discuss Digest, Vol 116, Issue 6 In-Reply-To: References: , Message-ID: Thanks Madhav. I am aware of that, and find myself with a need for krb5p - and a disappointed user. I am hoping for some rough quantification of the expected impact of turning on end-to-ed encryption so I know whether what I get is all there is or whether I need to keep digging. I know that Spectrum Scale uses the AES-NI instructions (if available) for its own end-to-end encryption. I am less clear on whether AES-NI is used by ganesha for krb5p. Both ends have cpus that indicate support of AES-NI to the OS. I can, and with apologies for it being a pdf, point you at a paper on AES-NI performance: http://www.sce.carleton.ca/faculty/huang/iccae-2020.pdf which shows that their Intel i5-8250U test platform (which is probably disappointingly close in single-thread performance to my 6212U-based servers) will happily push around 900MB/s using AES-NI accelaration, but only around 110MB/s without. The higher number wouldn't be the bottleneck in my setup. The lower number is pretty close to what I am seeing. Unfortunately I can't tell whether AES-NI is actually being used, or find any options that might control its use. Do you have any numbers to indicate what throughput I might expect to get for krb5p, and what hit that might be over krb5? Or any suggestions for checking whether AES-NI is actually in use? Thanks, Jon -- Dr. Jonathan Diprose > Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN ________________________________ From: gpfsug-discuss-bounces at spectrumscale.org [gpfsug-discuss-bounces at spectrumscale.org] on behalf of Madhav Ponamgi1 [mzp at us.ibm.com] Sent: 20 September 2021 13:44 To: gpfsug-discuss at spectrumscale.org Subject: Re: [gpfsug-discuss] gpfsug-discuss Digest, Vol 116, Issue 6 There are 3 flavors of NFS Kerberos (I'm only going to address NFS 4.x): Krb5 - encrypts authentication Krtbi - encrypts authentication and provides checksums (reducing man-in-the-middle attacks) Krb5p - End-to-end encryption with integrity checking The Krb5p protocol provides ultimate security but comes at a cost where all NFS packets will be encrypted (mount authenticated) and with checksums. This can add considerable overhead (for example, using AES-256 is similar to SMB3 signing and sealing). There are AES-NI off-loading engines to reduce this overhead. So it is not surprising to see significant performance drop when using Krb5p versus Krb5. --- Madhav Ponamgi mzp at us.ibm.com (215) 794-6987 http://www.ibm.biz/FOSDesignEngine https://fileobjectsolutiondesignstudio.ibm.com/ Tech Sales Website: w3.ibm.com/w3publisher/ww_storage_tech_sales From: gpfsug-discuss-request at spectrumscale.org To: gpfsug-discuss at spectrumscale.org Date: 09/20/2021 07:00 AM Subject: [EXTERNAL] gpfsug-discuss Digest, Vol 116, Issue 6 Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Send gpfsug-discuss mailing list submissions to gpfsug-discuss at spectrumscale.org To subscribe or unsubscribe via the World Wide Web, visit http://gpfsug.org/mailman/listinfo/gpfsug-discuss or, via email, send a message with subject or body 'help' to gpfsug-discuss-request at spectrumscale.org You can reach the person managing the list at gpfsug-discuss-owner at spectrumscale.org When replying, please edit your Subject line so it is more specific than "Re: Contents of gpfsug-discuss digest..." Today's Topics: 1. nfs krb5p performance (Jon Diprose) ---------------------------------------------------------------------- Message: 1 Date: Mon, 20 Sep 2021 09:58:02 +0000 From: Jon Diprose To: "gpfsug-discuss at spectrumscale.org" Subject: [gpfsug-discuss] nfs krb5p performance Message-ID: Content-Type: text/plain; charset="us-ascii" Hello, We have just started using the nfs protocol with SECTYPE=krb5p and are a little surprised by the performance impact - looks like down to a third of that of SECTYPE=krb5. Would any of you using krb5p be kind enough to share your estimates of impact? Not sure if we have a misconfiguration of setup or expectation. Thanks, Jon -- Dr. Jonathan Diprose Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN ------------------------------ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss End of gpfsug-discuss Digest, Vol 116, Issue 6 ********************************************** -------------- next part -------------- An HTML attachment was scrubbed... URL: From committee at io500.org Wed Sep 22 16:34:06 2021 From: committee at io500.org (IO500 Committee) Date: Wed, 22 Sep 2021 09:34:06 -0600 Subject: [gpfsug-discuss] =?utf-8?q?IO500_SC=E2=80=9921_Call_for_Submissio?= =?utf-8?q?n?= Message-ID: Stabilization period: Friday, 17th September - Friday, 1st October Submission deadline: Monday, 1st November 2021 AoE The IO500 [1] is now accepting and encouraging submissions for the upcoming 9th semi-annual IO500 list, in conjunction with SC'21. Once again, we are also accepting submissions to the 10 Node Challenge to encourage the submission of small-scale results. The new ranked lists will be announced via live-stream at a virtual session during "The IO500 and the Virtual Institute of I/O" BoF [3]. We hope to see many new results. What's New Since ISC21, the IO500 follows a two-staged approach. First, there will be a two-week stabilization period during which we encourage the community to verify that the benchmark runs properly on a variety of storage systems. During this period the benchmark may be updated based upon feedback from the community. The final benchmark will then be released. We expect that submissions compliant with the rules made during the stabilization period will be valid as a final submission unless a significant defect is found. We are now creating a more detailed schema to describe the hardware and software of the system under test and provide the first set of tools to ease capturing of this information for inclusion with the submission. Further details will be released on the submission page [2]. We are evaluating the inclusion of optional test phases for additional key workloads - split easy/hard find phases, 4KB and 1MB random read/write phases, and concurrent metadata operations. This is called an extended run. At the moment, we collect the information to verify that additional phases do not significantly impact the results of the standard IO500 run. We encourage every participant to submit results from both a standard run and an extended run to facilitate comparisons between the existing and new benchmark phases. In a future release, we may include some or all of these results as part of the standard benchmark. The extended results are not currently included in the scoring of any ranked list. Background The benchmark suite is designed to be easy to run and the community has multiple active support channels to help with any questions. Please note that submissions of all sizes are welcome; the site has customizable sorting, so it is possible to submit on a small system and still get a very good per-client score, for example. Additionally, the list is about much more than just the raw rank; all submissions help the community by collecting and publishing a wider corpus of data. More details below. Following the success of the Top500 in collecting and analyzing historical trends in supercomputer technology and evolution, the IO500 was created in 2017, published its first list at SC17, and has grown continually since then. The need for such an initiative has long been known within High-Performance Computing; however, defining appropriate benchmarks has long been challenging. Despite this challenge, the community, after long and spirited discussion, finally reached a consensus on a suite of benchmarks and a metric for resolving the scores into a single ranking. The multi-fold goals of the benchmark suite are as follows: Maximizing simplicity in running the benchmark suite Encouraging optimization and documentation of tuning parameters for performance Allowing submitters to highlight their "hero run" performance numbers Forcing submitters to simultaneously report performance for challenging IO patterns. Specifically, the benchmark suite includes a hero-run of both IOR and MDTest configured, however, possible to maximize performance and establish an upper-bound for performance. It also includes an IOR and MDTest run with highly constrained parameters forcing a difficult usage pattern in an attempt to determine a lower-bound. Finally, it includes a namespace search as this has been determined to be a highly sought-after feature in HPC storage systems that has historically not been well-measured. Submitters are encouraged to share their tuning insights for publication. The goals of the community are also multi-fold: Gather historical data for the sake of analysis and to aid predictions of storage futures Collect tuning data to share valuable performance optimizations across the community Encourage vendors and designers to optimize for workloads beyond "hero runs" Establish bounded expectations for users, procurers, and administrators 10 Node I/O Challenge The 10 Node Challenge is conducted using the regular IO500 benchmark, however, with the rule that exactly 10 client nodes must be used to run the benchmark. You may use any shared storage with any number of servers. When submitting for the IO500 list, you can opt-in for "Participate in the 10 compute node challenge only", then we will not include the results in the ranked list. Other 10-node node submissions will be included in the full list and in the ranked list. We will announce the result in a separate derived list and in the full list but not on the ranked IO500 list [2]. ------------------------------------ Birds-of-a-feather Once again, we encourage you to submit [2], to join our community, and to attend our BoF "The IO500 and the Virtual Institute of I/O" [3], where we will announce the new IO500 and 10 node challenge lists. The current list includes results from twenty different storage system types and 70 institutions. We hope that the upcoming list grows even more. We look forward to answering any questions or concerns you might have. [1] https://io500.org/ [2] https://io500.org/submission [3] https://io500.org/pages/bof-sc21 -- The IO500 Committee From cabrillo at ifca.unican.es Thu Sep 2 07:47:12 2021 From: cabrillo at ifca.unican.es (Iban Cabrillo) Date: Thu, 2 Sep 2021 08:47:12 +0200 (CEST) Subject: [gpfsug-discuss] gpfsgui java cannot start Message-ID: <1675029176.1332615.1630565232533.JavaMail.zimbra@ifca.unican.es> Hi Guys, After a copuple of weeks working, i can not start gpfsgui after upgrade to 5.1.1 I get this java error at logs: ......... Sep 2 08:38:47 gpfsgui java: [AUDIT ] CWWKG0028A: Processing included configuration resource: /opt/ibm/wlp/usr/servers/gpfsgui/httpsKeystore.xml Sep 2 08:38:53 gpfsgui java: WARNING: An illegal reflective access operation has occurred Sep 2 08:38:53 gpfsgui java: WARNING: Illegal reflective access by org.apache.aries.jndi.startup.Activator (file:/opt/ibm/wlp/lib/com.ibm.ws.org.apache.aries.jndi.core_1.1.44.jar) to field javax.naming.spi.NamingManager.initctx_factory_builder Sep 2 08:38:53 gpfsgui java: WARNING: Please consider reporting this to the maintainers of org.apache.aries.jndi.startup.Activator Sep 2 08:38:53 gpfsgui java: WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations ........................ Sep 2 08:32:27 gpfsgui java: file: /var/lib/mmfs/gui/user.repo.json Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/ibm/api/explorer/ Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/api/explorer/ Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/api/docs/ Sep 2 08:32:28 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/ibm/api/ Sep 2 08:32:33 gpfsgui java: [AUDIT ] CWWKT0016I: Web application available (default_host): http://gpfsgui.ifca.es:47080/ Sep 2 08:32:36 gpfsgui java: Loggers initialized Sep 2 08:32:58 gpfsgui java: [AUDIT ] CWWKZ0022W: Application / has not started in 30.001 seconds. Sep 2 08:33:03 gpfsgui java: [AUDIT ] CWWKF0012I: The server installed the following features: [apiDiscovery-1.0, appSecurity-2.0, distributedMap-1.0, federatedRegistry-1.0, jaxrs-1.1, jdbc-4.0, jndi-1.0, json-1.0, jsp-2.2, ldapRegistry-3.0, servlet-3.0, ssl-1.0, usr:FsccUserRepo]. Sep 2 08:33:03 gpfsgui java: [AUDIT ] CWWKF0011I: The gpfsgui server is ready to run a smarter planet. The gpfsgui server started in 46.086 seconds. Sep 2 08:33:30 gpfsgui java: Features: [GPFS, POSTGRES, GPFS_CLUSTER] Sep 2 08:33:30 gpfsgui java: Using the GSSApplicationManagerBehavior Sep 2 08:33:30 gpfsgui java: GPFS GUI Version:5.1.1-0 Sep 2 08:33:30 gpfsgui java: GPFS GUI Build Date: 20210401-1619 Sep 2 08:33:30 gpfsgui java: (Startup) 2021-09-02 08:33:30.705 Start Backend initialization. Sep 2 08:33:30 gpfsgui java: (Startup) 144ms Database initialized. Sep 2 08:35:09 gpfsgui java: Detected Platform GPFS with mmlsconfig, because the nsdRAIDTracks parameter is not set. Sep 2 08:35:09 gpfsgui java: Successfully detected platform GPFS. Sep 2 08:36:50 gpfsgui java: (Startup) 199452ms Database version checked. Sep 2 08:36:50 gpfsgui ccrChangedCallback.sh: GPFS CCR update event received: 'root ccrFileChange _gui.settings 320' Sep 2 08:37:16 gpfsgui systemd: gpfsgui.service start operation timed out. Terminating. Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKE0085I: The server gpfsgui is stopping because the JVM is exiting. Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKE1100I: Waiting for up to 30 seconds for the server to quiesce. Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/ibm/api/explorer/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/api/docs/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/ibm/api/ Sep 2 08:37:16 gpfsgui java: [AUDIT ] CWWKT0017I: Web application removed (default_host): http://gpfsgui.ifca.es:47080/api/explorer/ Sep 2 08:37:46 gpfsgui java: [WARNING ] CWWKE1102W: The quiesce operation did not complete. The server will now stop. Sep 2 08:37:46 gpfsgui java: [WARNING ] CWWKE1106W: 2 shutdown operations did not complete during the quiesce period. Sep 2 08:37:46 gpfsgui java: [WARNING ] CWWKE1107W: 4 threads did not complete during the quiesce period. Sep 2 08:38:10 gpfsgui java: PreferencesToJsonMigrator: The non cluster related entities are currently initialized by another GUI, will retry in 5000 milliseconds. Sep 2 08:38:10 gpfsgui java: Backend/CLI/REST started. Sep 2 08:38:10 gpfsgui java: Context initialized. ..... ..... Sep 2 08:40:00 gpfsgui mmfs: [N] Purged 9023 CCR request(s) due to err: 895 (Maximal number of requests in operation queue reached (Check for request jam)) since 2021-09-02_08:22:47.580+0200 Any advice will be welcomed. regards, I -------------- next part -------------- An HTML attachment was scrubbed... URL: From juergen.hannappel at desy.de Thu Sep 2 16:31:43 2021 From: juergen.hannappel at desy.de (Hannappel, Juergen) Date: Thu, 2 Sep 2021 17:31:43 +0200 (CEST) Subject: [gpfsug-discuss] Serial number of [EG]SS nodes Message-ID: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Hi, on an ESS node with power cpu I can get the serial number from /proc/device-tree/system-id which is very useful sometimes On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there is no such pseudo-file. Is there a simple way to get at the serial number? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 1711 bytes Desc: S/MIME Cryptographic Signature URL: From abeattie at au1.ibm.com Thu Sep 2 16:50:53 2021 From: abeattie at au1.ibm.com (Andrew Beattie) Date: Thu, 2 Sep 2021 15:50:53 +0000 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: I?m not sure for the Lenovo But the GUI hardware details tabs has MTM and serial information for all the ESS nodes. Regards Andrew > On 3 Sep 2021, at 01:39, Hannappel, Juergen wrote: > > ?Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From S.J.Thompson at bham.ac.uk Thu Sep 2 16:53:37 2021 From: S.J.Thompson at bham.ac.uk (Simon Thompson) Date: Thu, 2 Sep 2021 15:53:37 +0000 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: <0ADEDB80-E348-42D5-B9A2-DC4357EF2474@bham.ac.uk> Depends if it was filled in at install time, but mmlscomp might hold the data (on both ESS and DSS systems)? I guess that is where the GUI reads the data from also? Simon From: on behalf of "abeattie at au1.ibm.com" Reply to: "gpfsug-discuss at spectrumscale.org" Date: Thursday, 2 September 2021 at 16:51 To: "gpfsug-discuss at spectrumscale.org" Subject: Re: [gpfsug-discuss] Serial number of [EG]SS nodes I?m not sure for the Lenovo But the GUI hardware details tabs has MTM and serial information for all the ESS nodes. Regards Andrew > On 3 Sep 2021, at 01:39, Hannappel, Juergen wrote: > > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From sadaniel at us.ibm.com Thu Sep 2 17:07:06 2021 From: sadaniel at us.ibm.com (Steven Daniels) Date: Thu, 2 Sep 2021 10:07:06 -0600 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <0ADEDB80-E348-42D5-B9A2-DC4357EF2474@bham.ac.uk> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> <0ADEDB80-E348-42D5-B9A2-DC4357EF2474@bham.ac.uk> Message-ID: If xcat is on gss, then you can run nodels and use the node name for lsdef -t node To: "gpfsug main discussion list" Date: 09/02/2021 09:53 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] Serial number of [EG]SS nodes Sent by: gpfsug-discuss-bounces at spectrumscale.org Depends if it was filled in at install time, but mmlscomp might hold the data (on both ESS and DSS systems)? I guess that is where the GUI reads the data from also? Simon From: on behalf of "abeattie at au1.ibm.com" Reply to: "gpfsug-discuss at spectrumscale.org" Date: Thursday, 2 September 2021 at 16:51 To: "gpfsug-discuss at spectrumscale.org" Subject: Re: [gpfsug-discuss] Serial number of [EG]SS nodes I?m not sure for the Lenovo But the GUI hardware details tabs has MTM and serial information for all the ESS nodes. Regards Andrew > On 3 Sep 2021, at 01:39, Hannappel, Juergen wrote: > > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: opencits-d.jpg Type: image/jpeg Size: 182862 bytes Desc: not available URL: From UWEFALKE at de.ibm.com Thu Sep 2 17:14:56 2021 From: UWEFALKE at de.ibm.com (Uwe Falke) Date: Thu, 2 Sep 2021 18:14:56 +0200 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Hi, J?rgen, try the command dmidecode lists a bunch of information, somewhere should be the serial of the system. Mit freundlichen Gr??en / Kind regards Dr. Uwe Falke IT Specialist Hybrid Cloud Infrastructure / Technology Consulting & Implementation Services +49 175 575 2877 Mobile Rochlitzer Str. 19, 09111 Chemnitz, Germany uwefalke at de.ibm.com IBM Services IBM Data Privacy Statement IBM Deutschland Business & Technology Services GmbH Gesch?ftsf?hrung: Sven Schooss, Stefan Hierl Sitz der Gesellschaft: Ehningen Registergericht: Amtsgericht Stuttgart, HRB 17122 From: "Hannappel, Juergen" To: "gpfsug main discussion list" Date: 02/09/2021 17:40 Subject: [EXTERNAL] [gpfsug-discuss] Serial number of [EG]SS nodes Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, on an ESS node with power cpu I can get the serial number from /proc/device-tree/system-id which is very useful sometimes On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there is no such pseudo-file. Is there a simple way to get at the serial number? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 [attachment "smime.p7s" deleted by Uwe Falke/Germany/IBM] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss From spectrumscale at kiranghag.com Thu Sep 2 18:32:31 2021 From: spectrumscale at kiranghag.com (KG) Date: Thu, 2 Sep 2021 23:02:31 +0530 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: did you try "lshw -C system" On Thu, Sep 2, 2021 at 9:09 PM Hannappel, Juergen wrote: > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Achim.Rehor at de.ibm.com Thu Sep 2 19:38:04 2021 From: Achim.Rehor at de.ibm.com (Achim Rehor) Date: Thu, 2 Sep 2021 20:38:04 +0200 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Hi Juergen, topsummary does contain the serial number of th ESS3K Mit freundlichen Gr??en / Kind regards Achim Rehor Remote Technical Support Engineer Storage IBM Systems Storage Support - EMEA Storage Competence Center (ESCC) Spectrum Scale / Elastic Storage Server ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland Am Weiher 24 65451 Kelsterbach Phone: +49-170-4521194 E-Mail: Achim.Rehor at de.ibm.com ------------------------------------------------------------------------------------------------------------------------------------------- IBM Deutschland GmbH / Vorsitzender des Aufsichtsrats: Sebastian Krause Gesch?ftsf?hrung: Gregor Pillen (Vorsitzender), Agnes Heftberger, Norbert Janzen, Markus Koerner, Christian Noll, Nicole Reimer Sitz der Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB 14562 / WEEE-Reg.-Nr. DE 99369940 gpfsug-discuss-bounces at spectrumscale.org wrote on 02/09/2021 17:31:43: > From: "Hannappel, Juergen" > To: "gpfsug main discussion list" > Date: 02/09/2021 17:39 > Subject: [EXTERNAL] [gpfsug-discuss] Serial number of [EG]SS nodes > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > Hi, > on an ESS node with power cpu I can get the serial number from > /proc/device-tree/system-id > which is very useful sometimes > On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there > is no such pseudo-file. Is there a simple way to get at the serial number? > -- > Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 > [attachment "smime.p7s" deleted by Achim Rehor/Germany/IBM] > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss From ewahl at osc.edu Thu Sep 2 20:18:12 2021 From: ewahl at osc.edu (Wahl, Edward) Date: Thu, 2 Sep 2021 19:18:12 +0000 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Does 'rinv |grep -i serial ' work on the x86? Ed Wahl OSC ________________________________ From: gpfsug-discuss-bounces at spectrumscale.org on behalf of Hannappel, Juergen Sent: Thursday, September 2, 2021 11:31 AM To: gpfsug main discussion list Subject: [gpfsug-discuss] Serial number of [EG]SS nodes Hi, on an ESS node with power cpu I can get the serial number from /proc/device-tree/system-id which is very useful sometimes On nodes with X86 architecture (Lenovo GSS or IBM ESS3XXX_) there is no such pseudo-file. Is there a simple way to get at the serial number? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 -------------- next part -------------- An HTML attachment was scrubbed... URL: From jonathan.buzzard at strath.ac.uk Thu Sep 2 21:46:56 2021 From: jonathan.buzzard at strath.ac.uk (Jonathan Buzzard) Date: Thu, 2 Sep 2021 21:46:56 +0100 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: On 02/09/2021 17:14, Uwe Falke wrote: > > Hi, J?rgen, > > try the command > dmidecode > > lists a bunch of information, somewhere should be the serial of the > system. > You can cut the amount of information down by specifying the type of information you want, so usually dmidecode -t system will display the information with the serial number of the machine. This is my preferred choice as it is usually installed by default. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG From sannaik2 at in.ibm.com Wed Sep 8 04:31:52 2021 From: sannaik2 at in.ibm.com (Sandeep Naik1) Date: Wed, 8 Sep 2021 09:01:52 +0530 Subject: [gpfsug-discuss] Serial number of [EG]SS nodes In-Reply-To: References: <648025861.10513071.1630596703572.JavaMail.zimbra@desy.de> Message-ID: Hi Jurgen, You can cut it even further :-) to get only serial number. dmidecode -s system-serial-number Thanks, Sandeep From: "Jonathan Buzzard" To: gpfsug-discuss at spectrumscale.org Date: 03/09/2021 02:17 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] Serial number of [EG]SS nodes Sent by: gpfsug-discuss-bounces at spectrumscale.org On 02/09/2021 17:14, Uwe Falke wrote: > > Hi, J?rgen, > > try the command > dmidecode > > lists a bunch of information, somewhere should be the serial of the > system. > You can cut the amount of information down by specifying the type of information you want, so usually dmidecode -t system will display the information with the serial number of the machine. This is my preferred choice as it is usually installed by default. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From jon at well.ox.ac.uk Mon Sep 20 10:58:02 2021 From: jon at well.ox.ac.uk (Jon Diprose) Date: Mon, 20 Sep 2021 09:58:02 +0000 Subject: [gpfsug-discuss] nfs krb5p performance Message-ID: Hello, We have just started using the nfs protocol with SECTYPE=krb5p and are a little surprised by the performance impact - looks like down to a third of that of SECTYPE=krb5. Would any of you using krb5p be kind enough to share your estimates of impact? Not sure if we have a misconfiguration of setup or expectation. Thanks, Jon -- Dr. Jonathan Diprose Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN From mzp at us.ibm.com Mon Sep 20 13:44:32 2021 From: mzp at us.ibm.com (Madhav Ponamgi1) Date: Mon, 20 Sep 2021 08:44:32 -0400 Subject: [gpfsug-discuss] gpfsug-discuss Digest, Vol 116, Issue 6 In-Reply-To: References: Message-ID: There are 3 flavors of NFS Kerberos (I'm only going to address NFS 4.x): Krb5 - encrypts authentication Krtbi - encrypts authentication and provides checksums (reducing man-in-the-middle attacks) Krb5p - End-to-end encryption with integrity checking The Krb5p protocol provides ultimate security but comes at a cost where all NFS packets will be encrypted (mount authenticated) and with checksums. This can add considerable overhead (for example, using AES-256 is similar to SMB3 signing and sealing). There are AES-NI off-loading engines to reduce this overhead. So it is not surprising to see significant performance drop when using Krb5p versus Krb5. --- Madhav Ponamgi mzp at us.ibm.com (215) 794-6987 http://www.ibm.biz/FOSDesignEngine https://fileobjectsolutiondesignstudio.ibm.com/ Tech Sales Website: w3.ibm.com/w3publisher/ww_storage_tech_sales From: gpfsug-discuss-request at spectrumscale.org To: gpfsug-discuss at spectrumscale.org Date: 09/20/2021 07:00 AM Subject: [EXTERNAL] gpfsug-discuss Digest, Vol 116, Issue 6 Sent by: gpfsug-discuss-bounces at spectrumscale.org Send gpfsug-discuss mailing list submissions to gpfsug-discuss at spectrumscale.org To subscribe or unsubscribe via the World Wide Web, visit http://gpfsug.org/mailman/listinfo/gpfsug-discuss or, via email, send a message with subject or body 'help' to gpfsug-discuss-request at spectrumscale.org You can reach the person managing the list at gpfsug-discuss-owner at spectrumscale.org When replying, please edit your Subject line so it is more specific than "Re: Contents of gpfsug-discuss digest..." Today's Topics: 1. nfs krb5p performance (Jon Diprose) ---------------------------------------------------------------------- Message: 1 Date: Mon, 20 Sep 2021 09:58:02 +0000 From: Jon Diprose To: "gpfsug-discuss at spectrumscale.org" Subject: [gpfsug-discuss] nfs krb5p performance Message-ID: Content-Type: text/plain; charset="us-ascii" Hello, We have just started using the nfs protocol with SECTYPE=krb5p and are a little surprised by the performance impact - looks like down to a third of that of SECTYPE=krb5. Would any of you using krb5p be kind enough to share your estimates of impact? Not sure if we have a misconfiguration of setup or expectation. Thanks, Jon -- Dr. Jonathan Diprose Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN ------------------------------ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss End of gpfsug-discuss Digest, Vol 116, Issue 6 ********************************************** -------------- next part -------------- An HTML attachment was scrubbed... URL: From jon at well.ox.ac.uk Mon Sep 20 14:40:17 2021 From: jon at well.ox.ac.uk (Jon Diprose) Date: Mon, 20 Sep 2021 13:40:17 +0000 Subject: [gpfsug-discuss] gpfsug-discuss Digest, Vol 116, Issue 6 In-Reply-To: References: , Message-ID: Thanks Madhav. I am aware of that, and find myself with a need for krb5p - and a disappointed user. I am hoping for some rough quantification of the expected impact of turning on end-to-ed encryption so I know whether what I get is all there is or whether I need to keep digging. I know that Spectrum Scale uses the AES-NI instructions (if available) for its own end-to-end encryption. I am less clear on whether AES-NI is used by ganesha for krb5p. Both ends have cpus that indicate support of AES-NI to the OS. I can, and with apologies for it being a pdf, point you at a paper on AES-NI performance: http://www.sce.carleton.ca/faculty/huang/iccae-2020.pdf which shows that their Intel i5-8250U test platform (which is probably disappointingly close in single-thread performance to my 6212U-based servers) will happily push around 900MB/s using AES-NI accelaration, but only around 110MB/s without. The higher number wouldn't be the bottleneck in my setup. The lower number is pretty close to what I am seeing. Unfortunately I can't tell whether AES-NI is actually being used, or find any options that might control its use. Do you have any numbers to indicate what throughput I might expect to get for krb5p, and what hit that might be over krb5? Or any suggestions for checking whether AES-NI is actually in use? Thanks, Jon -- Dr. Jonathan Diprose > Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN ________________________________ From: gpfsug-discuss-bounces at spectrumscale.org [gpfsug-discuss-bounces at spectrumscale.org] on behalf of Madhav Ponamgi1 [mzp at us.ibm.com] Sent: 20 September 2021 13:44 To: gpfsug-discuss at spectrumscale.org Subject: Re: [gpfsug-discuss] gpfsug-discuss Digest, Vol 116, Issue 6 There are 3 flavors of NFS Kerberos (I'm only going to address NFS 4.x): Krb5 - encrypts authentication Krtbi - encrypts authentication and provides checksums (reducing man-in-the-middle attacks) Krb5p - End-to-end encryption with integrity checking The Krb5p protocol provides ultimate security but comes at a cost where all NFS packets will be encrypted (mount authenticated) and with checksums. This can add considerable overhead (for example, using AES-256 is similar to SMB3 signing and sealing). There are AES-NI off-loading engines to reduce this overhead. So it is not surprising to see significant performance drop when using Krb5p versus Krb5. --- Madhav Ponamgi mzp at us.ibm.com (215) 794-6987 http://www.ibm.biz/FOSDesignEngine https://fileobjectsolutiondesignstudio.ibm.com/ Tech Sales Website: w3.ibm.com/w3publisher/ww_storage_tech_sales From: gpfsug-discuss-request at spectrumscale.org To: gpfsug-discuss at spectrumscale.org Date: 09/20/2021 07:00 AM Subject: [EXTERNAL] gpfsug-discuss Digest, Vol 116, Issue 6 Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Send gpfsug-discuss mailing list submissions to gpfsug-discuss at spectrumscale.org To subscribe or unsubscribe via the World Wide Web, visit http://gpfsug.org/mailman/listinfo/gpfsug-discuss or, via email, send a message with subject or body 'help' to gpfsug-discuss-request at spectrumscale.org You can reach the person managing the list at gpfsug-discuss-owner at spectrumscale.org When replying, please edit your Subject line so it is more specific than "Re: Contents of gpfsug-discuss digest..." Today's Topics: 1. nfs krb5p performance (Jon Diprose) ---------------------------------------------------------------------- Message: 1 Date: Mon, 20 Sep 2021 09:58:02 +0000 From: Jon Diprose To: "gpfsug-discuss at spectrumscale.org" Subject: [gpfsug-discuss] nfs krb5p performance Message-ID: Content-Type: text/plain; charset="us-ascii" Hello, We have just started using the nfs protocol with SECTYPE=krb5p and are a little surprised by the performance impact - looks like down to a third of that of SECTYPE=krb5. Would any of you using krb5p be kind enough to share your estimates of impact? Not sure if we have a misconfiguration of setup or expectation. Thanks, Jon -- Dr. Jonathan Diprose Tel: 01865 287873 Research Computing Manager Henry Wellcome Building for Genomic Medicine Roosevelt Drive, Headington, Oxford OX3 7BN ------------------------------ _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss End of gpfsug-discuss Digest, Vol 116, Issue 6 ********************************************** -------------- next part -------------- An HTML attachment was scrubbed... URL: From committee at io500.org Wed Sep 22 16:34:06 2021 From: committee at io500.org (IO500 Committee) Date: Wed, 22 Sep 2021 09:34:06 -0600 Subject: [gpfsug-discuss] =?utf-8?q?IO500_SC=E2=80=9921_Call_for_Submissio?= =?utf-8?q?n?= Message-ID: Stabilization period: Friday, 17th September - Friday, 1st October Submission deadline: Monday, 1st November 2021 AoE The IO500 [1] is now accepting and encouraging submissions for the upcoming 9th semi-annual IO500 list, in conjunction with SC'21. Once again, we are also accepting submissions to the 10 Node Challenge to encourage the submission of small-scale results. The new ranked lists will be announced via live-stream at a virtual session during "The IO500 and the Virtual Institute of I/O" BoF [3]. We hope to see many new results. What's New Since ISC21, the IO500 follows a two-staged approach. First, there will be a two-week stabilization period during which we encourage the community to verify that the benchmark runs properly on a variety of storage systems. During this period the benchmark may be updated based upon feedback from the community. The final benchmark will then be released. We expect that submissions compliant with the rules made during the stabilization period will be valid as a final submission unless a significant defect is found. We are now creating a more detailed schema to describe the hardware and software of the system under test and provide the first set of tools to ease capturing of this information for inclusion with the submission. Further details will be released on the submission page [2]. We are evaluating the inclusion of optional test phases for additional key workloads - split easy/hard find phases, 4KB and 1MB random read/write phases, and concurrent metadata operations. This is called an extended run. At the moment, we collect the information to verify that additional phases do not significantly impact the results of the standard IO500 run. We encourage every participant to submit results from both a standard run and an extended run to facilitate comparisons between the existing and new benchmark phases. In a future release, we may include some or all of these results as part of the standard benchmark. The extended results are not currently included in the scoring of any ranked list. Background The benchmark suite is designed to be easy to run and the community has multiple active support channels to help with any questions. Please note that submissions of all sizes are welcome; the site has customizable sorting, so it is possible to submit on a small system and still get a very good per-client score, for example. Additionally, the list is about much more than just the raw rank; all submissions help the community by collecting and publishing a wider corpus of data. More details below. Following the success of the Top500 in collecting and analyzing historical trends in supercomputer technology and evolution, the IO500 was created in 2017, published its first list at SC17, and has grown continually since then. The need for such an initiative has long been known within High-Performance Computing; however, defining appropriate benchmarks has long been challenging. Despite this challenge, the community, after long and spirited discussion, finally reached a consensus on a suite of benchmarks and a metric for resolving the scores into a single ranking. The multi-fold goals of the benchmark suite are as follows: Maximizing simplicity in running the benchmark suite Encouraging optimization and documentation of tuning parameters for performance Allowing submitters to highlight their "hero run" performance numbers Forcing submitters to simultaneously report performance for challenging IO patterns. Specifically, the benchmark suite includes a hero-run of both IOR and MDTest configured, however, possible to maximize performance and establish an upper-bound for performance. It also includes an IOR and MDTest run with highly constrained parameters forcing a difficult usage pattern in an attempt to determine a lower-bound. Finally, it includes a namespace search as this has been determined to be a highly sought-after feature in HPC storage systems that has historically not been well-measured. Submitters are encouraged to share their tuning insights for publication. The goals of the community are also multi-fold: Gather historical data for the sake of analysis and to aid predictions of storage futures Collect tuning data to share valuable performance optimizations across the community Encourage vendors and designers to optimize for workloads beyond "hero runs" Establish bounded expectations for users, procurers, and administrators 10 Node I/O Challenge The 10 Node Challenge is conducted using the regular IO500 benchmark, however, with the rule that exactly 10 client nodes must be used to run the benchmark. You may use any shared storage with any number of servers. When submitting for the IO500 list, you can opt-in for "Participate in the 10 compute node challenge only", then we will not include the results in the ranked list. Other 10-node node submissions will be included in the full list and in the ranked list. We will announce the result in a separate derived list and in the full list but not on the ranked IO500 list [2]. ------------------------------------ Birds-of-a-feather Once again, we encourage you to submit [2], to join our community, and to attend our BoF "The IO500 and the Virtual Institute of I/O" [3], where we will announce the new IO500 and 10 node challenge lists. The current list includes results from twenty different storage system types and 70 institutions. We hope that the upcoming list grows even more. We look forward to answering any questions or concerns you might have. [1] https://io500.org/ [2] https://io500.org/submission [3] https://io500.org/pages/bof-sc21 -- The IO500 Committee