From arc at b4restore.com Sat Jan 8 22:00:54 2022 From: arc at b4restore.com (=?utf-8?B?QW5kaSBOw7hyIENocmlzdGlhbnNlbg==?=) Date: Sat, 8 Jan 2022 22:00:54 +0000 Subject: [gpfsug-discuss] Has anyone used scale storage with RHEV as POSIX compliant FS and lived to tell the tale? Message-ID: Hi all, Hope its ok to ask this question here.. I was wondering if there was anyone here that has used spectrum scale underneath RHEV/oVirt before? Or still does. That would know how to mount a scale filesystem as a storage domain in RHEV/oVirt? I have a problem with the RHEV host rebooting when trying to mount it. GPFS is installed, configured and mounted on the local host through CLI but not in oVirt. I have tried with these settings in oVirt dashboard: Domain Function: Data Name: name_of_the_domain Storage Type: Posix Compliant FS Path: b4tsz001 (the name of the "device"/"filesystem" created, not an absoluthe path) VFS Type: gpfs Mount Options: rw,relatime,dev=b4tsz001 Using those options, the web interface just tells me it cannot communicate with the storage. If I change it to: Domain Function: Data Name: name_of_the_domain Storage Type: Posix Compliant FS Path: /mnt/b4tsz001 VFS Type: gpfs Mount Options: rw,relatime The oVirt host reboots immediately. No warning just an immediate reboot. I?ve also tried setting owner and permissions on the filesystem after mounting it through GPFS. Same issue.. 😊 chown 36:36 /mnt/b4tsz001 chmod 755 /mnt/b4tsz001 Unfortunately there?s not much use in the logs.. Thanks in advance! Andi Christiansen -------------- next part -------------- An HTML attachment was scrubbed... URL: From s.j.thompson at bham.ac.uk Tue Jan 11 13:56:16 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Tue, 11 Jan 2022 13:56:16 +0000 Subject: [gpfsug-discuss] SSUG::Digital January Day 1 Message-ID: The Spectrum Scale user group digital events return next week with sessions over two days. Day 1: https://www.spectrumscaleug.org/event/digital-user-group-jan-2022-day-1/ We?ll post the join link on the web page above. Simon -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2342 bytes Desc: not available URL: From s.j.thompson at bham.ac.uk Tue Jan 11 13:57:33 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Tue, 11 Jan 2022 13:57:33 +0000 Subject: [gpfsug-discuss] SSUG::Digital January Day 2 Message-ID: The Spectrum Scale user group digital events return next week with sessions over two days. Day 2: https://www.spectrumscaleug.org/event/digital-user-group-jan-2022-day-2/ We?ll post the join link on the web page above. Simon -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2343 bytes Desc: not available URL: From juergen.hannappel at desy.de Thu Jan 13 17:26:12 2022 From: juergen.hannappel at desy.de (Hannappel, Juergen) Date: Thu, 13 Jan 2022 18:26:12 +0100 (CET) Subject: [gpfsug-discuss] 5.1.2.2 changes Message-ID: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Hi, just got notified that 5.1.2.2 is out. What are the changes to 5.1.2.1? https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes does not specify that.... -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 From s.j.thompson at bham.ac.uk Thu Jan 13 17:40:05 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Thu, 13 Jan 2022 17:40:05 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: Try: https://public.dhe.ibm.com/storage/spectrumscale/spectrum_scale_apars_512x.html ? At least that lists the APARs resolved anyway. Given it is a PTF, I would mostly expect the changes to be APAR type fixes? And don?t forget the ?What is new in 5.1.2? talk next week - https://www.spectrumscaleug.org/event/digital-user-group-jan-2022-day-1/ (sure that isn?t specific to the -2 PTF) Simon From: gpfsug-discuss-bounces at spectrumscale.org on behalf of juergen.hannappel at desy.de Date: Thursday, 13 January 2022 at 17:27 To: gpfsug main discussion list Subject: [gpfsug-discuss] 5.1.2.2 changes Hi, just got notified that 5.1.2.2 is out. What are the changes to 5.1.2.1? https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes does not specify that.... -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From mark.bergman at uphs.upenn.edu Thu Jan 13 17:39:08 2022 From: mark.bergman at uphs.upenn.edu (mark.bergman at uphs.upenn.edu) Date: Thu, 13 Jan 2022 12:39:08 -0500 Subject: [gpfsug-discuss] [External] 5.1.2.2 changes In-Reply-To: Your message of "Thu, 13 Jan 2022 18:26:12 +0100." <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: <1377783-1642095548.592187@I9hg.LwGL.0znY> In the message dated: Thu, 13 Jan 2022 18:26:12 +0100, The pithy ruminations from "Hannappel, Juergen" on [[External] [gpfsug-discuss] 5.1.2.2 changes] were: => Hi, => just got notified that 5.1.2.2 is out. => What are the changes to 5.1.2.1? => https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes => does not specify that.... The change that I noticed most was: Repair functionality of mmfsck command in online mode is deprecated The repair functionality of mmfsck command in online mode is no longer available. The report-only operation still works in the online mode. While I know that mmfsck is rarely needed and has gotten much faster, deprecating the ability to do any online repairs seems like a significant regression. => => -- => Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 => _______________________________________________ => gpfsug-discuss mailing list => gpfsug-discuss at spectrumscale.org => http://gpfsug.org/mailman/listinfo/gpfsug-discuss => From juergen.hannappel at desy.de Thu Jan 13 18:16:45 2022 From: juergen.hannappel at desy.de (Hannappel, Juergen) Date: Thu, 13 Jan 2022 19:16:45 +0100 (CET) Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs Message-ID: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Hi, I noticed that whe I read directory entries with the usual readdir() function that for fifos I get in the d_type files a 0, i.e. DT_UNKNOWN while if I try that on a different file system e.g. ext4 I get the expected DT_FIFO. Is this a bug or an expected feature? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 From scale at us.ibm.com Fri Jan 14 07:05:11 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Fri, 14 Jan 2022 12:35:11 +0530 Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs In-Reply-To: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> References: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Message-ID: Hi Steve, Can you please look into the below query from Hannappel. Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479. If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team. From: "Hannappel, Juergen" To: "gpfsug main discussion list" Date: 13-01-2022 11.46 PM Subject: [EXTERNAL] [gpfsug-discuss] struct dirent d_type for fifos on gpfs Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I noticed that whe I read directory entries with the usual readdir() function that for fifos I get in the d_type files a 0, i.e. DT_UNKNOWN while if I try that on a different file system e.g. ext4 I get the expected DT_FIFO. Is this a bug or an expected feature? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: From jonathan.buzzard at strath.ac.uk Fri Jan 14 14:37:50 2022 From: jonathan.buzzard at strath.ac.uk (Jonathan Buzzard) Date: Fri, 14 Jan 2022 14:37:50 +0000 Subject: [gpfsug-discuss] [External] 5.1.2.2 changes In-Reply-To: <1377783-1642095548.592187@I9hg.LwGL.0znY> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> <1377783-1642095548.592187@I9hg.LwGL.0znY> Message-ID: <3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> On 13/01/2022 17:39, mark.bergman at uphs.upenn.edu wrote: [SNIP] > > The change that I noticed most was: > > Repair functionality of mmfsck command in online mode is deprecated > The repair functionality of mmfsck command in online mode is no longer available. The report-only operation still works in the online mode. > > While I know that mmfsck is rarely needed and has gotten much faster, deprecating the ability to do any online repairs seems > like a significant regression. > I would concur with that sentiment, and given it is a significant regression I would suggest that it IBM should give an explanation as to why functionality has been removed. Been able to do online repairs on large file systems is when you need it a complete life saver. It could be the difference between several days of outage vs. end users not realizing there was even a problem. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG From scale at us.ibm.com Fri Jan 14 16:27:26 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Fri, 14 Jan 2022 12:27:26 -0400 Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs In-Reply-To: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> References: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Message-ID: This is expected. GPFS readdir only support d_type: DT_REG, DT_DIR and DT_LNK. All other type will be returned as DT_UNKNOWN. Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479 . If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team. -------------- next part -------------- An HTML attachment was scrubbed... URL: From lgayne at us.ibm.com Fri Jan 14 16:38:19 2022 From: lgayne at us.ibm.com (Lyle Gayne) Date: Fri, 14 Jan 2022 16:38:19 +0000 Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs In-Reply-To: References: , <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Message-ID: An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Image.1__=0ABB0D59DFB540138f9e8a93df938690 at ibm.com.gif Type: image/gif Size: 105 bytes Desc: not available URL: From p.childs at qmul.ac.uk Mon Jan 17 11:29:54 2022 From: p.childs at qmul.ac.uk (Peter Childs) Date: Mon, 17 Jan 2022 11:29:54 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: https://public.dhe.ibm.com/storage/spectrumscale/spectrum_scale_apars_512x.html Is normally the best place to look for changes in PTF releases. Peter Childs ITS Research Storage Queen Mary University Of London ________________________________________ From: gpfsug-discuss-bounces at spectrumscale.org on behalf of Hannappel, Juergen Sent: Thursday, January 13, 2022 5:26 PM To: gpfsug main discussion list Subject: [EXTERNAL] [gpfsug-discuss] 5.1.2.2 changes CAUTION: This email originated from outside of QMUL. Do not click links or open attachments unless you recognise the sender and know the content is safe. Hi, just got notified that 5.1.2.2 is out. What are the changes to 5.1.2.1? https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes does not specify that.... -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss From s.j.thompson at bham.ac.uk Mon Jan 17 12:27:34 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Mon, 17 Jan 2022 12:27:34 +0000 Subject: [gpfsug-discuss] [External] 5.1.2.2 changes In-Reply-To: <3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> <1377783-1642095548.592187@I9hg.LwGL.0znY> <3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> Message-ID: My guess is ? they decided it was unsafe. I?m sure I?ve seen a few release notes that have referred to mmfsck and data corruption. e.g.: https://www.ibm.com/support/pages/ibm-spectrum-scale-alert-all-supported-versions-may-be-affected-issue-online-mmfsck-which-may-result-file-system-corruption So maybe it was classified as too dangerous to leave in the field? Simon From: gpfsug-discuss-bounces at spectrumscale.org on behalf of Jonathan Buzzard Date: Friday, 14 January 2022 at 14:38 To: gpfsug-discuss at spectrumscale.org Subject: Re: [gpfsug-discuss] [External] 5.1.2.2 changes On 13/01/2022 17:39, mark.bergman at uphs.upenn.edu wrote: [SNIP] > > The change that I noticed most was: > > Repair functionality of mmfsck command in online mode is deprecated > The repair functionality of mmfsck command in online mode is no longer available. The report-only operation still works in the online mode. > > While I know that mmfsck is rarely needed and has gotten much faster, deprecating the ability to do any online repairs seems > like a significant regression. > I would concur with that sentiment, and given it is a significant regression I would suggest that it IBM should give an explanation as to why functionality has been removed. Been able to do online repairs on large file systems is when you need it a complete life saver. It could be the difference between several days of outage vs. end users not realizing there was even a problem. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From MDIETZ at de.ibm.com Mon Jan 17 18:21:18 2022 From: MDIETZ at de.ibm.com (Mathias Dietz) Date: Mon, 17 Jan 2022 18:21:18 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: References: , <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de><1377783-1642095548.592187@I9hg.LwGL.0znY><3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> Message-ID: An HTML attachment was scrubbed... URL: From cabrillo at ifca.unican.es Tue Jan 18 16:08:50 2022 From: cabrillo at ifca.unican.es (Iban Cabrillo) Date: Tue, 18 Jan 2022 17:08:50 +0100 (CET) Subject: [gpfsug-discuss] Filesystem sometimes does not correctly inherit acls Message-ID: <575239190.9166807.1642522130898.JavaMail.zimbra@ifca.unican.es> Dear Scalers, We are running 5.1.1-0 version. Since a couple of months we have noticed, that the directory permissions are not inherited correctly even if the default acl is set correctly: For example this is the default acl for a directory (mmgetacl -d): #owner:100 #group:101 user::rwxc group::r-x- other::---- mask::rwxc user:user1:rwxc group:group1:rwx- group:group2:rwx- group:group3:rwx- But sometimes when a new dir is creted under this directory i see this: #owner:100 #group:101 user::rwxc group::r-x- #effective: ---- other::---- mask::---c user:user1:rwxc #effective: ---c group:group1:rwx- #effective: ---- group:group2:rwx- #effective: ---- group:group3:rwx- #effective: ---- Any Idea about this behavior ? Regards, I -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Tue Jan 18 16:56:17 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Tue, 18 Jan 2022 16:56:17 +0000 Subject: [gpfsug-discuss] mmbackup file selections Message-ID: Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. Wrong assumption? Where should I be looking - surely it shouldn't be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: From scl at virginia.edu Tue Jan 18 19:52:12 2022 From: scl at virginia.edu (Losen, Stephen C (scl)) Date: Tue, 18 Jan 2022 19:52:12 +0000 Subject: [gpfsug-discuss] Filesystem sometimes does not correctly inherit acls In-Reply-To: <575239190.9166807.1642522130898.JavaMail.zimbra@ifca.unican.es> References: <575239190.9166807.1642522130898.JavaMail.zimbra@ifca.unican.es> Message-ID: <9B932E92-1FAB-4B9E-9987-6DDBA7716D28@virginia.edu> Hi Iban, What you are seeing is what you get if you call mkdir(2) like this from C mkdir(?dirname?, 0700); or in a python script like this import os os.mkdir(?dirname?, Oo700) Or you could use chmod on the directory like this: chmod 700 dirname All of these modify the ACL mask entry so that it no longer matches the default ACL mask. Notice how everything else in the ACL still matches the default ACL. You can easily set the mask back with chmod g+rwx dirname (assuming that your fileset is configured to allow chmod). Steve Losen Research Computing University of Virginia scl at virginia.edu 434-924-0640 From: on behalf of Iban Cabrillo Reply-To: gpfsug main discussion list Date: Tuesday, January 18, 2022 at 11:26 AM To: gpfsug-discuss Subject: [gpfsug-discuss] Filesystem sometimes does not correctly inherit acls Dear Scalers, We are running 5.1.1-0 version. Since a couple of months we have noticed, that the directory permissions are not inherited correctly even if the default acl is set correctly: For example this is the default acl for a directory (mmgetacl -d): #owner:100 #group:101 user::rwxc group::r-x- other::---- mask::rwxc user:user1:rwxc group:group1:rwx- group:group2:rwx- group:group3:rwx- But sometimes when a new dir is creted under this directory i see this: #owner:100 #group:101 user::rwxc group::r-x- #effective: ---- other::---- mask::---c user:user1:rwxc #effective: ---c group:group1:rwx- #effective: ---- group:group2:rwx- #effective: ---- group:group3:rwx- #effective: ---- Any Idea about this behavior ? Regards, I -------------- next part -------------- An HTML attachment was scrubbed... URL: From scale at us.ibm.com Tue Jan 18 22:53:46 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Tue, 18 Jan 2022 18:53:46 -0400 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. From: "Paul Ward" To: "gpfsug-discuss at spectrumscale.org" Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 2E582126.jpg Type: image/jpeg Size: 5356 bytes Desc: not available URL: From p.ward at nhm.ac.uk Wed Jan 19 11:03:47 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Wed, 19 Jan 2022 11:03:47 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run - on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" > To: "gpfsug-discuss at spectrumscale.org" > Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. Wrong assumption? Where should I be looking - surely it shouldn't be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 105 bytes Desc: image002.gif URL: From scale at us.ibm.com Wed Jan 19 15:08:53 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Wed, 19 Jan 2022 11:08:53 -0400 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2 " right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. From: "Paul Ward" To: "gpfsug main discussion list" Cc: "gpfsug-discuss-bounces at spectrumscale.org" Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" To: "gpfsug-discuss at spectrumscale.org" Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 1A584757.jpg Type: image/jpeg Size: 5356 bytes Desc: not available URL: From skylar2 at uw.edu Wed Jan 19 15:39:55 2022 From: skylar2 at uw.edu (Skylar Thompson) Date: Wed, 19 Jan 2022 07:39:55 -0800 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: <20220119153955.wao2yhyqbr5s2uk2@utumno.gs.washington.edu> Hi Paul, Not to toot my own horn and while the DEBUGmmbackup=2 method definitely does work, you might want to vote for this RFE I put in a month ago to get a more robust "dry run" mode with mmbackup, since guessing how include/exclude rules get translated from SP/dsmc to SS/mmbackup can be challenging: https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=153520 Somewhat selfishly, I think implementing the RFE would benefit you as well. :) On Tue, Jan 18, 2022 at 04:56:17PM +0000, Paul Ward wrote: > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking - surely it shouldn't be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His From heinrich.billich at id.ethz.ch Thu Jan 20 10:55:01 2022 From: heinrich.billich at id.ethz.ch (Billich Heinrich Rainer (ID)) Date: Thu, 20 Jan 2022 10:55:01 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: <86ED32E1-2E2E-4FA6-9313-BA673CAF212B@id.ethz.ch> Hello, I just wonder if I can set a fileset to readonly - or link it as readonly. When I do data migration or finished a project which has it?s own fileset assigned it would be nice if I could just set the fileset to readonly to make sure that nothing and nobody can do any changes. There may be more cases ? Immutability seems overkill, and I can?t revert it Related: If I setup an afm cache fileset in readonly mode ? is this enforced on the cache side or just by convention? The afm gateways need to write to cache anyway, so probably other processes can, too? If anybody could comment and maybe also explain why it?s been designed the way it is? Thank you, Heiner -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5254 bytes Desc: not available URL: From anacreo at gmail.com Thu Jan 20 17:50:21 2022 From: anacreo at gmail.com (Alec) Date: Thu, 20 Jan 2022 09:50:21 -0800 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: <86ED32E1-2E2E-4FA6-9313-BA673CAF212B@id.ethz.ch> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> <86ED32E1-2E2E-4FA6-9313-BA673CAF212B@id.ethz.ch> Message-ID: Not sure if still supported but you could try tagging all the files/directories in a fileset with the immutable attribute using the policy engine. Not sure if that will cover what you need. You can simply use policy engine to add or subtract that attribute at will. It's biggest drawback may be exactly what you're looking for. You could get fancy and mount the gpfs volume twice once read-wrire and a second read-only.. then use mount command to mount over the read only filesystem ontop of the read-write filesystem at the appropriate junctures. You'd have to do this on each node you want affected... So: /FileSys/FileSetA /FileSys/FileSetB Mount FileSys again as /ro/FileSys and share out /ro/FileSys/FileSetA use read only option on mount. Mount /ro/FileSys/FileSetA ontop of /FileSys/FileSetA. I dont have root on my GPFS filesystems so I can't test this out... But would work on most other Unit FSs. Alec On Thu, Jan 20, 2022, 3:10 AM Billich Heinrich Rainer (ID) < heinrich.billich at id.ethz.ch> wrote: > Hello, > > I just wonder if I can set a fileset to readonly - or link it as > readonly. When I do data migration or finished a project which has it?s own > fileset assigned it would be nice if I could just set the fileset to > readonly to make sure that nothing and nobody can do any changes. There may > be more cases ? > > Immutability seems overkill, and I can?t revert it > > Related: If I setup an afm cache fileset in readonly mode ? is this > enforced on the cache side or just by convention? The afm gateways need to > write to cache anyway, so probably other processes can, too? > > If anybody could comment and maybe also explain why it?s been designed the > way it is? > > Thank you, > > Heiner > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Fri Jan 21 14:38:37 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Fri, 21 Jan 2022 14:38:37 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: wc -l mmbackup* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 754 total >From Summary Total number of objects inspected: 755 I can live with a discrepancy of 1. 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa >From Summary Total number of objects expired: 2 That matches wc -l mmbackupC* mmbackupS* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 752 total Summary: Total number of objects backed up: 751 A difference of 1 I can live with. What does Statech stand for? Just this to sort out: Total number of objects failed: 1 I will add: --tsm-errorlog TSMErrorLogFile Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 19 January 2022 15:09 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. From: "Paul Ward" > To: "gpfsug main discussion list" > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run - on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" > To: "gpfsug-discuss at spectrumscale.org" > Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. Wrong assumption? Where should I be looking - surely it shouldn't be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 105 bytes Desc: image002.gif URL: From p.ward at nhm.ac.uk Fri Jan 21 14:38:50 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Fri, 21 Jan 2022 14:38:50 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: <20220119153955.wao2yhyqbr5s2uk2@utumno.gs.washington.edu> References: <20220119153955.wao2yhyqbr5s2uk2@utumno.gs.washington.edu> Message-ID: Got my vote. Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk -----Original Message----- From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of Skylar Thompson Sent: 19 January 2022 15:40 To: gpfsug-discuss at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, Not to toot my own horn and while the DEBUGmmbackup=2 method definitely does work, you might want to vote for this RFE I put in a month ago to get a more robust "dry run" mode with mmbackup, since guessing how include/exclude rules get translated from SP/dsmc to SS/mmbackup can be challenging: https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fdeveloperworks%2Frfe%2Fexecute%3Fuse_case%3DviewRfe%26CR_ID%3D153520&data=04%7C01%7Cp.ward%40nhm.ac.uk%7C1898b9c0b030441112e708d9db61fb44%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637782037020043251%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=WCBNcdWnDtZL%2B8qPahZO0gFFdBAW1X%2BPyL6pI71r804%3D&reserved=0 Somewhat selfishly, I think implementing the RFE would benefit you as well. :) On Tue, Jan 18, 2022 at 04:56:17PM +0000, Paul Ward wrote: > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking - surely it shouldn't be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7C1898b9c0b030441112e708d9db61fb44%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637782037020043251%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=8NvIypofEOlGwDKQpZA6aorxKo5G0hYWt9mi9QZe9x8%3D&reserved=0 -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward%40nhm.ac.uk%7C1898b9c0b030441112e708d9db61fb44%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637782037020043251%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=8NvIypofEOlGwDKQpZA6aorxKo5G0hYWt9mi9QZe9x8%3D&reserved=0 From jesus.mora at 4ks.mx Fri Jan 21 15:17:07 2022 From: jesus.mora at 4ks.mx (Jesus Mora Luna) Date: Fri, 21 Jan 2022 09:17:07 -0600 Subject: [gpfsug-discuss] How do I add a new IP to the configuration? Message-ID: Good day Please can you help me to solve a problem that I have with the modification of an ESS to add a new IP to share the volumes in a new network. The issue is that I already tried to add the IP with the corresponding commands and what it tells me is that it does not find the network, I also tried to add the IP directly to one of the Ethernet interfaces and it does not let me do it. Where can I find or can you share the procedure if it is available to add a new IP Thanking you in advance for your attention to my request, I look forward to your response and comments. Greetings and thanks Jes?s Mora Luna Servicios Continuos System Engineer Jesus.mora at 4ks.mx Oficina 55 41636541 M?vil 55 14853753 Ignacio Allende N? 21 Ampliaci?n Torre Blanca Miguel Hidalgo, CDMX 11289 www.4ks.mx Descripci?n: Descripci?n: Descripci?n: https://docs.google.com/uc?export=download&id=11HlTv0TDj5BTu4hVCM-2rNkHWnmxA H5E&revid=0ByZwGRTUTp29c0VQdWVKWVRaT0dkUEVDK3hRckc4MCtJWVZnPQ Descripci?n: Descripci?n: Descripci?n: https://docs.google.com/uc?export=download&id=1NomENnxEOLpSFfGyStQMonSuz83p3 3aL&revid=0ByZwGRTUTp29NTlqVzMyMEVhQnNnNUt5eGpzY3M3MGNGeXZ3PQ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 16220 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 49179 bytes Desc: not available URL: From anacreo at gmail.com Sat Jan 22 00:02:10 2022 From: anacreo at gmail.com (Alec) Date: Fri, 21 Jan 2022 16:02:10 -0800 Subject: [gpfsug-discuss] How do I add a new IP to the configuration? In-Reply-To: References: Message-ID: It sounds like you are attempting to add multiple networks to the same interface. So if your existing ESS is not on a network that is routed to your new clients then you'll need to do one of the following: 1) Establish routing between the new ESS client IP's and your existing ESS servers. 2) Add a Virtual Interface with that network's VLAN on it (or the VLAN of a network that is routed to the new client). 3) Configure new interfaces on the ESS with the new network. No one else answered, and unfortunately I don't own an ESS so I can't tell you had to do step #2. But typically a scenario would look like this: ESS 1st interface IP is 192.168.1.150 subnetmask 255.255.0.0 and default gateway 192.168.0.1 With this anything in the 192.168.x.x address space could be added to the 1st interface as they are all local to that address. Now you're presented with needing to offer data to something on IP 10.1.20.30, and 192.168.0.1 doesn't know how to reach that interface, or we don't want that data flowing across routes. If we don't want to add another physical interface to ESS we have to get into VLAN configuration (Virtual LAN)... Now we say VLAN 0 is going to be 192.168.0.0 network and it's the default network (anything not tagged goes there)... And the network team has 10.0.0.0 network on VLAN 10... So we ask the network team to add VLAN 10 to our 1st interface. It should now have VLAN 0 and VLAN 10. I don't know how but somehow in the ESS you're now going to have to add a new virtual adapter that is bound to VLAN 10... and since the first interface didn't have VLAN's it will continue to use the now default VLAN 0. Once we have that 2nd virtual adaptor on VLAN 10 we can define it as... 2nd interface (still on the 1st physical interface, but a virtual adapter) IP is 10.240.1.150 (let's say 10.240 is going to be the ESS's portion of the 10 network).. and we define the subnetmask 255.0.0.0 and maybe no route... It really needs for your network team to define how they want you to proceed and then figure out how the ESS can be configured to consume that network design. What you can't do is straight up put two IP's from different subnets on the same interface. Essentially the logical interface will look at it's IP, it's Subnet combine the values with your new IP and say, hey wrong network. Alec On Fri, Jan 21, 2022, 7:17 AM Jesus Mora Luna wrote: > Good day > > > > Please can you help me to solve a problem that I have with the > modification of an ESS to add a new IP to share the volumes in a new > network. > > > > The issue is that I already tried to add the IP with the corresponding > commands and what it tells me is that it does not find the network, I also > tried to add the IP directly to one of the Ethernet interfaces and it does > not let me do it. > > > > Where can I find or can you share the procedure if it is available to add > a new IP > > > > Thanking you in advance for your attention to my request, I look forward > to your response and comments. > > > > Greetings and thanks > > > > *Jes?s Mora Luna * > > Servicios Continuos > > System Engineer > > Jesus.mora at 4ks.mx > > Oficina 55 41636541 > > M?vil 55 14853753 > > Ignacio Allende N? 21 > > Ampliaci?n Torre Blanca Miguel Hidalgo, CDMX 11289 > > www.4ks.mx > > > > [image: Descripci?n: Descripci?n: Descripci?n: > https://docs.google.com/uc?export=download&id=11HlTv0TDj5BTu4hVCM-2rNkHWnmxAH5E&revid=0ByZwGRTUTp29c0VQdWVKWVRaT0dkUEVDK3hRckc4MCtJWVZnPQ] > > > > [image: Descripci?n: Descripci?n: Descripci?n: > https://docs.google.com/uc?export=download&id=1NomENnxEOLpSFfGyStQMonSuz83p33aL&revid=0ByZwGRTUTp29NTlqVzMyMEVhQnNnNUt5eGpzY3M3MGNGeXZ3PQ] > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 16220 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 49179 bytes Desc: not available URL: From scale at us.ibm.com Sat Jan 22 00:35:24 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Fri, 21 Jan 2022 20:35:24 -0400 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Hi Paul, Instead of calculating *.ix.* files, please look at a list file in these directories. updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. From: "Paul Ward" To: "gpfsug main discussion list" Cc: "gpfsug-discuss-bounces at spectrumscale.org" Date: 01/21/2022 09:38 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: wc -l mmbackup* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 754 total From Summary Total number of objects inspected: 755 I can live with a discrepancy of 1. 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa From Summary Total number of objects expired: 2 That matches wc -l mmbackupC* mmbackupS* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 752 total Summary: Total number of objects backed up: 751 A difference of 1 I can live with. What does Statech stand for? Just this to sort out: Total number of objects failed: 1 I will add: --tsm-errorlog TSMErrorLogFile Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 19 January 2022 15:09 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. From: "Paul Ward" To: "gpfsug main discussion list" Cc: "gpfsug-discuss-bounces at spectrumscale.org" < gpfsug-discuss-bounces at spectrumscale.org> Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated From: gpfsug-discuss-bounces at spectrumscale.org < gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" To: "gpfsug-discuss at spectrumscale.org" Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 29915401.jpg Type: image/jpeg Size: 5356 bytes Desc: not available URL: From spectrumscale at kiranghag.com Sat Jan 22 05:26:53 2022 From: spectrumscale at kiranghag.com (KG) Date: Sat, 22 Jan 2022 10:56:53 +0530 Subject: [gpfsug-discuss] How do I add a new IP to the configuration? In-Reply-To: References: Message-ID: Hi The CES service on protocol nodes binds to all available addresses including fixed IP addresses. You would need to add a virtual interface on existing interface (or setup a new interface) and assign IP to it (from the new subnet that you wish to add). After that add IPs to CES pool. The CES pool will then attach to newly added interface. You may have to restart the CES service/protocol node daemon. On Sat, Jan 22, 2022 at 5:32 AM Alec wrote: > It sounds like you are attempting to add multiple networks to the same > interface. > > So if your existing ESS is not on a network that is routed to your new > clients then you'll need to do one of the following: > > 1) Establish routing between the new ESS client IP's and your existing ESS > servers. > 2) Add a Virtual Interface with that network's VLAN on it (or the VLAN of > a network that is routed to the new client). > 3) Configure new interfaces on the ESS with the new network. > > No one else answered, and unfortunately I don't own an ESS so I can't tell > you had to do step #2. > > But typically a scenario would look like this: > > ESS > 1st interface IP is 192.168.1.150 subnetmask 255.255.0.0 and default > gateway 192.168.0.1 > > With this anything in the 192.168.x.x address space could be added to > the 1st interface as they are all local to that address. > > Now you're presented with needing to offer data to something on IP > 10.1.20.30, and 192.168.0.1 doesn't know how to reach that interface, or we > don't want that data flowing across routes. > > If we don't want to add another physical interface to ESS we have to get > into VLAN configuration (Virtual LAN)... > > Now we say VLAN 0 is going to be 192.168.0.0 network and it's the > default network (anything not tagged goes there)... > And the network team has 10.0.0.0 network on VLAN 10... So we ask the > network team to add VLAN 10 to our 1st interface. It should now have VLAN > 0 and VLAN 10. > > I don't know how but somehow in the ESS you're now going to have to add > a new virtual adapter that is bound to VLAN 10... and since the first > interface didn't have VLAN's it will continue to use the now default VLAN 0. > > Once we have that 2nd virtual adaptor on VLAN 10 we can define it as... > 2nd interface (still on the 1st physical interface, but a virtual > adapter) IP is 10.240.1.150 (let's say 10.240 is going to be the ESS's > portion of the 10 network).. and we define the subnetmask 255.0.0.0 and > maybe no route... > > It really needs for your network team to define how they want you to > proceed and then figure out how the ESS can be configured to consume that > network design. > > What you can't do is straight up put two IP's from different subnets on > the same interface. Essentially the logical interface will look at it's > IP, it's Subnet combine the values with your new IP and say, hey wrong > network. > > Alec > > On Fri, Jan 21, 2022, 7:17 AM Jesus Mora Luna wrote: > >> Good day >> >> >> >> Please can you help me to solve a problem that I have with the >> modification of an ESS to add a new IP to share the volumes in a new >> network. >> >> >> >> The issue is that I already tried to add the IP with the corresponding >> commands and what it tells me is that it does not find the network, I also >> tried to add the IP directly to one of the Ethernet interfaces and it does >> not let me do it. >> >> >> >> Where can I find or can you share the procedure if it is available to add >> a new IP >> >> >> >> Thanking you in advance for your attention to my request, I look forward >> to your response and comments. >> >> >> >> Greetings and thanks >> >> >> >> *Jes?s Mora Luna * >> >> Servicios Continuos >> >> System Engineer >> >> Jesus.mora at 4ks.mx >> >> Oficina 55 41636541 >> >> M?vil 55 14853753 >> >> Ignacio Allende N? 21 >> >> Ampliaci?n Torre Blanca Miguel Hidalgo, CDMX 11289 >> >> www.4ks.mx >> >> >> >> [image: Descripci?n: Descripci?n: Descripci?n: >> https://docs.google.com/uc?export=download&id=11HlTv0TDj5BTu4hVCM-2rNkHWnmxAH5E&revid=0ByZwGRTUTp29c0VQdWVKWVRaT0dkUEVDK3hRckc4MCtJWVZnPQ] >> >> >> >> [image: Descripci?n: Descripci?n: Descripci?n: >> https://docs.google.com/uc?export=download&id=1NomENnxEOLpSFfGyStQMonSuz83p33aL&revid=0ByZwGRTUTp29NTlqVzMyMEVhQnNnNUt5eGpzY3M3MGNGeXZ3PQ] >> >> >> _______________________________________________ >> gpfsug-discuss mailing list >> gpfsug-discuss at spectrumscale.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss >> > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Mon Jan 24 14:31:54 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Mon, 24 Jan 2022 14:31:54 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Those directories are empty Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 22 January 2022 00:35 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, Instead of calculating *.ix.* files, please look at a list file in these directories. updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. From: "Paul Ward" > To: "gpfsug main discussion list" > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > Date: 01/21/2022 09:38 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: wc -l mmbackup* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 754 total >From Summary Total number of objects inspected: 755 I can live with a discrepancy of 1. 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa >From Summary Total number of objects expired: 2 That matches wc -l mmbackupC* mmbackupS* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 752 total Summary: Total number of objects backed up: 751 A difference of 1 I can live with. What does Statech stand for? Just this to sort out: Total number of objects failed: 1 I will add: --tsm-errorlog TSMErrorLogFile Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale Sent: 19 January 2022 15:09 To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. From: "Paul Ward" > To: "gpfsug main discussion list" > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" > To: "gpfsug-discuss at spectrumscale.org" > Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 105 bytes Desc: image002.gif URL: From skylar2 at uw.edu Mon Jan 24 15:36:31 2022 From: skylar2 at uw.edu (Skylar Thompson) Date: Mon, 24 Jan 2022 07:36:31 -0800 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> Hi Paul, Did you look for dot files? At least for us on 5.0.5 there's a .list.1. file while the backups are running: /gpfs/grc6/.mmbackupCfg/updatedFiles/: -r-------- 1 root nickers 6158526821 Jan 23 18:28 .list.1.gpfs-grc6 /gpfs/grc6/.mmbackupCfg/expiredFiles/: -r-------- 1 root nickers 85862211 Jan 23 18:28 .list.1.gpfs-grc6 On Mon, Jan 24, 2022 at 02:31:54PM +0000, Paul Ward wrote: > Those directories are empty > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale > Sent: 22 January 2022 00:35 > To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > Hi Paul, > > Instead of calculating *.ix.* files, please look at a list file in these directories. > > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta info update > expiredFiles : cantains a file that lists all candidates for expiration > > Regards, The Spectrum Scale (GPFS) team > > ------------------------------------------------------------------------------------------------------------------ > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > > Date: 01/21/2022 09:38 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > ________________________________ > > > > Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart > This Message Is From an External Sender > This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you > > Right in the command line seems to have worked. > At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder > > Checking how many entries in these files compared to the Summary: > wc -l mmbackup* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 754 total > From Summary > Total number of objects inspected: 755 > I can live with a discrepancy of 1. > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > From Summary > Total number of objects expired: 2 > That matches > > wc -l mmbackupC* mmbackupS* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 752 total > Summary: > Total number of objects backed up: 751 > > A difference of 1 I can live with. > > What does Statech stand for? > > Just this to sort out: > Total number of objects failed: 1 > I will add: > --tsm-errorlog TSMErrorLogFile > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale > Sent: 19 January 2022 15:09 > To: gpfsug main discussion list > > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > This is to set environment for mmbackup. > If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. > e.g) in your script > .... > export DEBUGmmbackup=2 > mmbackup .... > > Or, you can set it in the same command line like > DEBUGmmbackup=2 mmbackup .... > > Regards, The Spectrum Scale (GPFS) team > > ------------------------------------------------------------------------------------------------------------------ > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > > Date: 01/19/2022 06:04 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > ________________________________ > > > > > Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart > This Message Is From an External Sender > This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you. > > We run a script on all our nodes that checks to see if they are the cluster manager. > If they are, then they take responsibility to start the backup script. > The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. > > Where does this command belong? > I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale > Sent: 18 January 2022 22:54 > To: gpfsug main discussion list > > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > Hi Paul, > > If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). > In .mmbackupCfg directory, there are 3 directories: > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta info update > expiredFiles : cantains a file that lists all candidates for expiration > > > Regards, The Spectrum Scale (GPFS) team > > ------------------------------------------------------------------------------------------------------------------ > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. > > From: "Paul Ward" > > To: "gpfsug-discuss at spectrumscale.org" > > Date: 01/18/2022 11:56 AM > Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > ________________________________ > > > > > > Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart > This Message Is From an External Sender > This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His From Alifiya.Kantawala at ibm.com Tue Jan 25 15:05:02 2022 From: Alifiya.Kantawala at ibm.com (Alifiya Kantawala) Date: Tue, 25 Jan 2022 15:05:02 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes Message-ID: An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Image.16431227650740.png Type: image/png Size: 75092 bytes Desc: not available URL: From p.ward at nhm.ac.uk Wed Jan 26 15:55:48 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Wed, 26 Jan 2022 15:55:48 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> References: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> Message-ID: Good call! Yes they are dot files. New issue. Mmbackup seems to be backup up the same files over and over without them changing: areas are being backed up multiple times. The example below is a co-resident file, the only thing that has changed since it was created 20/10/21, is the file has been accessed for backup. This file is in the 'changed' list in mmbackup: This list has just been created: -rw-r--r--. 1 root root 6591914 Jan 26 11:12 mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa Listing the last few files in the file (selecting the last one) 11:17:52 [root at scale-sk-pn-1 .mmbackupCfg]# tail mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604556977.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557039.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557102.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557164.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557226.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557288.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557351.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557413.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557476.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" Check the file stats (access time just before last backup) 11:18:05 [root at scale-sk-pn-1 .mmbackupCfg]# stat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" File: '/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png' Size: 545 Blocks: 32 IO Block: 4194304 regular file Device: 2bh/43d Inode: 212618897 Links: 1 Access: (0644/-rw-r--r--) Uid: (1399613896/NHM\edwab) Gid: (1399647564/NHM\dg-mbl-urban-nature-project-rw) Context: unconfined_u:object_r:unlabeled_t:s0 Access: 2022-01-25 06:40:58.334961446 +0000 Modify: 2020-12-01 15:20:40.122053000 +0000 Change: 2021-10-20 17:55:18.265746459 +0100 Birth: - Check if migrated 11:18:16 [root at scale-sk-pn-1 .mmbackupCfg]# dsmls "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" File name : /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png On-line size : 545 Used blocks : 16 Data Version : 1 Meta Version : 1 State : Co-resident Container Index : 1 Base Name : 34C0B77D20194B0B.EACEB2055F6CAA58.56D56C5F140C8C9D.0000000000000000.2197396D.000000000CAC4E91 Check if immutable 11:18:26 [root at scale-sk-pn-1 .mmbackupCfg]# mstat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" file name: /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png metadata replication: 2 max 2 data replication: 2 max 2 immutable: no appendOnly: no flags: storage pool name: data fileset name: hpc-workspaces-fset snapshot name: creation time: Wed Oct 20 17:55:18 2021 Misc attributes: ARCHIVE Encrypted: no Check active and inactive backups (it was backed up yesterday) 11:18:52 [root at scale-sk-pn-1 .mmbackupCfg]# dsmcqbi "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" IBM Spectrum Protect Command Line Backup-Archive Client Interface Client Version 8, Release 1, Level 10.0 Client date/time: 01/26/2022 11:19:02 (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. Node Name: SC-PN-SK-01 Session established with server TSM-JERSEY: Windows Server Version 8, Release 1, Level 10.100 Server date/time: 01/26/2022 11:19:02 Last access: 01/26/2022 11:07:05 Accessing as node: SCALE Size Backup Date Mgmt Class A/I File ---- ----------- ---------- --- ---- 545 B 01/25/2022 06:41:17 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png It will be backed up again shortly, why? And it was backed up again: # dsmcqbi /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png IBM Spectrum Protect Command Line Backup-Archive Client Interface Client Version 8, Release 1, Level 10.0 Client date/time: 01/26/2022 15:54:09 (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. Node Name: SC-PN-SK-01 Session established with server TSM-JERSEY: Windows Server Version 8, Release 1, Level 10.100 Server date/time: 01/26/2022 15:54:10 Last access: 01/26/2022 15:30:03 Accessing as node: SCALE Size Backup Date Mgmt Class A/I File ---- ----------- ---------- --- ---- 545 B 01/26/2022 12:23:02 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/25/2022 06:41:17 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk -----Original Message----- From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of Skylar Thompson Sent: 24 January 2022 15:37 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, Did you look for dot files? At least for us on 5.0.5 there's a .list.1. file while the backups are running: /gpfs/grc6/.mmbackupCfg/updatedFiles/: -r-------- 1 root nickers 6158526821 Jan 23 18:28 .list.1.gpfs-grc6 /gpfs/grc6/.mmbackupCfg/expiredFiles/: -r-------- 1 root nickers 85862211 Jan 23 18:28 .list.1.gpfs-grc6 On Mon, Jan 24, 2022 at 02:31:54PM +0000, Paul Ward wrote: > Those directories are empty > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum > Scale > Sent: 22 January 2022 00:35 > To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > Hi Paul, > > Instead of calculating *.ix.* files, please look at a list file in these directories. > > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta > info update expiredFiles : cantains a file that lists all candidates > for expiration > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > org>> > Cc: > "gpfsug-discuss-bounces at spectrumscale.org s at spectrumscale.org>" > s at spectrumscale.org>> > Date: 01/21/2022 09:38 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > by: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > > ________________________________ > > > > Thank you Right in the command line seems to have worked. At the end > of the script I now copy the contents of the .mmbackupCfg folder to a > date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you > > Right in the command line seems to have worked. > At the end of the script I now copy the contents of the .mmbackupCfg > folder to a date stamped logging folder > > Checking how many entries in these files compared to the Summary: > wc -l mmbackup* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 754 total > From Summary > Total number of objects inspected: 755 > I can live with a discrepancy of 1. > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > From Summary > Total number of objects expired: 2 > That matches > > wc -l mmbackupC* mmbackupS* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 752 total > Summary: > Total number of objects backed up: 751 > > A difference of 1 I can live with. > > What does Statech stand for? > > Just this to sort out: > Total number of objects failed: 1 > I will add: > --tsm-errorlog TSMErrorLogFile > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > Sent: 19 January 2022 15:09 > To: gpfsug main discussion list > org>> > Cc: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > This is to set environment for mmbackup. > If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. > e.g) in your script > .... > export DEBUGmmbackup=2 > mmbackup .... > > Or, you can set it in the same command line like > DEBUGmmbackup=2 mmbackup .... > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > org>> > Cc: > "gpfsug-discuss-bounces at spectrumscale.org s at spectrumscale.org>" > s at spectrumscale.org>> > Date: 01/19/2022 06:04 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > by: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > > ________________________________ > > > > > Thank you. We run a script on all our nodes that checks to see if they > are the cluster manager. If they are, then they take responsibility to > start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you. > > We run a script on all our nodes that checks to see if they are the cluster manager. > If they are, then they take responsibility to start the backup script. > The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. > > Where does this command belong? > I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > Sent: 18 January 2022 22:54 > To: gpfsug main discussion list > org>> > Cc: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > Subject: Re: [gpfsug-discuss] mmbackup file selections > > Hi Paul, > > If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). > In .mmbackupCfg directory, there are 3 directories: > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta > info update expiredFiles : cantains a file that lists all candidates > for expiration > > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. > > From: "Paul Ward" > > To: > "gpfsug-discuss at spectrumscale.org org>" > org>> > Date: 01/18/2022 11:56 AM > Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > > ________________________________ > > > > > > Hi, I am trying to work out what files have been sent to backup using > mmbackup. I have increased the -L value from 3 up to 6 but only seem > to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > =0 fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > d4c8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8ey > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > 0&sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reser > ved=0> > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > =0 fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8ey > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > 0&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&res > erved=0> > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > ed=0 gpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp. > ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437f > a0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8 > eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2 > 000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&r > eserved=0> > > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > ed=0 -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserved=0 From skylar2 at uw.edu Wed Jan 26 16:50:13 2022 From: skylar2 at uw.edu (Skylar Thompson) Date: Wed, 26 Jan 2022 08:50:13 -0800 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> Message-ID: <20220126165013.z7vo3m4d666el7wr@utumno.gs.washington.edu> Awesome, glad that you found them (I missed them the first time too). As for the anomalous changed files, do you have these options set in your client option file? skipacl yes skipaclupdatecheck yes updatectime yes We had similar problems where metadata and ACL updates were interpreted as data changes by mmbackup/dsmc. We also have a case open with IBM where mmbackup will both expire and backup a file in the same run, even in the absence of mtime changes, but it's unclear whether that's program error or something with our include/exclude rules. I'd be curious if you're running into that as well. On Wed, Jan 26, 2022 at 03:55:48PM +0000, Paul Ward wrote: > Good call! > > Yes they are dot files. > > > New issue. > > Mmbackup seems to be backup up the same files over and over without them changing: > areas are being backed up multiple times. > The example below is a co-resident file, the only thing that has changed since it was created 20/10/21, is the file has been accessed for backup. > This file is in the 'changed' list in mmbackup: > > This list has just been created: > -rw-r--r--. 1 root root 6591914 Jan 26 11:12 mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa > > Listing the last few files in the file (selecting the last one) > 11:17:52 [root at scale-sk-pn-1 .mmbackupCfg]# tail mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604556977.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557039.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557102.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557164.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557226.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557288.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557351.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557413.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557476.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > > Check the file stats (access time just before last backup) > 11:18:05 [root at scale-sk-pn-1 .mmbackupCfg]# stat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > File: '/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png' > Size: 545 Blocks: 32 IO Block: 4194304 regular file > Device: 2bh/43d Inode: 212618897 Links: 1 > Access: (0644/-rw-r--r--) Uid: (1399613896/NHM\edwab) Gid: (1399647564/NHM\dg-mbl-urban-nature-project-rw) > Context: unconfined_u:object_r:unlabeled_t:s0 > Access: 2022-01-25 06:40:58.334961446 +0000 > Modify: 2020-12-01 15:20:40.122053000 +0000 > Change: 2021-10-20 17:55:18.265746459 +0100 > Birth: - > > Check if migrated > 11:18:16 [root at scale-sk-pn-1 .mmbackupCfg]# dsmls "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > File name : /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > On-line size : 545 > Used blocks : 16 > Data Version : 1 > Meta Version : 1 > State : Co-resident > Container Index : 1 > Base Name : 34C0B77D20194B0B.EACEB2055F6CAA58.56D56C5F140C8C9D.0000000000000000.2197396D.000000000CAC4E91 > > Check if immutable > 11:18:26 [root at scale-sk-pn-1 .mmbackupCfg]# mstat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > file name: /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > metadata replication: 2 max 2 > data replication: 2 max 2 > immutable: no > appendOnly: no > flags: > storage pool name: data > fileset name: hpc-workspaces-fset > snapshot name: > creation time: Wed Oct 20 17:55:18 2021 > Misc attributes: ARCHIVE > Encrypted: no > > Check active and inactive backups (it was backed up yesterday) > 11:18:52 [root at scale-sk-pn-1 .mmbackupCfg]# dsmcqbi "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > IBM Spectrum Protect > Command Line Backup-Archive Client Interface > Client Version 8, Release 1, Level 10.0 > Client date/time: 01/26/2022 11:19:02 > (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. > > Node Name: SC-PN-SK-01 > Session established with server TSM-JERSEY: Windows > Server Version 8, Release 1, Level 10.100 > Server date/time: 01/26/2022 11:19:02 Last access: 01/26/2022 11:07:05 > > Accessing as node: SCALE > Size Backup Date Mgmt Class A/I File > ---- ----------- ---------- --- ---- > 545 B 01/25/2022 06:41:17 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > > > It will be backed up again shortly, why? > > And it was backed up again: > # dsmcqbi /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > IBM Spectrum Protect > Command Line Backup-Archive Client Interface > Client Version 8, Release 1, Level 10.0 > Client date/time: 01/26/2022 15:54:09 > (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. > > Node Name: SC-PN-SK-01 > Session established with server TSM-JERSEY: Windows > Server Version 8, Release 1, Level 10.100 > Server date/time: 01/26/2022 15:54:10 Last access: 01/26/2022 15:30:03 > > Accessing as node: SCALE > Size Backup Date Mgmt Class A/I File > ---- ----------- ---------- --- ---- > 545 B 01/26/2022 12:23:02 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/25/2022 06:41:17 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > > > -----Original Message----- > From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of Skylar Thompson > Sent: 24 January 2022 15:37 > To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > Hi Paul, > > Did you look for dot files? At least for us on 5.0.5 there's a .list.1. file while the backups are running: > > /gpfs/grc6/.mmbackupCfg/updatedFiles/: > -r-------- 1 root nickers 6158526821 Jan 23 18:28 .list.1.gpfs-grc6 > /gpfs/grc6/.mmbackupCfg/expiredFiles/: > -r-------- 1 root nickers 85862211 Jan 23 18:28 .list.1.gpfs-grc6 > > On Mon, Jan 24, 2022 at 02:31:54PM +0000, Paul Ward wrote: > > Those directories are empty > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > > > From: gpfsug-discuss-bounces at spectrumscale.org > > On Behalf Of IBM Spectrum > > Scale > > Sent: 22 January 2022 00:35 > > To: gpfsug main discussion list > > Cc: gpfsug-discuss-bounces at spectrumscale.org > > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > > > > Hi Paul, > > > > Instead of calculating *.ix.* files, please look at a list file in these directories. > > > > updatedFiles : contains a file that lists all candidates for backup > > statechFiles : cantains a file that lists all candidates for meta > > info update expiredFiles : cantains a file that lists all candidates > > for expiration > > > > Regards, The Spectrum Scale (GPFS) team > > > > ---------------------------------------------------------------------- > > -------------------------------------------- > > > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > > > > [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. > > > > From: "Paul Ward" > > > To: "gpfsug main discussion list" > > > org>> > > Cc: > > "gpfsug-discuss-bounces at spectrumscale.org > s at spectrumscale.org>" > > > s at spectrumscale.org>> > > Date: 01/21/2022 09:38 AM > > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > > by: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > > ________________________________ > > > > > > > > Thank you Right in the command line seems to have worked. At the end > > of the script I now copy the contents of the .mmbackupCfg folder to a > > date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > > ZjQcmQRYFpfptBannerEnd > > Thank you > > > > Right in the command line seems to have worked. > > At the end of the script I now copy the contents of the .mmbackupCfg > > folder to a date stamped logging folder > > > > Checking how many entries in these files compared to the Summary: > > wc -l mmbackup* > > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > > 754 total > > From Summary > > Total number of objects inspected: 755 > > I can live with a discrepancy of 1. > > > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > > From Summary > > Total number of objects expired: 2 > > That matches > > > > wc -l mmbackupC* mmbackupS* > > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > > 752 total > > Summary: > > Total number of objects backed up: 751 > > > > A difference of 1 I can live with. > > > > What does Statech stand for? > > > > Just this to sort out: > > Total number of objects failed: 1 > > I will add: > > --tsm-errorlog TSMErrorLogFile > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > > > From: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > > Sent: 19 January 2022 15:09 > > To: gpfsug main discussion list > > > org>> > > Cc: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > > > > This is to set environment for mmbackup. > > If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. > > e.g) in your script > > .... > > export DEBUGmmbackup=2 > > mmbackup .... > > > > Or, you can set it in the same command line like > > DEBUGmmbackup=2 mmbackup .... > > > > Regards, The Spectrum Scale (GPFS) team > > > > ---------------------------------------------------------------------- > > -------------------------------------------- > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > > [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. > > > > From: "Paul Ward" > > > To: "gpfsug main discussion list" > > > org>> > > Cc: > > "gpfsug-discuss-bounces at spectrumscale.org > s at spectrumscale.org>" > > > s at spectrumscale.org>> > > Date: 01/19/2022 06:04 AM > > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > > by: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > > ________________________________ > > > > > > > > > > Thank you. We run a script on all our nodes that checks to see if they > > are the cluster manager. If they are, then they take responsibility to > > start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > > ZjQcmQRYFpfptBannerEnd > > Thank you. > > > > We run a script on all our nodes that checks to see if they are the cluster manager. > > If they are, then they take responsibility to start the backup script. > > The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. > > > > Where does this command belong? > > I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > > > From: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > > Sent: 18 January 2022 22:54 > > To: gpfsug main discussion list > > > org>> > > Cc: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > > Hi Paul, > > > > If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). > > In .mmbackupCfg directory, there are 3 directories: > > updatedFiles : contains a file that lists all candidates for backup > > statechFiles : cantains a file that lists all candidates for meta > > info update expiredFiles : cantains a file that lists all candidates > > for expiration > > > > > > Regards, The Spectrum Scale (GPFS) team > > > > ---------------------------------------------------------------------- > > -------------------------------------------- > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > > [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. > > > > From: "Paul Ward" > > > To: > > "gpfsug-discuss at spectrumscale.org > org>" > > > org>> > > Date: 01/18/2022 11:56 AM > > Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > > ________________________________ > > > > > > > > > > > > Hi, I am trying to work out what files have been sent to backup using > > mmbackup. I have increased the -L value from 3 up to 6 but only seem > > to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > > ZjQcmQRYFpfptBannerEnd > > Hi, > > > > I am trying to work out what files have been sent to backup using mmbackup. > > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > > > I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. > > > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. > > Wrong assumption? > > > > Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > > =0 > fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > > d4c8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8ey > > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > > 0&sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reser > > ved=0> > > > > > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > > =0 > fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > > d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8ey > > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > > 0&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&res > > erved=0> > > > > > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > > ed=0 > gpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp. > > ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437f > > a0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8 > > eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2 > > 000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&r > > eserved=0> > > > > > > > > > > > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > > ed=0 > > > -- > -- Skylar Thompson (skylar2 at u.washington.edu) > -- Genome Sciences Department (UW Medicine), System Administrator > -- Foege Building S046, (206)-685-7354 > -- Pronouns: He/Him/His > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserved=0 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His From arc at b4restore.com Sat Jan 8 22:00:54 2022 From: arc at b4restore.com (=?utf-8?B?QW5kaSBOw7hyIENocmlzdGlhbnNlbg==?=) Date: Sat, 8 Jan 2022 22:00:54 +0000 Subject: [gpfsug-discuss] Has anyone used scale storage with RHEV as POSIX compliant FS and lived to tell the tale? Message-ID: Hi all, Hope its ok to ask this question here.. I was wondering if there was anyone here that has used spectrum scale underneath RHEV/oVirt before? Or still does. That would know how to mount a scale filesystem as a storage domain in RHEV/oVirt? I have a problem with the RHEV host rebooting when trying to mount it. GPFS is installed, configured and mounted on the local host through CLI but not in oVirt. I have tried with these settings in oVirt dashboard: Domain Function: Data Name: name_of_the_domain Storage Type: Posix Compliant FS Path: b4tsz001 (the name of the "device"/"filesystem" created, not an absoluthe path) VFS Type: gpfs Mount Options: rw,relatime,dev=b4tsz001 Using those options, the web interface just tells me it cannot communicate with the storage. If I change it to: Domain Function: Data Name: name_of_the_domain Storage Type: Posix Compliant FS Path: /mnt/b4tsz001 VFS Type: gpfs Mount Options: rw,relatime The oVirt host reboots immediately. No warning just an immediate reboot. I?ve also tried setting owner and permissions on the filesystem after mounting it through GPFS. Same issue.. 😊 chown 36:36 /mnt/b4tsz001 chmod 755 /mnt/b4tsz001 Unfortunately there?s not much use in the logs.. Thanks in advance! Andi Christiansen -------------- next part -------------- An HTML attachment was scrubbed... URL: From s.j.thompson at bham.ac.uk Tue Jan 11 13:56:16 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Tue, 11 Jan 2022 13:56:16 +0000 Subject: [gpfsug-discuss] SSUG::Digital January Day 1 Message-ID: The Spectrum Scale user group digital events return next week with sessions over two days. Day 1: https://www.spectrumscaleug.org/event/digital-user-group-jan-2022-day-1/ We?ll post the join link on the web page above. Simon -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2342 bytes Desc: not available URL: From s.j.thompson at bham.ac.uk Tue Jan 11 13:57:33 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Tue, 11 Jan 2022 13:57:33 +0000 Subject: [gpfsug-discuss] SSUG::Digital January Day 2 Message-ID: The Spectrum Scale user group digital events return next week with sessions over two days. Day 2: https://www.spectrumscaleug.org/event/digital-user-group-jan-2022-day-2/ We?ll post the join link on the web page above. Simon -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2343 bytes Desc: not available URL: From juergen.hannappel at desy.de Thu Jan 13 17:26:12 2022 From: juergen.hannappel at desy.de (Hannappel, Juergen) Date: Thu, 13 Jan 2022 18:26:12 +0100 (CET) Subject: [gpfsug-discuss] 5.1.2.2 changes Message-ID: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Hi, just got notified that 5.1.2.2 is out. What are the changes to 5.1.2.1? https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes does not specify that.... -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 From s.j.thompson at bham.ac.uk Thu Jan 13 17:40:05 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Thu, 13 Jan 2022 17:40:05 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: Try: https://public.dhe.ibm.com/storage/spectrumscale/spectrum_scale_apars_512x.html ? At least that lists the APARs resolved anyway. Given it is a PTF, I would mostly expect the changes to be APAR type fixes? And don?t forget the ?What is new in 5.1.2? talk next week - https://www.spectrumscaleug.org/event/digital-user-group-jan-2022-day-1/ (sure that isn?t specific to the -2 PTF) Simon From: gpfsug-discuss-bounces at spectrumscale.org on behalf of juergen.hannappel at desy.de Date: Thursday, 13 January 2022 at 17:27 To: gpfsug main discussion list Subject: [gpfsug-discuss] 5.1.2.2 changes Hi, just got notified that 5.1.2.2 is out. What are the changes to 5.1.2.1? https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes does not specify that.... -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From mark.bergman at uphs.upenn.edu Thu Jan 13 17:39:08 2022 From: mark.bergman at uphs.upenn.edu (mark.bergman at uphs.upenn.edu) Date: Thu, 13 Jan 2022 12:39:08 -0500 Subject: [gpfsug-discuss] [External] 5.1.2.2 changes In-Reply-To: Your message of "Thu, 13 Jan 2022 18:26:12 +0100." <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: <1377783-1642095548.592187@I9hg.LwGL.0znY> In the message dated: Thu, 13 Jan 2022 18:26:12 +0100, The pithy ruminations from "Hannappel, Juergen" on [[External] [gpfsug-discuss] 5.1.2.2 changes] were: => Hi, => just got notified that 5.1.2.2 is out. => What are the changes to 5.1.2.1? => https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes => does not specify that.... The change that I noticed most was: Repair functionality of mmfsck command in online mode is deprecated The repair functionality of mmfsck command in online mode is no longer available. The report-only operation still works in the online mode. While I know that mmfsck is rarely needed and has gotten much faster, deprecating the ability to do any online repairs seems like a significant regression. => => -- => Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 => _______________________________________________ => gpfsug-discuss mailing list => gpfsug-discuss at spectrumscale.org => http://gpfsug.org/mailman/listinfo/gpfsug-discuss => From juergen.hannappel at desy.de Thu Jan 13 18:16:45 2022 From: juergen.hannappel at desy.de (Hannappel, Juergen) Date: Thu, 13 Jan 2022 19:16:45 +0100 (CET) Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs Message-ID: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Hi, I noticed that whe I read directory entries with the usual readdir() function that for fifos I get in the d_type files a 0, i.e. DT_UNKNOWN while if I try that on a different file system e.g. ext4 I get the expected DT_FIFO. Is this a bug or an expected feature? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 From scale at us.ibm.com Fri Jan 14 07:05:11 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Fri, 14 Jan 2022 12:35:11 +0530 Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs In-Reply-To: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> References: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Message-ID: Hi Steve, Can you please look into the below query from Hannappel. Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479. If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team. From: "Hannappel, Juergen" To: "gpfsug main discussion list" Date: 13-01-2022 11.46 PM Subject: [EXTERNAL] [gpfsug-discuss] struct dirent d_type for fifos on gpfs Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I noticed that whe I read directory entries with the usual readdir() function that for fifos I get in the d_type files a 0, i.e. DT_UNKNOWN while if I try that on a different file system e.g. ext4 I get the expected DT_FIFO. Is this a bug or an expected feature? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: From jonathan.buzzard at strath.ac.uk Fri Jan 14 14:37:50 2022 From: jonathan.buzzard at strath.ac.uk (Jonathan Buzzard) Date: Fri, 14 Jan 2022 14:37:50 +0000 Subject: [gpfsug-discuss] [External] 5.1.2.2 changes In-Reply-To: <1377783-1642095548.592187@I9hg.LwGL.0znY> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> <1377783-1642095548.592187@I9hg.LwGL.0znY> Message-ID: <3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> On 13/01/2022 17:39, mark.bergman at uphs.upenn.edu wrote: [SNIP] > > The change that I noticed most was: > > Repair functionality of mmfsck command in online mode is deprecated > The repair functionality of mmfsck command in online mode is no longer available. The report-only operation still works in the online mode. > > While I know that mmfsck is rarely needed and has gotten much faster, deprecating the ability to do any online repairs seems > like a significant regression. > I would concur with that sentiment, and given it is a significant regression I would suggest that it IBM should give an explanation as to why functionality has been removed. Been able to do online repairs on large file systems is when you need it a complete life saver. It could be the difference between several days of outage vs. end users not realizing there was even a problem. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG From scale at us.ibm.com Fri Jan 14 16:27:26 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Fri, 14 Jan 2022 12:27:26 -0400 Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs In-Reply-To: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> References: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Message-ID: This is expected. GPFS readdir only support d_type: DT_REG, DT_DIR and DT_LNK. All other type will be returned as DT_UNKNOWN. Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479 . If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team. -------------- next part -------------- An HTML attachment was scrubbed... URL: From lgayne at us.ibm.com Fri Jan 14 16:38:19 2022 From: lgayne at us.ibm.com (Lyle Gayne) Date: Fri, 14 Jan 2022 16:38:19 +0000 Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs In-Reply-To: References: , <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Message-ID: An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Image.1__=0ABB0D59DFB540138f9e8a93df938690 at ibm.com.gif Type: image/gif Size: 105 bytes Desc: not available URL: From p.childs at qmul.ac.uk Mon Jan 17 11:29:54 2022 From: p.childs at qmul.ac.uk (Peter Childs) Date: Mon, 17 Jan 2022 11:29:54 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: https://public.dhe.ibm.com/storage/spectrumscale/spectrum_scale_apars_512x.html Is normally the best place to look for changes in PTF releases. Peter Childs ITS Research Storage Queen Mary University Of London ________________________________________ From: gpfsug-discuss-bounces at spectrumscale.org on behalf of Hannappel, Juergen Sent: Thursday, January 13, 2022 5:26 PM To: gpfsug main discussion list Subject: [EXTERNAL] [gpfsug-discuss] 5.1.2.2 changes CAUTION: This email originated from outside of QMUL. Do not click links or open attachments unless you recognise the sender and know the content is safe. Hi, just got notified that 5.1.2.2 is out. What are the changes to 5.1.2.1? https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes does not specify that.... -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss From s.j.thompson at bham.ac.uk Mon Jan 17 12:27:34 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Mon, 17 Jan 2022 12:27:34 +0000 Subject: [gpfsug-discuss] [External] 5.1.2.2 changes In-Reply-To: <3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> <1377783-1642095548.592187@I9hg.LwGL.0znY> <3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> Message-ID: My guess is ? they decided it was unsafe. I?m sure I?ve seen a few release notes that have referred to mmfsck and data corruption. e.g.: https://www.ibm.com/support/pages/ibm-spectrum-scale-alert-all-supported-versions-may-be-affected-issue-online-mmfsck-which-may-result-file-system-corruption So maybe it was classified as too dangerous to leave in the field? Simon From: gpfsug-discuss-bounces at spectrumscale.org on behalf of Jonathan Buzzard Date: Friday, 14 January 2022 at 14:38 To: gpfsug-discuss at spectrumscale.org Subject: Re: [gpfsug-discuss] [External] 5.1.2.2 changes On 13/01/2022 17:39, mark.bergman at uphs.upenn.edu wrote: [SNIP] > > The change that I noticed most was: > > Repair functionality of mmfsck command in online mode is deprecated > The repair functionality of mmfsck command in online mode is no longer available. The report-only operation still works in the online mode. > > While I know that mmfsck is rarely needed and has gotten much faster, deprecating the ability to do any online repairs seems > like a significant regression. > I would concur with that sentiment, and given it is a significant regression I would suggest that it IBM should give an explanation as to why functionality has been removed. Been able to do online repairs on large file systems is when you need it a complete life saver. It could be the difference between several days of outage vs. end users not realizing there was even a problem. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From MDIETZ at de.ibm.com Mon Jan 17 18:21:18 2022 From: MDIETZ at de.ibm.com (Mathias Dietz) Date: Mon, 17 Jan 2022 18:21:18 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: References: , <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de><1377783-1642095548.592187@I9hg.LwGL.0znY><3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> Message-ID: An HTML attachment was scrubbed... URL: From cabrillo at ifca.unican.es Tue Jan 18 16:08:50 2022 From: cabrillo at ifca.unican.es (Iban Cabrillo) Date: Tue, 18 Jan 2022 17:08:50 +0100 (CET) Subject: [gpfsug-discuss] Filesystem sometimes does not correctly inherit acls Message-ID: <575239190.9166807.1642522130898.JavaMail.zimbra@ifca.unican.es> Dear Scalers, We are running 5.1.1-0 version. Since a couple of months we have noticed, that the directory permissions are not inherited correctly even if the default acl is set correctly: For example this is the default acl for a directory (mmgetacl -d): #owner:100 #group:101 user::rwxc group::r-x- other::---- mask::rwxc user:user1:rwxc group:group1:rwx- group:group2:rwx- group:group3:rwx- But sometimes when a new dir is creted under this directory i see this: #owner:100 #group:101 user::rwxc group::r-x- #effective: ---- other::---- mask::---c user:user1:rwxc #effective: ---c group:group1:rwx- #effective: ---- group:group2:rwx- #effective: ---- group:group3:rwx- #effective: ---- Any Idea about this behavior ? Regards, I -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Tue Jan 18 16:56:17 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Tue, 18 Jan 2022 16:56:17 +0000 Subject: [gpfsug-discuss] mmbackup file selections Message-ID: Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. Wrong assumption? Where should I be looking - surely it shouldn't be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: From scl at virginia.edu Tue Jan 18 19:52:12 2022 From: scl at virginia.edu (Losen, Stephen C (scl)) Date: Tue, 18 Jan 2022 19:52:12 +0000 Subject: [gpfsug-discuss] Filesystem sometimes does not correctly inherit acls In-Reply-To: <575239190.9166807.1642522130898.JavaMail.zimbra@ifca.unican.es> References: <575239190.9166807.1642522130898.JavaMail.zimbra@ifca.unican.es> Message-ID: <9B932E92-1FAB-4B9E-9987-6DDBA7716D28@virginia.edu> Hi Iban, What you are seeing is what you get if you call mkdir(2) like this from C mkdir(?dirname?, 0700); or in a python script like this import os os.mkdir(?dirname?, Oo700) Or you could use chmod on the directory like this: chmod 700 dirname All of these modify the ACL mask entry so that it no longer matches the default ACL mask. Notice how everything else in the ACL still matches the default ACL. You can easily set the mask back with chmod g+rwx dirname (assuming that your fileset is configured to allow chmod). Steve Losen Research Computing University of Virginia scl at virginia.edu 434-924-0640 From: on behalf of Iban Cabrillo Reply-To: gpfsug main discussion list Date: Tuesday, January 18, 2022 at 11:26 AM To: gpfsug-discuss Subject: [gpfsug-discuss] Filesystem sometimes does not correctly inherit acls Dear Scalers, We are running 5.1.1-0 version. Since a couple of months we have noticed, that the directory permissions are not inherited correctly even if the default acl is set correctly: For example this is the default acl for a directory (mmgetacl -d): #owner:100 #group:101 user::rwxc group::r-x- other::---- mask::rwxc user:user1:rwxc group:group1:rwx- group:group2:rwx- group:group3:rwx- But sometimes when a new dir is creted under this directory i see this: #owner:100 #group:101 user::rwxc group::r-x- #effective: ---- other::---- mask::---c user:user1:rwxc #effective: ---c group:group1:rwx- #effective: ---- group:group2:rwx- #effective: ---- group:group3:rwx- #effective: ---- Any Idea about this behavior ? Regards, I -------------- next part -------------- An HTML attachment was scrubbed... URL: From scale at us.ibm.com Tue Jan 18 22:53:46 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Tue, 18 Jan 2022 18:53:46 -0400 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. From: "Paul Ward" To: "gpfsug-discuss at spectrumscale.org" Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 2E582126.jpg Type: image/jpeg Size: 5356 bytes Desc: not available URL: From p.ward at nhm.ac.uk Wed Jan 19 11:03:47 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Wed, 19 Jan 2022 11:03:47 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run - on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" > To: "gpfsug-discuss at spectrumscale.org" > Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. Wrong assumption? Where should I be looking - surely it shouldn't be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 105 bytes Desc: image002.gif URL: From scale at us.ibm.com Wed Jan 19 15:08:53 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Wed, 19 Jan 2022 11:08:53 -0400 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2 " right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. From: "Paul Ward" To: "gpfsug main discussion list" Cc: "gpfsug-discuss-bounces at spectrumscale.org" Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" To: "gpfsug-discuss at spectrumscale.org" Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 1A584757.jpg Type: image/jpeg Size: 5356 bytes Desc: not available URL: From skylar2 at uw.edu Wed Jan 19 15:39:55 2022 From: skylar2 at uw.edu (Skylar Thompson) Date: Wed, 19 Jan 2022 07:39:55 -0800 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: <20220119153955.wao2yhyqbr5s2uk2@utumno.gs.washington.edu> Hi Paul, Not to toot my own horn and while the DEBUGmmbackup=2 method definitely does work, you might want to vote for this RFE I put in a month ago to get a more robust "dry run" mode with mmbackup, since guessing how include/exclude rules get translated from SP/dsmc to SS/mmbackup can be challenging: https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=153520 Somewhat selfishly, I think implementing the RFE would benefit you as well. :) On Tue, Jan 18, 2022 at 04:56:17PM +0000, Paul Ward wrote: > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking - surely it shouldn't be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His From heinrich.billich at id.ethz.ch Thu Jan 20 10:55:01 2022 From: heinrich.billich at id.ethz.ch (Billich Heinrich Rainer (ID)) Date: Thu, 20 Jan 2022 10:55:01 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: <86ED32E1-2E2E-4FA6-9313-BA673CAF212B@id.ethz.ch> Hello, I just wonder if I can set a fileset to readonly - or link it as readonly. When I do data migration or finished a project which has it?s own fileset assigned it would be nice if I could just set the fileset to readonly to make sure that nothing and nobody can do any changes. There may be more cases ? Immutability seems overkill, and I can?t revert it Related: If I setup an afm cache fileset in readonly mode ? is this enforced on the cache side or just by convention? The afm gateways need to write to cache anyway, so probably other processes can, too? If anybody could comment and maybe also explain why it?s been designed the way it is? Thank you, Heiner -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5254 bytes Desc: not available URL: From anacreo at gmail.com Thu Jan 20 17:50:21 2022 From: anacreo at gmail.com (Alec) Date: Thu, 20 Jan 2022 09:50:21 -0800 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: <86ED32E1-2E2E-4FA6-9313-BA673CAF212B@id.ethz.ch> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> <86ED32E1-2E2E-4FA6-9313-BA673CAF212B@id.ethz.ch> Message-ID: Not sure if still supported but you could try tagging all the files/directories in a fileset with the immutable attribute using the policy engine. Not sure if that will cover what you need. You can simply use policy engine to add or subtract that attribute at will. It's biggest drawback may be exactly what you're looking for. You could get fancy and mount the gpfs volume twice once read-wrire and a second read-only.. then use mount command to mount over the read only filesystem ontop of the read-write filesystem at the appropriate junctures. You'd have to do this on each node you want affected... So: /FileSys/FileSetA /FileSys/FileSetB Mount FileSys again as /ro/FileSys and share out /ro/FileSys/FileSetA use read only option on mount. Mount /ro/FileSys/FileSetA ontop of /FileSys/FileSetA. I dont have root on my GPFS filesystems so I can't test this out... But would work on most other Unit FSs. Alec On Thu, Jan 20, 2022, 3:10 AM Billich Heinrich Rainer (ID) < heinrich.billich at id.ethz.ch> wrote: > Hello, > > I just wonder if I can set a fileset to readonly - or link it as > readonly. When I do data migration or finished a project which has it?s own > fileset assigned it would be nice if I could just set the fileset to > readonly to make sure that nothing and nobody can do any changes. There may > be more cases ? > > Immutability seems overkill, and I can?t revert it > > Related: If I setup an afm cache fileset in readonly mode ? is this > enforced on the cache side or just by convention? The afm gateways need to > write to cache anyway, so probably other processes can, too? > > If anybody could comment and maybe also explain why it?s been designed the > way it is? > > Thank you, > > Heiner > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Fri Jan 21 14:38:37 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Fri, 21 Jan 2022 14:38:37 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: wc -l mmbackup* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 754 total >From Summary Total number of objects inspected: 755 I can live with a discrepancy of 1. 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa >From Summary Total number of objects expired: 2 That matches wc -l mmbackupC* mmbackupS* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 752 total Summary: Total number of objects backed up: 751 A difference of 1 I can live with. What does Statech stand for? Just this to sort out: Total number of objects failed: 1 I will add: --tsm-errorlog TSMErrorLogFile Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 19 January 2022 15:09 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. From: "Paul Ward" > To: "gpfsug main discussion list" > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run - on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" > To: "gpfsug-discuss at spectrumscale.org" > Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. Wrong assumption? Where should I be looking - surely it shouldn't be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 105 bytes Desc: image002.gif URL: From p.ward at nhm.ac.uk Fri Jan 21 14:38:50 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Fri, 21 Jan 2022 14:38:50 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: <20220119153955.wao2yhyqbr5s2uk2@utumno.gs.washington.edu> References: <20220119153955.wao2yhyqbr5s2uk2@utumno.gs.washington.edu> Message-ID: Got my vote. Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk -----Original Message----- From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of Skylar Thompson Sent: 19 January 2022 15:40 To: gpfsug-discuss at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, Not to toot my own horn and while the DEBUGmmbackup=2 method definitely does work, you might want to vote for this RFE I put in a month ago to get a more robust "dry run" mode with mmbackup, since guessing how include/exclude rules get translated from SP/dsmc to SS/mmbackup can be challenging: https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fdeveloperworks%2Frfe%2Fexecute%3Fuse_case%3DviewRfe%26CR_ID%3D153520&data=04%7C01%7Cp.ward%40nhm.ac.uk%7C1898b9c0b030441112e708d9db61fb44%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637782037020043251%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=WCBNcdWnDtZL%2B8qPahZO0gFFdBAW1X%2BPyL6pI71r804%3D&reserved=0 Somewhat selfishly, I think implementing the RFE would benefit you as well. :) On Tue, Jan 18, 2022 at 04:56:17PM +0000, Paul Ward wrote: > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking - surely it shouldn't be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7C1898b9c0b030441112e708d9db61fb44%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637782037020043251%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=8NvIypofEOlGwDKQpZA6aorxKo5G0hYWt9mi9QZe9x8%3D&reserved=0 -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward%40nhm.ac.uk%7C1898b9c0b030441112e708d9db61fb44%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637782037020043251%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=8NvIypofEOlGwDKQpZA6aorxKo5G0hYWt9mi9QZe9x8%3D&reserved=0 From jesus.mora at 4ks.mx Fri Jan 21 15:17:07 2022 From: jesus.mora at 4ks.mx (Jesus Mora Luna) Date: Fri, 21 Jan 2022 09:17:07 -0600 Subject: [gpfsug-discuss] How do I add a new IP to the configuration? Message-ID: Good day Please can you help me to solve a problem that I have with the modification of an ESS to add a new IP to share the volumes in a new network. The issue is that I already tried to add the IP with the corresponding commands and what it tells me is that it does not find the network, I also tried to add the IP directly to one of the Ethernet interfaces and it does not let me do it. Where can I find or can you share the procedure if it is available to add a new IP Thanking you in advance for your attention to my request, I look forward to your response and comments. Greetings and thanks Jes?s Mora Luna Servicios Continuos System Engineer Jesus.mora at 4ks.mx Oficina 55 41636541 M?vil 55 14853753 Ignacio Allende N? 21 Ampliaci?n Torre Blanca Miguel Hidalgo, CDMX 11289 www.4ks.mx Descripci?n: Descripci?n: Descripci?n: https://docs.google.com/uc?export=download&id=11HlTv0TDj5BTu4hVCM-2rNkHWnmxA H5E&revid=0ByZwGRTUTp29c0VQdWVKWVRaT0dkUEVDK3hRckc4MCtJWVZnPQ Descripci?n: Descripci?n: Descripci?n: https://docs.google.com/uc?export=download&id=1NomENnxEOLpSFfGyStQMonSuz83p3 3aL&revid=0ByZwGRTUTp29NTlqVzMyMEVhQnNnNUt5eGpzY3M3MGNGeXZ3PQ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 16220 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 49179 bytes Desc: not available URL: From anacreo at gmail.com Sat Jan 22 00:02:10 2022 From: anacreo at gmail.com (Alec) Date: Fri, 21 Jan 2022 16:02:10 -0800 Subject: [gpfsug-discuss] How do I add a new IP to the configuration? In-Reply-To: References: Message-ID: It sounds like you are attempting to add multiple networks to the same interface. So if your existing ESS is not on a network that is routed to your new clients then you'll need to do one of the following: 1) Establish routing between the new ESS client IP's and your existing ESS servers. 2) Add a Virtual Interface with that network's VLAN on it (or the VLAN of a network that is routed to the new client). 3) Configure new interfaces on the ESS with the new network. No one else answered, and unfortunately I don't own an ESS so I can't tell you had to do step #2. But typically a scenario would look like this: ESS 1st interface IP is 192.168.1.150 subnetmask 255.255.0.0 and default gateway 192.168.0.1 With this anything in the 192.168.x.x address space could be added to the 1st interface as they are all local to that address. Now you're presented with needing to offer data to something on IP 10.1.20.30, and 192.168.0.1 doesn't know how to reach that interface, or we don't want that data flowing across routes. If we don't want to add another physical interface to ESS we have to get into VLAN configuration (Virtual LAN)... Now we say VLAN 0 is going to be 192.168.0.0 network and it's the default network (anything not tagged goes there)... And the network team has 10.0.0.0 network on VLAN 10... So we ask the network team to add VLAN 10 to our 1st interface. It should now have VLAN 0 and VLAN 10. I don't know how but somehow in the ESS you're now going to have to add a new virtual adapter that is bound to VLAN 10... and since the first interface didn't have VLAN's it will continue to use the now default VLAN 0. Once we have that 2nd virtual adaptor on VLAN 10 we can define it as... 2nd interface (still on the 1st physical interface, but a virtual adapter) IP is 10.240.1.150 (let's say 10.240 is going to be the ESS's portion of the 10 network).. and we define the subnetmask 255.0.0.0 and maybe no route... It really needs for your network team to define how they want you to proceed and then figure out how the ESS can be configured to consume that network design. What you can't do is straight up put two IP's from different subnets on the same interface. Essentially the logical interface will look at it's IP, it's Subnet combine the values with your new IP and say, hey wrong network. Alec On Fri, Jan 21, 2022, 7:17 AM Jesus Mora Luna wrote: > Good day > > > > Please can you help me to solve a problem that I have with the > modification of an ESS to add a new IP to share the volumes in a new > network. > > > > The issue is that I already tried to add the IP with the corresponding > commands and what it tells me is that it does not find the network, I also > tried to add the IP directly to one of the Ethernet interfaces and it does > not let me do it. > > > > Where can I find or can you share the procedure if it is available to add > a new IP > > > > Thanking you in advance for your attention to my request, I look forward > to your response and comments. > > > > Greetings and thanks > > > > *Jes?s Mora Luna * > > Servicios Continuos > > System Engineer > > Jesus.mora at 4ks.mx > > Oficina 55 41636541 > > M?vil 55 14853753 > > Ignacio Allende N? 21 > > Ampliaci?n Torre Blanca Miguel Hidalgo, CDMX 11289 > > www.4ks.mx > > > > [image: Descripci?n: Descripci?n: Descripci?n: > https://docs.google.com/uc?export=download&id=11HlTv0TDj5BTu4hVCM-2rNkHWnmxAH5E&revid=0ByZwGRTUTp29c0VQdWVKWVRaT0dkUEVDK3hRckc4MCtJWVZnPQ] > > > > [image: Descripci?n: Descripci?n: Descripci?n: > https://docs.google.com/uc?export=download&id=1NomENnxEOLpSFfGyStQMonSuz83p33aL&revid=0ByZwGRTUTp29NTlqVzMyMEVhQnNnNUt5eGpzY3M3MGNGeXZ3PQ] > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 16220 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 49179 bytes Desc: not available URL: From scale at us.ibm.com Sat Jan 22 00:35:24 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Fri, 21 Jan 2022 20:35:24 -0400 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Hi Paul, Instead of calculating *.ix.* files, please look at a list file in these directories. updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. From: "Paul Ward" To: "gpfsug main discussion list" Cc: "gpfsug-discuss-bounces at spectrumscale.org" Date: 01/21/2022 09:38 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: wc -l mmbackup* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 754 total From Summary Total number of objects inspected: 755 I can live with a discrepancy of 1. 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa From Summary Total number of objects expired: 2 That matches wc -l mmbackupC* mmbackupS* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 752 total Summary: Total number of objects backed up: 751 A difference of 1 I can live with. What does Statech stand for? Just this to sort out: Total number of objects failed: 1 I will add: --tsm-errorlog TSMErrorLogFile Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 19 January 2022 15:09 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. From: "Paul Ward" To: "gpfsug main discussion list" Cc: "gpfsug-discuss-bounces at spectrumscale.org" < gpfsug-discuss-bounces at spectrumscale.org> Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated From: gpfsug-discuss-bounces at spectrumscale.org < gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" To: "gpfsug-discuss at spectrumscale.org" Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 29915401.jpg Type: image/jpeg Size: 5356 bytes Desc: not available URL: From spectrumscale at kiranghag.com Sat Jan 22 05:26:53 2022 From: spectrumscale at kiranghag.com (KG) Date: Sat, 22 Jan 2022 10:56:53 +0530 Subject: [gpfsug-discuss] How do I add a new IP to the configuration? In-Reply-To: References: Message-ID: Hi The CES service on protocol nodes binds to all available addresses including fixed IP addresses. You would need to add a virtual interface on existing interface (or setup a new interface) and assign IP to it (from the new subnet that you wish to add). After that add IPs to CES pool. The CES pool will then attach to newly added interface. You may have to restart the CES service/protocol node daemon. On Sat, Jan 22, 2022 at 5:32 AM Alec wrote: > It sounds like you are attempting to add multiple networks to the same > interface. > > So if your existing ESS is not on a network that is routed to your new > clients then you'll need to do one of the following: > > 1) Establish routing between the new ESS client IP's and your existing ESS > servers. > 2) Add a Virtual Interface with that network's VLAN on it (or the VLAN of > a network that is routed to the new client). > 3) Configure new interfaces on the ESS with the new network. > > No one else answered, and unfortunately I don't own an ESS so I can't tell > you had to do step #2. > > But typically a scenario would look like this: > > ESS > 1st interface IP is 192.168.1.150 subnetmask 255.255.0.0 and default > gateway 192.168.0.1 > > With this anything in the 192.168.x.x address space could be added to > the 1st interface as they are all local to that address. > > Now you're presented with needing to offer data to something on IP > 10.1.20.30, and 192.168.0.1 doesn't know how to reach that interface, or we > don't want that data flowing across routes. > > If we don't want to add another physical interface to ESS we have to get > into VLAN configuration (Virtual LAN)... > > Now we say VLAN 0 is going to be 192.168.0.0 network and it's the > default network (anything not tagged goes there)... > And the network team has 10.0.0.0 network on VLAN 10... So we ask the > network team to add VLAN 10 to our 1st interface. It should now have VLAN > 0 and VLAN 10. > > I don't know how but somehow in the ESS you're now going to have to add > a new virtual adapter that is bound to VLAN 10... and since the first > interface didn't have VLAN's it will continue to use the now default VLAN 0. > > Once we have that 2nd virtual adaptor on VLAN 10 we can define it as... > 2nd interface (still on the 1st physical interface, but a virtual > adapter) IP is 10.240.1.150 (let's say 10.240 is going to be the ESS's > portion of the 10 network).. and we define the subnetmask 255.0.0.0 and > maybe no route... > > It really needs for your network team to define how they want you to > proceed and then figure out how the ESS can be configured to consume that > network design. > > What you can't do is straight up put two IP's from different subnets on > the same interface. Essentially the logical interface will look at it's > IP, it's Subnet combine the values with your new IP and say, hey wrong > network. > > Alec > > On Fri, Jan 21, 2022, 7:17 AM Jesus Mora Luna wrote: > >> Good day >> >> >> >> Please can you help me to solve a problem that I have with the >> modification of an ESS to add a new IP to share the volumes in a new >> network. >> >> >> >> The issue is that I already tried to add the IP with the corresponding >> commands and what it tells me is that it does not find the network, I also >> tried to add the IP directly to one of the Ethernet interfaces and it does >> not let me do it. >> >> >> >> Where can I find or can you share the procedure if it is available to add >> a new IP >> >> >> >> Thanking you in advance for your attention to my request, I look forward >> to your response and comments. >> >> >> >> Greetings and thanks >> >> >> >> *Jes?s Mora Luna * >> >> Servicios Continuos >> >> System Engineer >> >> Jesus.mora at 4ks.mx >> >> Oficina 55 41636541 >> >> M?vil 55 14853753 >> >> Ignacio Allende N? 21 >> >> Ampliaci?n Torre Blanca Miguel Hidalgo, CDMX 11289 >> >> www.4ks.mx >> >> >> >> [image: Descripci?n: Descripci?n: Descripci?n: >> https://docs.google.com/uc?export=download&id=11HlTv0TDj5BTu4hVCM-2rNkHWnmxAH5E&revid=0ByZwGRTUTp29c0VQdWVKWVRaT0dkUEVDK3hRckc4MCtJWVZnPQ] >> >> >> >> [image: Descripci?n: Descripci?n: Descripci?n: >> https://docs.google.com/uc?export=download&id=1NomENnxEOLpSFfGyStQMonSuz83p33aL&revid=0ByZwGRTUTp29NTlqVzMyMEVhQnNnNUt5eGpzY3M3MGNGeXZ3PQ] >> >> >> _______________________________________________ >> gpfsug-discuss mailing list >> gpfsug-discuss at spectrumscale.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss >> > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Mon Jan 24 14:31:54 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Mon, 24 Jan 2022 14:31:54 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Those directories are empty Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 22 January 2022 00:35 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, Instead of calculating *.ix.* files, please look at a list file in these directories. updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. From: "Paul Ward" > To: "gpfsug main discussion list" > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > Date: 01/21/2022 09:38 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: wc -l mmbackup* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 754 total >From Summary Total number of objects inspected: 755 I can live with a discrepancy of 1. 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa >From Summary Total number of objects expired: 2 That matches wc -l mmbackupC* mmbackupS* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 752 total Summary: Total number of objects backed up: 751 A difference of 1 I can live with. What does Statech stand for? Just this to sort out: Total number of objects failed: 1 I will add: --tsm-errorlog TSMErrorLogFile Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale Sent: 19 January 2022 15:09 To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. From: "Paul Ward" > To: "gpfsug main discussion list" > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" > To: "gpfsug-discuss at spectrumscale.org" > Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 105 bytes Desc: image002.gif URL: From skylar2 at uw.edu Mon Jan 24 15:36:31 2022 From: skylar2 at uw.edu (Skylar Thompson) Date: Mon, 24 Jan 2022 07:36:31 -0800 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> Hi Paul, Did you look for dot files? At least for us on 5.0.5 there's a .list.1. file while the backups are running: /gpfs/grc6/.mmbackupCfg/updatedFiles/: -r-------- 1 root nickers 6158526821 Jan 23 18:28 .list.1.gpfs-grc6 /gpfs/grc6/.mmbackupCfg/expiredFiles/: -r-------- 1 root nickers 85862211 Jan 23 18:28 .list.1.gpfs-grc6 On Mon, Jan 24, 2022 at 02:31:54PM +0000, Paul Ward wrote: > Those directories are empty > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale > Sent: 22 January 2022 00:35 > To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > Hi Paul, > > Instead of calculating *.ix.* files, please look at a list file in these directories. > > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta info update > expiredFiles : cantains a file that lists all candidates for expiration > > Regards, The Spectrum Scale (GPFS) team > > ------------------------------------------------------------------------------------------------------------------ > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > > Date: 01/21/2022 09:38 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > ________________________________ > > > > Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart > This Message Is From an External Sender > This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you > > Right in the command line seems to have worked. > At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder > > Checking how many entries in these files compared to the Summary: > wc -l mmbackup* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 754 total > From Summary > Total number of objects inspected: 755 > I can live with a discrepancy of 1. > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > From Summary > Total number of objects expired: 2 > That matches > > wc -l mmbackupC* mmbackupS* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 752 total > Summary: > Total number of objects backed up: 751 > > A difference of 1 I can live with. > > What does Statech stand for? > > Just this to sort out: > Total number of objects failed: 1 > I will add: > --tsm-errorlog TSMErrorLogFile > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale > Sent: 19 January 2022 15:09 > To: gpfsug main discussion list > > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > This is to set environment for mmbackup. > If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. > e.g) in your script > .... > export DEBUGmmbackup=2 > mmbackup .... > > Or, you can set it in the same command line like > DEBUGmmbackup=2 mmbackup .... > > Regards, The Spectrum Scale (GPFS) team > > ------------------------------------------------------------------------------------------------------------------ > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > > Date: 01/19/2022 06:04 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > ________________________________ > > > > > Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart > This Message Is From an External Sender > This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you. > > We run a script on all our nodes that checks to see if they are the cluster manager. > If they are, then they take responsibility to start the backup script. > The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. > > Where does this command belong? > I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale > Sent: 18 January 2022 22:54 > To: gpfsug main discussion list > > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > Hi Paul, > > If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). > In .mmbackupCfg directory, there are 3 directories: > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta info update > expiredFiles : cantains a file that lists all candidates for expiration > > > Regards, The Spectrum Scale (GPFS) team > > ------------------------------------------------------------------------------------------------------------------ > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. > > From: "Paul Ward" > > To: "gpfsug-discuss at spectrumscale.org" > > Date: 01/18/2022 11:56 AM > Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > ________________________________ > > > > > > Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart > This Message Is From an External Sender > This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His From Alifiya.Kantawala at ibm.com Tue Jan 25 15:05:02 2022 From: Alifiya.Kantawala at ibm.com (Alifiya Kantawala) Date: Tue, 25 Jan 2022 15:05:02 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes Message-ID: An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Image.16431227650740.png Type: image/png Size: 75092 bytes Desc: not available URL: From p.ward at nhm.ac.uk Wed Jan 26 15:55:48 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Wed, 26 Jan 2022 15:55:48 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> References: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> Message-ID: Good call! Yes they are dot files. New issue. Mmbackup seems to be backup up the same files over and over without them changing: areas are being backed up multiple times. The example below is a co-resident file, the only thing that has changed since it was created 20/10/21, is the file has been accessed for backup. This file is in the 'changed' list in mmbackup: This list has just been created: -rw-r--r--. 1 root root 6591914 Jan 26 11:12 mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa Listing the last few files in the file (selecting the last one) 11:17:52 [root at scale-sk-pn-1 .mmbackupCfg]# tail mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604556977.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557039.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557102.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557164.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557226.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557288.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557351.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557413.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557476.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" Check the file stats (access time just before last backup) 11:18:05 [root at scale-sk-pn-1 .mmbackupCfg]# stat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" File: '/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png' Size: 545 Blocks: 32 IO Block: 4194304 regular file Device: 2bh/43d Inode: 212618897 Links: 1 Access: (0644/-rw-r--r--) Uid: (1399613896/NHM\edwab) Gid: (1399647564/NHM\dg-mbl-urban-nature-project-rw) Context: unconfined_u:object_r:unlabeled_t:s0 Access: 2022-01-25 06:40:58.334961446 +0000 Modify: 2020-12-01 15:20:40.122053000 +0000 Change: 2021-10-20 17:55:18.265746459 +0100 Birth: - Check if migrated 11:18:16 [root at scale-sk-pn-1 .mmbackupCfg]# dsmls "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" File name : /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png On-line size : 545 Used blocks : 16 Data Version : 1 Meta Version : 1 State : Co-resident Container Index : 1 Base Name : 34C0B77D20194B0B.EACEB2055F6CAA58.56D56C5F140C8C9D.0000000000000000.2197396D.000000000CAC4E91 Check if immutable 11:18:26 [root at scale-sk-pn-1 .mmbackupCfg]# mstat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" file name: /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png metadata replication: 2 max 2 data replication: 2 max 2 immutable: no appendOnly: no flags: storage pool name: data fileset name: hpc-workspaces-fset snapshot name: creation time: Wed Oct 20 17:55:18 2021 Misc attributes: ARCHIVE Encrypted: no Check active and inactive backups (it was backed up yesterday) 11:18:52 [root at scale-sk-pn-1 .mmbackupCfg]# dsmcqbi "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" IBM Spectrum Protect Command Line Backup-Archive Client Interface Client Version 8, Release 1, Level 10.0 Client date/time: 01/26/2022 11:19:02 (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. Node Name: SC-PN-SK-01 Session established with server TSM-JERSEY: Windows Server Version 8, Release 1, Level 10.100 Server date/time: 01/26/2022 11:19:02 Last access: 01/26/2022 11:07:05 Accessing as node: SCALE Size Backup Date Mgmt Class A/I File ---- ----------- ---------- --- ---- 545 B 01/25/2022 06:41:17 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png It will be backed up again shortly, why? And it was backed up again: # dsmcqbi /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png IBM Spectrum Protect Command Line Backup-Archive Client Interface Client Version 8, Release 1, Level 10.0 Client date/time: 01/26/2022 15:54:09 (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. Node Name: SC-PN-SK-01 Session established with server TSM-JERSEY: Windows Server Version 8, Release 1, Level 10.100 Server date/time: 01/26/2022 15:54:10 Last access: 01/26/2022 15:30:03 Accessing as node: SCALE Size Backup Date Mgmt Class A/I File ---- ----------- ---------- --- ---- 545 B 01/26/2022 12:23:02 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/25/2022 06:41:17 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk -----Original Message----- From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of Skylar Thompson Sent: 24 January 2022 15:37 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, Did you look for dot files? At least for us on 5.0.5 there's a .list.1. file while the backups are running: /gpfs/grc6/.mmbackupCfg/updatedFiles/: -r-------- 1 root nickers 6158526821 Jan 23 18:28 .list.1.gpfs-grc6 /gpfs/grc6/.mmbackupCfg/expiredFiles/: -r-------- 1 root nickers 85862211 Jan 23 18:28 .list.1.gpfs-grc6 On Mon, Jan 24, 2022 at 02:31:54PM +0000, Paul Ward wrote: > Those directories are empty > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum > Scale > Sent: 22 January 2022 00:35 > To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > Hi Paul, > > Instead of calculating *.ix.* files, please look at a list file in these directories. > > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta > info update expiredFiles : cantains a file that lists all candidates > for expiration > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > org>> > Cc: > "gpfsug-discuss-bounces at spectrumscale.org s at spectrumscale.org>" > s at spectrumscale.org>> > Date: 01/21/2022 09:38 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > by: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > > ________________________________ > > > > Thank you Right in the command line seems to have worked. At the end > of the script I now copy the contents of the .mmbackupCfg folder to a > date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you > > Right in the command line seems to have worked. > At the end of the script I now copy the contents of the .mmbackupCfg > folder to a date stamped logging folder > > Checking how many entries in these files compared to the Summary: > wc -l mmbackup* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 754 total > From Summary > Total number of objects inspected: 755 > I can live with a discrepancy of 1. > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > From Summary > Total number of objects expired: 2 > That matches > > wc -l mmbackupC* mmbackupS* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 752 total > Summary: > Total number of objects backed up: 751 > > A difference of 1 I can live with. > > What does Statech stand for? > > Just this to sort out: > Total number of objects failed: 1 > I will add: > --tsm-errorlog TSMErrorLogFile > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > Sent: 19 January 2022 15:09 > To: gpfsug main discussion list > org>> > Cc: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > This is to set environment for mmbackup. > If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. > e.g) in your script > .... > export DEBUGmmbackup=2 > mmbackup .... > > Or, you can set it in the same command line like > DEBUGmmbackup=2 mmbackup .... > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > org>> > Cc: > "gpfsug-discuss-bounces at spectrumscale.org s at spectrumscale.org>" > s at spectrumscale.org>> > Date: 01/19/2022 06:04 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > by: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > > ________________________________ > > > > > Thank you. We run a script on all our nodes that checks to see if they > are the cluster manager. If they are, then they take responsibility to > start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you. > > We run a script on all our nodes that checks to see if they are the cluster manager. > If they are, then they take responsibility to start the backup script. > The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. > > Where does this command belong? > I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > Sent: 18 January 2022 22:54 > To: gpfsug main discussion list > org>> > Cc: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > Subject: Re: [gpfsug-discuss] mmbackup file selections > > Hi Paul, > > If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). > In .mmbackupCfg directory, there are 3 directories: > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta > info update expiredFiles : cantains a file that lists all candidates > for expiration > > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. > > From: "Paul Ward" > > To: > "gpfsug-discuss at spectrumscale.org org>" > org>> > Date: 01/18/2022 11:56 AM > Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > > ________________________________ > > > > > > Hi, I am trying to work out what files have been sent to backup using > mmbackup. I have increased the -L value from 3 up to 6 but only seem > to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > =0 fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > d4c8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8ey > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > 0&sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reser > ved=0> > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > =0 fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8ey > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > 0&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&res > erved=0> > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > ed=0 gpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp. > ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437f > a0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8 > eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2 > 000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&r > eserved=0> > > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > ed=0 -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserved=0 From skylar2 at uw.edu Wed Jan 26 16:50:13 2022 From: skylar2 at uw.edu (Skylar Thompson) Date: Wed, 26 Jan 2022 08:50:13 -0800 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> Message-ID: <20220126165013.z7vo3m4d666el7wr@utumno.gs.washington.edu> Awesome, glad that you found them (I missed them the first time too). As for the anomalous changed files, do you have these options set in your client option file? skipacl yes skipaclupdatecheck yes updatectime yes We had similar problems where metadata and ACL updates were interpreted as data changes by mmbackup/dsmc. We also have a case open with IBM where mmbackup will both expire and backup a file in the same run, even in the absence of mtime changes, but it's unclear whether that's program error or something with our include/exclude rules. I'd be curious if you're running into that as well. On Wed, Jan 26, 2022 at 03:55:48PM +0000, Paul Ward wrote: > Good call! > > Yes they are dot files. > > > New issue. > > Mmbackup seems to be backup up the same files over and over without them changing: > areas are being backed up multiple times. > The example below is a co-resident file, the only thing that has changed since it was created 20/10/21, is the file has been accessed for backup. > This file is in the 'changed' list in mmbackup: > > This list has just been created: > -rw-r--r--. 1 root root 6591914 Jan 26 11:12 mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa > > Listing the last few files in the file (selecting the last one) > 11:17:52 [root at scale-sk-pn-1 .mmbackupCfg]# tail mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604556977.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557039.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557102.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557164.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557226.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557288.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557351.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557413.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557476.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > > Check the file stats (access time just before last backup) > 11:18:05 [root at scale-sk-pn-1 .mmbackupCfg]# stat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > File: '/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png' > Size: 545 Blocks: 32 IO Block: 4194304 regular file > Device: 2bh/43d Inode: 212618897 Links: 1 > Access: (0644/-rw-r--r--) Uid: (1399613896/NHM\edwab) Gid: (1399647564/NHM\dg-mbl-urban-nature-project-rw) > Context: unconfined_u:object_r:unlabeled_t:s0 > Access: 2022-01-25 06:40:58.334961446 +0000 > Modify: 2020-12-01 15:20:40.122053000 +0000 > Change: 2021-10-20 17:55:18.265746459 +0100 > Birth: - > > Check if migrated > 11:18:16 [root at scale-sk-pn-1 .mmbackupCfg]# dsmls "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > File name : /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > On-line size : 545 > Used blocks : 16 > Data Version : 1 > Meta Version : 1 > State : Co-resident > Container Index : 1 > Base Name : 34C0B77D20194B0B.EACEB2055F6CAA58.56D56C5F140C8C9D.0000000000000000.2197396D.000000000CAC4E91 > > Check if immutable > 11:18:26 [root at scale-sk-pn-1 .mmbackupCfg]# mstat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > file name: /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > metadata replication: 2 max 2 > data replication: 2 max 2 > immutable: no > appendOnly: no > flags: > storage pool name: data > fileset name: hpc-workspaces-fset > snapshot name: > creation time: Wed Oct 20 17:55:18 2021 > Misc attributes: ARCHIVE > Encrypted: no > > Check active and inactive backups (it was backed up yesterday) > 11:18:52 [root at scale-sk-pn-1 .mmbackupCfg]# dsmcqbi "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > IBM Spectrum Protect > Command Line Backup-Archive Client Interface > Client Version 8, Release 1, Level 10.0 > Client date/time: 01/26/2022 11:19:02 > (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. > > Node Name: SC-PN-SK-01 > Session established with server TSM-JERSEY: Windows > Server Version 8, Release 1, Level 10.100 > Server date/time: 01/26/2022 11:19:02 Last access: 01/26/2022 11:07:05 > > Accessing as node: SCALE > Size Backup Date Mgmt Class A/I File > ---- ----------- ---------- --- ---- > 545 B 01/25/2022 06:41:17 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > > > It will be backed up again shortly, why? > > And it was backed up again: > # dsmcqbi /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > IBM Spectrum Protect > Command Line Backup-Archive Client Interface > Client Version 8, Release 1, Level 10.0 > Client date/time: 01/26/2022 15:54:09 > (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. > > Node Name: SC-PN-SK-01 > Session established with server TSM-JERSEY: Windows > Server Version 8, Release 1, Level 10.100 > Server date/time: 01/26/2022 15:54:10 Last access: 01/26/2022 15:30:03 > > Accessing as node: SCALE > Size Backup Date Mgmt Class A/I File > ---- ----------- ---------- --- ---- > 545 B 01/26/2022 12:23:02 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/25/2022 06:41:17 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > > > -----Original Message----- > From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of Skylar Thompson > Sent: 24 January 2022 15:37 > To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > Hi Paul, > > Did you look for dot files? At least for us on 5.0.5 there's a .list.1. file while the backups are running: > > /gpfs/grc6/.mmbackupCfg/updatedFiles/: > -r-------- 1 root nickers 6158526821 Jan 23 18:28 .list.1.gpfs-grc6 > /gpfs/grc6/.mmbackupCfg/expiredFiles/: > -r-------- 1 root nickers 85862211 Jan 23 18:28 .list.1.gpfs-grc6 > > On Mon, Jan 24, 2022 at 02:31:54PM +0000, Paul Ward wrote: > > Those directories are empty > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > > > From: gpfsug-discuss-bounces at spectrumscale.org > > On Behalf Of IBM Spectrum > > Scale > > Sent: 22 January 2022 00:35 > > To: gpfsug main discussion list > > Cc: gpfsug-discuss-bounces at spectrumscale.org > > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > > > > Hi Paul, > > > > Instead of calculating *.ix.* files, please look at a list file in these directories. > > > > updatedFiles : contains a file that lists all candidates for backup > > statechFiles : cantains a file that lists all candidates for meta > > info update expiredFiles : cantains a file that lists all candidates > > for expiration > > > > Regards, The Spectrum Scale (GPFS) team > > > > ---------------------------------------------------------------------- > > -------------------------------------------- > > > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > > > > [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. > > > > From: "Paul Ward" > > > To: "gpfsug main discussion list" > > > org>> > > Cc: > > "gpfsug-discuss-bounces at spectrumscale.org > s at spectrumscale.org>" > > > s at spectrumscale.org>> > > Date: 01/21/2022 09:38 AM > > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > > by: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > > ________________________________ > > > > > > > > Thank you Right in the command line seems to have worked. At the end > > of the script I now copy the contents of the .mmbackupCfg folder to a > > date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > > ZjQcmQRYFpfptBannerEnd > > Thank you > > > > Right in the command line seems to have worked. > > At the end of the script I now copy the contents of the .mmbackupCfg > > folder to a date stamped logging folder > > > > Checking how many entries in these files compared to the Summary: > > wc -l mmbackup* > > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > > 754 total > > From Summary > > Total number of objects inspected: 755 > > I can live with a discrepancy of 1. > > > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > > From Summary > > Total number of objects expired: 2 > > That matches > > > > wc -l mmbackupC* mmbackupS* > > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > > 752 total > > Summary: > > Total number of objects backed up: 751 > > > > A difference of 1 I can live with. > > > > What does Statech stand for? > > > > Just this to sort out: > > Total number of objects failed: 1 > > I will add: > > --tsm-errorlog TSMErrorLogFile > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > > > From: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > > Sent: 19 January 2022 15:09 > > To: gpfsug main discussion list > > > org>> > > Cc: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > > > > This is to set environment for mmbackup. > > If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. > > e.g) in your script > > .... > > export DEBUGmmbackup=2 > > mmbackup .... > > > > Or, you can set it in the same command line like > > DEBUGmmbackup=2 mmbackup .... > > > > Regards, The Spectrum Scale (GPFS) team > > > > ---------------------------------------------------------------------- > > -------------------------------------------- > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > > [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. > > > > From: "Paul Ward" > > > To: "gpfsug main discussion list" > > > org>> > > Cc: > > "gpfsug-discuss-bounces at spectrumscale.org > s at spectrumscale.org>" > > > s at spectrumscale.org>> > > Date: 01/19/2022 06:04 AM > > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > > by: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > > ________________________________ > > > > > > > > > > Thank you. We run a script on all our nodes that checks to see if they > > are the cluster manager. If they are, then they take responsibility to > > start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > > ZjQcmQRYFpfptBannerEnd > > Thank you. > > > > We run a script on all our nodes that checks to see if they are the cluster manager. > > If they are, then they take responsibility to start the backup script. > > The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. > > > > Where does this command belong? > > I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > > > From: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > > Sent: 18 January 2022 22:54 > > To: gpfsug main discussion list > > > org>> > > Cc: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > > Hi Paul, > > > > If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). > > In .mmbackupCfg directory, there are 3 directories: > > updatedFiles : contains a file that lists all candidates for backup > > statechFiles : cantains a file that lists all candidates for meta > > info update expiredFiles : cantains a file that lists all candidates > > for expiration > > > > > > Regards, The Spectrum Scale (GPFS) team > > > > ---------------------------------------------------------------------- > > -------------------------------------------- > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > > [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. > > > > From: "Paul Ward" > > > To: > > "gpfsug-discuss at spectrumscale.org > org>" > > > org>> > > Date: 01/18/2022 11:56 AM > > Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > > ________________________________ > > > > > > > > > > > > Hi, I am trying to work out what files have been sent to backup using > > mmbackup. I have increased the -L value from 3 up to 6 but only seem > > to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > > ZjQcmQRYFpfptBannerEnd > > Hi, > > > > I am trying to work out what files have been sent to backup using mmbackup. > > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > > > I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. > > > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. > > Wrong assumption? > > > > Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > > =0 > fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > > d4c8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8ey > > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > > 0&sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reser > > ved=0> > > > > > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > > =0 > fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > > d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8ey > > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > > 0&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&res > > erved=0> > > > > > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > > ed=0 > gpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp. > > ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437f > > a0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8 > > eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2 > > 000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&r > > eserved=0> > > > > > > > > > > > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > > ed=0 > > > -- > -- Skylar Thompson (skylar2 at u.washington.edu) > -- Genome Sciences Department (UW Medicine), System Administrator > -- Foege Building S046, (206)-685-7354 > -- Pronouns: He/Him/His > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserved=0 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His From arc at b4restore.com Sat Jan 8 22:00:54 2022 From: arc at b4restore.com (=?utf-8?B?QW5kaSBOw7hyIENocmlzdGlhbnNlbg==?=) Date: Sat, 8 Jan 2022 22:00:54 +0000 Subject: [gpfsug-discuss] Has anyone used scale storage with RHEV as POSIX compliant FS and lived to tell the tale? Message-ID: Hi all, Hope its ok to ask this question here.. I was wondering if there was anyone here that has used spectrum scale underneath RHEV/oVirt before? Or still does. That would know how to mount a scale filesystem as a storage domain in RHEV/oVirt? I have a problem with the RHEV host rebooting when trying to mount it. GPFS is installed, configured and mounted on the local host through CLI but not in oVirt. I have tried with these settings in oVirt dashboard: Domain Function: Data Name: name_of_the_domain Storage Type: Posix Compliant FS Path: b4tsz001 (the name of the "device"/"filesystem" created, not an absoluthe path) VFS Type: gpfs Mount Options: rw,relatime,dev=b4tsz001 Using those options, the web interface just tells me it cannot communicate with the storage. If I change it to: Domain Function: Data Name: name_of_the_domain Storage Type: Posix Compliant FS Path: /mnt/b4tsz001 VFS Type: gpfs Mount Options: rw,relatime The oVirt host reboots immediately. No warning just an immediate reboot. I?ve also tried setting owner and permissions on the filesystem after mounting it through GPFS. Same issue.. 😊 chown 36:36 /mnt/b4tsz001 chmod 755 /mnt/b4tsz001 Unfortunately there?s not much use in the logs.. Thanks in advance! Andi Christiansen -------------- next part -------------- An HTML attachment was scrubbed... URL: From s.j.thompson at bham.ac.uk Tue Jan 11 13:56:16 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Tue, 11 Jan 2022 13:56:16 +0000 Subject: [gpfsug-discuss] SSUG::Digital January Day 1 Message-ID: The Spectrum Scale user group digital events return next week with sessions over two days. Day 1: https://www.spectrumscaleug.org/event/digital-user-group-jan-2022-day-1/ We?ll post the join link on the web page above. Simon -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2342 bytes Desc: not available URL: From s.j.thompson at bham.ac.uk Tue Jan 11 13:57:33 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Tue, 11 Jan 2022 13:57:33 +0000 Subject: [gpfsug-discuss] SSUG::Digital January Day 2 Message-ID: The Spectrum Scale user group digital events return next week with sessions over two days. Day 2: https://www.spectrumscaleug.org/event/digital-user-group-jan-2022-day-2/ We?ll post the join link on the web page above. Simon -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2343 bytes Desc: not available URL: From juergen.hannappel at desy.de Thu Jan 13 17:26:12 2022 From: juergen.hannappel at desy.de (Hannappel, Juergen) Date: Thu, 13 Jan 2022 18:26:12 +0100 (CET) Subject: [gpfsug-discuss] 5.1.2.2 changes Message-ID: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Hi, just got notified that 5.1.2.2 is out. What are the changes to 5.1.2.1? https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes does not specify that.... -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 From s.j.thompson at bham.ac.uk Thu Jan 13 17:40:05 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Thu, 13 Jan 2022 17:40:05 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: Try: https://public.dhe.ibm.com/storage/spectrumscale/spectrum_scale_apars_512x.html ? At least that lists the APARs resolved anyway. Given it is a PTF, I would mostly expect the changes to be APAR type fixes? And don?t forget the ?What is new in 5.1.2? talk next week - https://www.spectrumscaleug.org/event/digital-user-group-jan-2022-day-1/ (sure that isn?t specific to the -2 PTF) Simon From: gpfsug-discuss-bounces at spectrumscale.org on behalf of juergen.hannappel at desy.de Date: Thursday, 13 January 2022 at 17:27 To: gpfsug main discussion list Subject: [gpfsug-discuss] 5.1.2.2 changes Hi, just got notified that 5.1.2.2 is out. What are the changes to 5.1.2.1? https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes does not specify that.... -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From mark.bergman at uphs.upenn.edu Thu Jan 13 17:39:08 2022 From: mark.bergman at uphs.upenn.edu (mark.bergman at uphs.upenn.edu) Date: Thu, 13 Jan 2022 12:39:08 -0500 Subject: [gpfsug-discuss] [External] 5.1.2.2 changes In-Reply-To: Your message of "Thu, 13 Jan 2022 18:26:12 +0100." <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: <1377783-1642095548.592187@I9hg.LwGL.0znY> In the message dated: Thu, 13 Jan 2022 18:26:12 +0100, The pithy ruminations from "Hannappel, Juergen" on [[External] [gpfsug-discuss] 5.1.2.2 changes] were: => Hi, => just got notified that 5.1.2.2 is out. => What are the changes to 5.1.2.1? => https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes => does not specify that.... The change that I noticed most was: Repair functionality of mmfsck command in online mode is deprecated The repair functionality of mmfsck command in online mode is no longer available. The report-only operation still works in the online mode. While I know that mmfsck is rarely needed and has gotten much faster, deprecating the ability to do any online repairs seems like a significant regression. => => -- => Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 => _______________________________________________ => gpfsug-discuss mailing list => gpfsug-discuss at spectrumscale.org => http://gpfsug.org/mailman/listinfo/gpfsug-discuss => From juergen.hannappel at desy.de Thu Jan 13 18:16:45 2022 From: juergen.hannappel at desy.de (Hannappel, Juergen) Date: Thu, 13 Jan 2022 19:16:45 +0100 (CET) Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs Message-ID: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Hi, I noticed that whe I read directory entries with the usual readdir() function that for fifos I get in the d_type files a 0, i.e. DT_UNKNOWN while if I try that on a different file system e.g. ext4 I get the expected DT_FIFO. Is this a bug or an expected feature? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 From scale at us.ibm.com Fri Jan 14 07:05:11 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Fri, 14 Jan 2022 12:35:11 +0530 Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs In-Reply-To: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> References: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Message-ID: Hi Steve, Can you please look into the below query from Hannappel. Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479. If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team. From: "Hannappel, Juergen" To: "gpfsug main discussion list" Date: 13-01-2022 11.46 PM Subject: [EXTERNAL] [gpfsug-discuss] struct dirent d_type for fifos on gpfs Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I noticed that whe I read directory entries with the usual readdir() function that for fifos I get in the d_type files a 0, i.e. DT_UNKNOWN while if I try that on a different file system e.g. ext4 I get the expected DT_FIFO. Is this a bug or an expected feature? -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: From jonathan.buzzard at strath.ac.uk Fri Jan 14 14:37:50 2022 From: jonathan.buzzard at strath.ac.uk (Jonathan Buzzard) Date: Fri, 14 Jan 2022 14:37:50 +0000 Subject: [gpfsug-discuss] [External] 5.1.2.2 changes In-Reply-To: <1377783-1642095548.592187@I9hg.LwGL.0znY> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> <1377783-1642095548.592187@I9hg.LwGL.0znY> Message-ID: <3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> On 13/01/2022 17:39, mark.bergman at uphs.upenn.edu wrote: [SNIP] > > The change that I noticed most was: > > Repair functionality of mmfsck command in online mode is deprecated > The repair functionality of mmfsck command in online mode is no longer available. The report-only operation still works in the online mode. > > While I know that mmfsck is rarely needed and has gotten much faster, deprecating the ability to do any online repairs seems > like a significant regression. > I would concur with that sentiment, and given it is a significant regression I would suggest that it IBM should give an explanation as to why functionality has been removed. Been able to do online repairs on large file systems is when you need it a complete life saver. It could be the difference between several days of outage vs. end users not realizing there was even a problem. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG From scale at us.ibm.com Fri Jan 14 16:27:26 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Fri, 14 Jan 2022 12:27:26 -0400 Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs In-Reply-To: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> References: <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Message-ID: This is expected. GPFS readdir only support d_type: DT_REG, DT_DIR and DT_LNK. All other type will be returned as DT_UNKNOWN. Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If you feel that your question can benefit other users of Spectrum Scale (GPFS), then please post it to the public IBM developerWroks Forum at https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479 . If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. The forum is informally monitored as time permits and should not be used for priority messages to the Spectrum Scale (GPFS) team. -------------- next part -------------- An HTML attachment was scrubbed... URL: From lgayne at us.ibm.com Fri Jan 14 16:38:19 2022 From: lgayne at us.ibm.com (Lyle Gayne) Date: Fri, 14 Jan 2022 16:38:19 +0000 Subject: [gpfsug-discuss] struct dirent d_type for fifos on gpfs In-Reply-To: References: , <829073771.10291012.1642097805106.JavaMail.zimbra@desy.de> Message-ID: An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Image.1__=0ABB0D59DFB540138f9e8a93df938690 at ibm.com.gif Type: image/gif Size: 105 bytes Desc: not available URL: From p.childs at qmul.ac.uk Mon Jan 17 11:29:54 2022 From: p.childs at qmul.ac.uk (Peter Childs) Date: Mon, 17 Jan 2022 11:29:54 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: https://public.dhe.ibm.com/storage/spectrumscale/spectrum_scale_apars_512x.html Is normally the best place to look for changes in PTF releases. Peter Childs ITS Research Storage Queen Mary University Of London ________________________________________ From: gpfsug-discuss-bounces at spectrumscale.org on behalf of Hannappel, Juergen Sent: Thursday, January 13, 2022 5:26 PM To: gpfsug main discussion list Subject: [EXTERNAL] [gpfsug-discuss] 5.1.2.2 changes CAUTION: This email originated from outside of QMUL. Do not click links or open attachments unless you recognise the sender and know the content is safe. Hi, just got notified that 5.1.2.2 is out. What are the changes to 5.1.2.1? https://www.ibm.com/docs/en/spectrum-scale/5.1.2?topic=summary-changes does not specify that.... -- Dr. J?rgen Hannappel DESY/IT Tel. : +49 40 8998-4616 _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss From s.j.thompson at bham.ac.uk Mon Jan 17 12:27:34 2022 From: s.j.thompson at bham.ac.uk (Simon Thompson) Date: Mon, 17 Jan 2022 12:27:34 +0000 Subject: [gpfsug-discuss] [External] 5.1.2.2 changes In-Reply-To: <3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> <1377783-1642095548.592187@I9hg.LwGL.0znY> <3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> Message-ID: My guess is ? they decided it was unsafe. I?m sure I?ve seen a few release notes that have referred to mmfsck and data corruption. e.g.: https://www.ibm.com/support/pages/ibm-spectrum-scale-alert-all-supported-versions-may-be-affected-issue-online-mmfsck-which-may-result-file-system-corruption So maybe it was classified as too dangerous to leave in the field? Simon From: gpfsug-discuss-bounces at spectrumscale.org on behalf of Jonathan Buzzard Date: Friday, 14 January 2022 at 14:38 To: gpfsug-discuss at spectrumscale.org Subject: Re: [gpfsug-discuss] [External] 5.1.2.2 changes On 13/01/2022 17:39, mark.bergman at uphs.upenn.edu wrote: [SNIP] > > The change that I noticed most was: > > Repair functionality of mmfsck command in online mode is deprecated > The repair functionality of mmfsck command in online mode is no longer available. The report-only operation still works in the online mode. > > While I know that mmfsck is rarely needed and has gotten much faster, deprecating the ability to do any online repairs seems > like a significant regression. > I would concur with that sentiment, and given it is a significant regression I would suggest that it IBM should give an explanation as to why functionality has been removed. Been able to do online repairs on large file systems is when you need it a complete life saver. It could be the difference between several days of outage vs. end users not realizing there was even a problem. JAB. -- Jonathan A. Buzzard Tel: +44141-5483420 HPC System Administrator, ARCHIE-WeSt. University of Strathclyde, John Anderson Building, Glasgow. G4 0NG _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: From MDIETZ at de.ibm.com Mon Jan 17 18:21:18 2022 From: MDIETZ at de.ibm.com (Mathias Dietz) Date: Mon, 17 Jan 2022 18:21:18 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: References: , <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de><1377783-1642095548.592187@I9hg.LwGL.0znY><3e6fffbc-1fb9-f8c8-2957-2bc6415218a0@strath.ac.uk> Message-ID: An HTML attachment was scrubbed... URL: From cabrillo at ifca.unican.es Tue Jan 18 16:08:50 2022 From: cabrillo at ifca.unican.es (Iban Cabrillo) Date: Tue, 18 Jan 2022 17:08:50 +0100 (CET) Subject: [gpfsug-discuss] Filesystem sometimes does not correctly inherit acls Message-ID: <575239190.9166807.1642522130898.JavaMail.zimbra@ifca.unican.es> Dear Scalers, We are running 5.1.1-0 version. Since a couple of months we have noticed, that the directory permissions are not inherited correctly even if the default acl is set correctly: For example this is the default acl for a directory (mmgetacl -d): #owner:100 #group:101 user::rwxc group::r-x- other::---- mask::rwxc user:user1:rwxc group:group1:rwx- group:group2:rwx- group:group3:rwx- But sometimes when a new dir is creted under this directory i see this: #owner:100 #group:101 user::rwxc group::r-x- #effective: ---- other::---- mask::---c user:user1:rwxc #effective: ---c group:group1:rwx- #effective: ---- group:group2:rwx- #effective: ---- group:group3:rwx- #effective: ---- Any Idea about this behavior ? Regards, I -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Tue Jan 18 16:56:17 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Tue, 18 Jan 2022 16:56:17 +0000 Subject: [gpfsug-discuss] mmbackup file selections Message-ID: Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. Wrong assumption? Where should I be looking - surely it shouldn't be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: From scl at virginia.edu Tue Jan 18 19:52:12 2022 From: scl at virginia.edu (Losen, Stephen C (scl)) Date: Tue, 18 Jan 2022 19:52:12 +0000 Subject: [gpfsug-discuss] Filesystem sometimes does not correctly inherit acls In-Reply-To: <575239190.9166807.1642522130898.JavaMail.zimbra@ifca.unican.es> References: <575239190.9166807.1642522130898.JavaMail.zimbra@ifca.unican.es> Message-ID: <9B932E92-1FAB-4B9E-9987-6DDBA7716D28@virginia.edu> Hi Iban, What you are seeing is what you get if you call mkdir(2) like this from C mkdir(?dirname?, 0700); or in a python script like this import os os.mkdir(?dirname?, Oo700) Or you could use chmod on the directory like this: chmod 700 dirname All of these modify the ACL mask entry so that it no longer matches the default ACL mask. Notice how everything else in the ACL still matches the default ACL. You can easily set the mask back with chmod g+rwx dirname (assuming that your fileset is configured to allow chmod). Steve Losen Research Computing University of Virginia scl at virginia.edu 434-924-0640 From: on behalf of Iban Cabrillo Reply-To: gpfsug main discussion list Date: Tuesday, January 18, 2022 at 11:26 AM To: gpfsug-discuss Subject: [gpfsug-discuss] Filesystem sometimes does not correctly inherit acls Dear Scalers, We are running 5.1.1-0 version. Since a couple of months we have noticed, that the directory permissions are not inherited correctly even if the default acl is set correctly: For example this is the default acl for a directory (mmgetacl -d): #owner:100 #group:101 user::rwxc group::r-x- other::---- mask::rwxc user:user1:rwxc group:group1:rwx- group:group2:rwx- group:group3:rwx- But sometimes when a new dir is creted under this directory i see this: #owner:100 #group:101 user::rwxc group::r-x- #effective: ---- other::---- mask::---c user:user1:rwxc #effective: ---c group:group1:rwx- #effective: ---- group:group2:rwx- #effective: ---- group:group3:rwx- #effective: ---- Any Idea about this behavior ? Regards, I -------------- next part -------------- An HTML attachment was scrubbed... URL: From scale at us.ibm.com Tue Jan 18 22:53:46 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Tue, 18 Jan 2022 18:53:46 -0400 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. From: "Paul Ward" To: "gpfsug-discuss at spectrumscale.org" Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 2E582126.jpg Type: image/jpeg Size: 5356 bytes Desc: not available URL: From p.ward at nhm.ac.uk Wed Jan 19 11:03:47 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Wed, 19 Jan 2022 11:03:47 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run - on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" > To: "gpfsug-discuss at spectrumscale.org" > Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. Wrong assumption? Where should I be looking - surely it shouldn't be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 105 bytes Desc: image002.gif URL: From scale at us.ibm.com Wed Jan 19 15:08:53 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Wed, 19 Jan 2022 11:08:53 -0400 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2 " right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. From: "Paul Ward" To: "gpfsug main discussion list" Cc: "gpfsug-discuss-bounces at spectrumscale.org" Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" To: "gpfsug-discuss at spectrumscale.org" Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 1A584757.jpg Type: image/jpeg Size: 5356 bytes Desc: not available URL: From skylar2 at uw.edu Wed Jan 19 15:39:55 2022 From: skylar2 at uw.edu (Skylar Thompson) Date: Wed, 19 Jan 2022 07:39:55 -0800 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: <20220119153955.wao2yhyqbr5s2uk2@utumno.gs.washington.edu> Hi Paul, Not to toot my own horn and while the DEBUGmmbackup=2 method definitely does work, you might want to vote for this RFE I put in a month ago to get a more robust "dry run" mode with mmbackup, since guessing how include/exclude rules get translated from SP/dsmc to SS/mmbackup can be challenging: https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=153520 Somewhat selfishly, I think implementing the RFE would benefit you as well. :) On Tue, Jan 18, 2022 at 04:56:17PM +0000, Paul Ward wrote: > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking - surely it shouldn't be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His From heinrich.billich at id.ethz.ch Thu Jan 20 10:55:01 2022 From: heinrich.billich at id.ethz.ch (Billich Heinrich Rainer (ID)) Date: Thu, 20 Jan 2022 10:55:01 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> Message-ID: <86ED32E1-2E2E-4FA6-9313-BA673CAF212B@id.ethz.ch> Hello, I just wonder if I can set a fileset to readonly - or link it as readonly. When I do data migration or finished a project which has it?s own fileset assigned it would be nice if I could just set the fileset to readonly to make sure that nothing and nobody can do any changes. There may be more cases ? Immutability seems overkill, and I can?t revert it Related: If I setup an afm cache fileset in readonly mode ? is this enforced on the cache side or just by convention? The afm gateways need to write to cache anyway, so probably other processes can, too? If anybody could comment and maybe also explain why it?s been designed the way it is? Thank you, Heiner -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5254 bytes Desc: not available URL: From anacreo at gmail.com Thu Jan 20 17:50:21 2022 From: anacreo at gmail.com (Alec) Date: Thu, 20 Jan 2022 09:50:21 -0800 Subject: [gpfsug-discuss] 5.1.2.2 changes In-Reply-To: <86ED32E1-2E2E-4FA6-9313-BA673CAF212B@id.ethz.ch> References: <1166039962.10256035.1642094772319.JavaMail.zimbra@desy.de> <86ED32E1-2E2E-4FA6-9313-BA673CAF212B@id.ethz.ch> Message-ID: Not sure if still supported but you could try tagging all the files/directories in a fileset with the immutable attribute using the policy engine. Not sure if that will cover what you need. You can simply use policy engine to add or subtract that attribute at will. It's biggest drawback may be exactly what you're looking for. You could get fancy and mount the gpfs volume twice once read-wrire and a second read-only.. then use mount command to mount over the read only filesystem ontop of the read-write filesystem at the appropriate junctures. You'd have to do this on each node you want affected... So: /FileSys/FileSetA /FileSys/FileSetB Mount FileSys again as /ro/FileSys and share out /ro/FileSys/FileSetA use read only option on mount. Mount /ro/FileSys/FileSetA ontop of /FileSys/FileSetA. I dont have root on my GPFS filesystems so I can't test this out... But would work on most other Unit FSs. Alec On Thu, Jan 20, 2022, 3:10 AM Billich Heinrich Rainer (ID) < heinrich.billich at id.ethz.ch> wrote: > Hello, > > I just wonder if I can set a fileset to readonly - or link it as > readonly. When I do data migration or finished a project which has it?s own > fileset assigned it would be nice if I could just set the fileset to > readonly to make sure that nothing and nobody can do any changes. There may > be more cases ? > > Immutability seems overkill, and I can?t revert it > > Related: If I setup an afm cache fileset in readonly mode ? is this > enforced on the cache side or just by convention? The afm gateways need to > write to cache anyway, so probably other processes can, too? > > If anybody could comment and maybe also explain why it?s been designed the > way it is? > > Thank you, > > Heiner > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Fri Jan 21 14:38:37 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Fri, 21 Jan 2022 14:38:37 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: wc -l mmbackup* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 754 total >From Summary Total number of objects inspected: 755 I can live with a discrepancy of 1. 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa >From Summary Total number of objects expired: 2 That matches wc -l mmbackupC* mmbackupS* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 752 total Summary: Total number of objects backed up: 751 A difference of 1 I can live with. What does Statech stand for? Just this to sort out: Total number of objects failed: 1 I will add: --tsm-errorlog TSMErrorLogFile Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 19 January 2022 15:09 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. From: "Paul Ward" > To: "gpfsug main discussion list" > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run - on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" > To: "gpfsug-discuss at spectrumscale.org" > Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. Wrong assumption? Where should I be looking - surely it shouldn't be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 105 bytes Desc: image002.gif URL: From p.ward at nhm.ac.uk Fri Jan 21 14:38:50 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Fri, 21 Jan 2022 14:38:50 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: <20220119153955.wao2yhyqbr5s2uk2@utumno.gs.washington.edu> References: <20220119153955.wao2yhyqbr5s2uk2@utumno.gs.washington.edu> Message-ID: Got my vote. Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk -----Original Message----- From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of Skylar Thompson Sent: 19 January 2022 15:40 To: gpfsug-discuss at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, Not to toot my own horn and while the DEBUGmmbackup=2 method definitely does work, you might want to vote for this RFE I put in a month ago to get a more robust "dry run" mode with mmbackup, since guessing how include/exclude rules get translated from SP/dsmc to SS/mmbackup can be challenging: https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.ibm.com%2Fdeveloperworks%2Frfe%2Fexecute%3Fuse_case%3DviewRfe%26CR_ID%3D153520&data=04%7C01%7Cp.ward%40nhm.ac.uk%7C1898b9c0b030441112e708d9db61fb44%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637782037020043251%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=WCBNcdWnDtZL%2B8qPahZO0gFFdBAW1X%2BPyL6pI71r804%3D&reserved=0 Somewhat selfishly, I think implementing the RFE would benefit you as well. :) On Tue, Jan 18, 2022 at 04:56:17PM +0000, Paul Ward wrote: > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can't seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn't match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking - surely it shouldn't be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7C1898b9c0b030441112e708d9db61fb44%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637782037020043251%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=8NvIypofEOlGwDKQpZA6aorxKo5G0hYWt9mi9QZe9x8%3D&reserved=0 -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward%40nhm.ac.uk%7C1898b9c0b030441112e708d9db61fb44%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637782037020043251%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=8NvIypofEOlGwDKQpZA6aorxKo5G0hYWt9mi9QZe9x8%3D&reserved=0 From jesus.mora at 4ks.mx Fri Jan 21 15:17:07 2022 From: jesus.mora at 4ks.mx (Jesus Mora Luna) Date: Fri, 21 Jan 2022 09:17:07 -0600 Subject: [gpfsug-discuss] How do I add a new IP to the configuration? Message-ID: Good day Please can you help me to solve a problem that I have with the modification of an ESS to add a new IP to share the volumes in a new network. The issue is that I already tried to add the IP with the corresponding commands and what it tells me is that it does not find the network, I also tried to add the IP directly to one of the Ethernet interfaces and it does not let me do it. Where can I find or can you share the procedure if it is available to add a new IP Thanking you in advance for your attention to my request, I look forward to your response and comments. Greetings and thanks Jes?s Mora Luna Servicios Continuos System Engineer Jesus.mora at 4ks.mx Oficina 55 41636541 M?vil 55 14853753 Ignacio Allende N? 21 Ampliaci?n Torre Blanca Miguel Hidalgo, CDMX 11289 www.4ks.mx Descripci?n: Descripci?n: Descripci?n: https://docs.google.com/uc?export=download&id=11HlTv0TDj5BTu4hVCM-2rNkHWnmxA H5E&revid=0ByZwGRTUTp29c0VQdWVKWVRaT0dkUEVDK3hRckc4MCtJWVZnPQ Descripci?n: Descripci?n: Descripci?n: https://docs.google.com/uc?export=download&id=1NomENnxEOLpSFfGyStQMonSuz83p3 3aL&revid=0ByZwGRTUTp29NTlqVzMyMEVhQnNnNUt5eGpzY3M3MGNGeXZ3PQ -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 16220 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 49179 bytes Desc: not available URL: From anacreo at gmail.com Sat Jan 22 00:02:10 2022 From: anacreo at gmail.com (Alec) Date: Fri, 21 Jan 2022 16:02:10 -0800 Subject: [gpfsug-discuss] How do I add a new IP to the configuration? In-Reply-To: References: Message-ID: It sounds like you are attempting to add multiple networks to the same interface. So if your existing ESS is not on a network that is routed to your new clients then you'll need to do one of the following: 1) Establish routing between the new ESS client IP's and your existing ESS servers. 2) Add a Virtual Interface with that network's VLAN on it (or the VLAN of a network that is routed to the new client). 3) Configure new interfaces on the ESS with the new network. No one else answered, and unfortunately I don't own an ESS so I can't tell you had to do step #2. But typically a scenario would look like this: ESS 1st interface IP is 192.168.1.150 subnetmask 255.255.0.0 and default gateway 192.168.0.1 With this anything in the 192.168.x.x address space could be added to the 1st interface as they are all local to that address. Now you're presented with needing to offer data to something on IP 10.1.20.30, and 192.168.0.1 doesn't know how to reach that interface, or we don't want that data flowing across routes. If we don't want to add another physical interface to ESS we have to get into VLAN configuration (Virtual LAN)... Now we say VLAN 0 is going to be 192.168.0.0 network and it's the default network (anything not tagged goes there)... And the network team has 10.0.0.0 network on VLAN 10... So we ask the network team to add VLAN 10 to our 1st interface. It should now have VLAN 0 and VLAN 10. I don't know how but somehow in the ESS you're now going to have to add a new virtual adapter that is bound to VLAN 10... and since the first interface didn't have VLAN's it will continue to use the now default VLAN 0. Once we have that 2nd virtual adaptor on VLAN 10 we can define it as... 2nd interface (still on the 1st physical interface, but a virtual adapter) IP is 10.240.1.150 (let's say 10.240 is going to be the ESS's portion of the 10 network).. and we define the subnetmask 255.0.0.0 and maybe no route... It really needs for your network team to define how they want you to proceed and then figure out how the ESS can be configured to consume that network design. What you can't do is straight up put two IP's from different subnets on the same interface. Essentially the logical interface will look at it's IP, it's Subnet combine the values with your new IP and say, hey wrong network. Alec On Fri, Jan 21, 2022, 7:17 AM Jesus Mora Luna wrote: > Good day > > > > Please can you help me to solve a problem that I have with the > modification of an ESS to add a new IP to share the volumes in a new > network. > > > > The issue is that I already tried to add the IP with the corresponding > commands and what it tells me is that it does not find the network, I also > tried to add the IP directly to one of the Ethernet interfaces and it does > not let me do it. > > > > Where can I find or can you share the procedure if it is available to add > a new IP > > > > Thanking you in advance for your attention to my request, I look forward > to your response and comments. > > > > Greetings and thanks > > > > *Jes?s Mora Luna * > > Servicios Continuos > > System Engineer > > Jesus.mora at 4ks.mx > > Oficina 55 41636541 > > M?vil 55 14853753 > > Ignacio Allende N? 21 > > Ampliaci?n Torre Blanca Miguel Hidalgo, CDMX 11289 > > www.4ks.mx > > > > [image: Descripci?n: Descripci?n: Descripci?n: > https://docs.google.com/uc?export=download&id=11HlTv0TDj5BTu4hVCM-2rNkHWnmxAH5E&revid=0ByZwGRTUTp29c0VQdWVKWVRaT0dkUEVDK3hRckc4MCtJWVZnPQ] > > > > [image: Descripci?n: Descripci?n: Descripci?n: > https://docs.google.com/uc?export=download&id=1NomENnxEOLpSFfGyStQMonSuz83p33aL&revid=0ByZwGRTUTp29NTlqVzMyMEVhQnNnNUt5eGpzY3M3MGNGeXZ3PQ] > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 16220 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 49179 bytes Desc: not available URL: From scale at us.ibm.com Sat Jan 22 00:35:24 2022 From: scale at us.ibm.com (IBM Spectrum Scale) Date: Fri, 21 Jan 2022 20:35:24 -0400 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Hi Paul, Instead of calculating *.ix.* files, please look at a list file in these directories. updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. From: "Paul Ward" To: "gpfsug main discussion list" Cc: "gpfsug-discuss-bounces at spectrumscale.org" Date: 01/21/2022 09:38 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: wc -l mmbackup* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 754 total From Summary Total number of objects inspected: 755 I can live with a discrepancy of 1. 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa From Summary Total number of objects expired: 2 That matches wc -l mmbackupC* mmbackupS* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 752 total Summary: Total number of objects backed up: 751 A difference of 1 I can live with. What does Statech stand for? Just this to sort out: Total number of objects failed: 1 I will add: --tsm-errorlog TSMErrorLogFile Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 19 January 2022 15:09 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. From: "Paul Ward" To: "gpfsug main discussion list" Cc: "gpfsug-discuss-bounces at spectrumscale.org" < gpfsug-discuss-bounces at spectrumscale.org> Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated From: gpfsug-discuss-bounces at spectrumscale.org < gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" To: "gpfsug-discuss at spectrumscale.org" Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk A picture containing drawing Description automatically generated _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: graycol.gif Type: image/gif Size: 105 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: 29915401.jpg Type: image/jpeg Size: 5356 bytes Desc: not available URL: From spectrumscale at kiranghag.com Sat Jan 22 05:26:53 2022 From: spectrumscale at kiranghag.com (KG) Date: Sat, 22 Jan 2022 10:56:53 +0530 Subject: [gpfsug-discuss] How do I add a new IP to the configuration? In-Reply-To: References: Message-ID: Hi The CES service on protocol nodes binds to all available addresses including fixed IP addresses. You would need to add a virtual interface on existing interface (or setup a new interface) and assign IP to it (from the new subnet that you wish to add). After that add IPs to CES pool. The CES pool will then attach to newly added interface. You may have to restart the CES service/protocol node daemon. On Sat, Jan 22, 2022 at 5:32 AM Alec wrote: > It sounds like you are attempting to add multiple networks to the same > interface. > > So if your existing ESS is not on a network that is routed to your new > clients then you'll need to do one of the following: > > 1) Establish routing between the new ESS client IP's and your existing ESS > servers. > 2) Add a Virtual Interface with that network's VLAN on it (or the VLAN of > a network that is routed to the new client). > 3) Configure new interfaces on the ESS with the new network. > > No one else answered, and unfortunately I don't own an ESS so I can't tell > you had to do step #2. > > But typically a scenario would look like this: > > ESS > 1st interface IP is 192.168.1.150 subnetmask 255.255.0.0 and default > gateway 192.168.0.1 > > With this anything in the 192.168.x.x address space could be added to > the 1st interface as they are all local to that address. > > Now you're presented with needing to offer data to something on IP > 10.1.20.30, and 192.168.0.1 doesn't know how to reach that interface, or we > don't want that data flowing across routes. > > If we don't want to add another physical interface to ESS we have to get > into VLAN configuration (Virtual LAN)... > > Now we say VLAN 0 is going to be 192.168.0.0 network and it's the > default network (anything not tagged goes there)... > And the network team has 10.0.0.0 network on VLAN 10... So we ask the > network team to add VLAN 10 to our 1st interface. It should now have VLAN > 0 and VLAN 10. > > I don't know how but somehow in the ESS you're now going to have to add > a new virtual adapter that is bound to VLAN 10... and since the first > interface didn't have VLAN's it will continue to use the now default VLAN 0. > > Once we have that 2nd virtual adaptor on VLAN 10 we can define it as... > 2nd interface (still on the 1st physical interface, but a virtual > adapter) IP is 10.240.1.150 (let's say 10.240 is going to be the ESS's > portion of the 10 network).. and we define the subnetmask 255.0.0.0 and > maybe no route... > > It really needs for your network team to define how they want you to > proceed and then figure out how the ESS can be configured to consume that > network design. > > What you can't do is straight up put two IP's from different subnets on > the same interface. Essentially the logical interface will look at it's > IP, it's Subnet combine the values with your new IP and say, hey wrong > network. > > Alec > > On Fri, Jan 21, 2022, 7:17 AM Jesus Mora Luna wrote: > >> Good day >> >> >> >> Please can you help me to solve a problem that I have with the >> modification of an ESS to add a new IP to share the volumes in a new >> network. >> >> >> >> The issue is that I already tried to add the IP with the corresponding >> commands and what it tells me is that it does not find the network, I also >> tried to add the IP directly to one of the Ethernet interfaces and it does >> not let me do it. >> >> >> >> Where can I find or can you share the procedure if it is available to add >> a new IP >> >> >> >> Thanking you in advance for your attention to my request, I look forward >> to your response and comments. >> >> >> >> Greetings and thanks >> >> >> >> *Jes?s Mora Luna * >> >> Servicios Continuos >> >> System Engineer >> >> Jesus.mora at 4ks.mx >> >> Oficina 55 41636541 >> >> M?vil 55 14853753 >> >> Ignacio Allende N? 21 >> >> Ampliaci?n Torre Blanca Miguel Hidalgo, CDMX 11289 >> >> www.4ks.mx >> >> >> >> [image: Descripci?n: Descripci?n: Descripci?n: >> https://docs.google.com/uc?export=download&id=11HlTv0TDj5BTu4hVCM-2rNkHWnmxAH5E&revid=0ByZwGRTUTp29c0VQdWVKWVRaT0dkUEVDK3hRckc4MCtJWVZnPQ] >> >> >> >> [image: Descripci?n: Descripci?n: Descripci?n: >> https://docs.google.com/uc?export=download&id=1NomENnxEOLpSFfGyStQMonSuz83p33aL&revid=0ByZwGRTUTp29NTlqVzMyMEVhQnNnNUt5eGpzY3M3MGNGeXZ3PQ] >> >> >> _______________________________________________ >> gpfsug-discuss mailing list >> gpfsug-discuss at spectrumscale.org >> http://gpfsug.org/mailman/listinfo/gpfsug-discuss >> > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From p.ward at nhm.ac.uk Mon Jan 24 14:31:54 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Mon, 24 Jan 2022 14:31:54 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: Those directories are empty Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale Sent: 22 January 2022 00:35 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, Instead of calculating *.ix.* files, please look at a list file in these directories. updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. From: "Paul Ward" > To: "gpfsug main discussion list" > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > Date: 01/21/2022 09:38 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: wc -l mmbackup* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 754 total >From Summary Total number of objects inspected: 755 I can live with a discrepancy of 1. 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa >From Summary Total number of objects expired: 2 That matches wc -l mmbackupC* mmbackupS* 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa 752 total Summary: Total number of objects backed up: 751 A difference of 1 I can live with. What does Statech stand for? Just this to sort out: Total number of objects failed: 1 I will add: --tsm-errorlog TSMErrorLogFile Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale Sent: 19 January 2022 15:09 To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections This is to set environment for mmbackup. If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. e.g) in your script .... export DEBUGmmbackup=2 mmbackup .... Or, you can set it in the same command line like DEBUGmmbackup=2 mmbackup .... Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. From: "Paul Ward" > To: "gpfsug main discussion list" > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > Date: 01/19/2022 06:04 AM Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. Where does this command belong? I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale Sent: 18 January 2022 22:54 To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). In .mmbackupCfg directory, there are 3 directories: updatedFiles : contains a file that lists all candidates for backup statechFiles : cantains a file that lists all candidates for meta info update expiredFiles : cantains a file that lists all candidates for expiration Regards, The Spectrum Scale (GPFS) team ------------------------------------------------------------------------------------------------------------------ If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. From: "Paul Ward" > To: "gpfsug-discuss at spectrumscale.org" > Date: 01/18/2022 11:56 AM Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: gpfsug-discuss-bounces at spectrumscale.org ________________________________ Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. Wrong assumption? Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk [A picture containing drawing Description automatically generated] _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.jpg Type: image/jpeg Size: 5356 bytes Desc: image001.jpg URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.gif Type: image/gif Size: 105 bytes Desc: image002.gif URL: From skylar2 at uw.edu Mon Jan 24 15:36:31 2022 From: skylar2 at uw.edu (Skylar Thompson) Date: Mon, 24 Jan 2022 07:36:31 -0800 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: Message-ID: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> Hi Paul, Did you look for dot files? At least for us on 5.0.5 there's a .list.1. file while the backups are running: /gpfs/grc6/.mmbackupCfg/updatedFiles/: -r-------- 1 root nickers 6158526821 Jan 23 18:28 .list.1.gpfs-grc6 /gpfs/grc6/.mmbackupCfg/expiredFiles/: -r-------- 1 root nickers 85862211 Jan 23 18:28 .list.1.gpfs-grc6 On Mon, Jan 24, 2022 at 02:31:54PM +0000, Paul Ward wrote: > Those directories are empty > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of IBM Spectrum Scale > Sent: 22 January 2022 00:35 > To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > Hi Paul, > > Instead of calculating *.ix.* files, please look at a list file in these directories. > > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta info update > expiredFiles : cantains a file that lists all candidates for expiration > > Regards, The Spectrum Scale (GPFS) team > > ------------------------------------------------------------------------------------------------------------------ > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > > Date: 01/21/2022 09:38 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > ________________________________ > > > > Thank you Right in the command line seems to have worked. At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart > This Message Is From an External Sender > This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you > > Right in the command line seems to have worked. > At the end of the script I now copy the contents of the .mmbackupCfg folder to a date stamped logging folder > > Checking how many entries in these files compared to the Summary: > wc -l mmbackup* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 754 total > From Summary > Total number of objects inspected: 755 > I can live with a discrepancy of 1. > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > From Summary > Total number of objects expired: 2 > That matches > > wc -l mmbackupC* mmbackupS* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 752 total > Summary: > Total number of objects backed up: 751 > > A difference of 1 I can live with. > > What does Statech stand for? > > Just this to sort out: > Total number of objects failed: 1 > I will add: > --tsm-errorlog TSMErrorLogFile > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale > Sent: 19 January 2022 15:09 > To: gpfsug main discussion list > > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > This is to set environment for mmbackup. > If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. > e.g) in your script > .... > export DEBUGmmbackup=2 > mmbackup .... > > Or, you can set it in the same command line like > DEBUGmmbackup=2 mmbackup .... > > Regards, The Spectrum Scale (GPFS) team > > ------------------------------------------------------------------------------------------------------------------ > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > > Cc: "gpfsug-discuss-bounces at spectrumscale.org" > > Date: 01/19/2022 06:04 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > ________________________________ > > > > > Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. If they are, then they take responsibility to start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart > This Message Is From an External Sender > This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you. > > We run a script on all our nodes that checks to see if they are the cluster manager. > If they are, then they take responsibility to start the backup script. > The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. > > Where does this command belong? > I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum Scale > Sent: 18 January 2022 22:54 > To: gpfsug main discussion list > > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > Hi Paul, > > If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). > In .mmbackupCfg directory, there are 3 directories: > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta info update > expiredFiles : cantains a file that lists all candidates for expiration > > > Regards, The Spectrum Scale (GPFS) team > > ------------------------------------------------------------------------------------------------------------------ > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. > > From: "Paul Ward" > > To: "gpfsug-discuss at spectrumscale.org" > > Date: 01/18/2022 11:56 AM > Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections > Sent by: gpfsug-discuss-bounces at spectrumscale.org > > ________________________________ > > > > > > Hi, I am trying to work out what files have been sent to backup using mmbackup. I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart > This Message Is From an External Sender > This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss > > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His From Alifiya.Kantawala at ibm.com Tue Jan 25 15:05:02 2022 From: Alifiya.Kantawala at ibm.com (Alifiya Kantawala) Date: Tue, 25 Jan 2022 15:05:02 +0000 Subject: [gpfsug-discuss] 5.1.2.2 changes Message-ID: An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Image.16431227650740.png Type: image/png Size: 75092 bytes Desc: not available URL: From p.ward at nhm.ac.uk Wed Jan 26 15:55:48 2022 From: p.ward at nhm.ac.uk (Paul Ward) Date: Wed, 26 Jan 2022 15:55:48 +0000 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> References: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> Message-ID: Good call! Yes they are dot files. New issue. Mmbackup seems to be backup up the same files over and over without them changing: areas are being backed up multiple times. The example below is a co-resident file, the only thing that has changed since it was created 20/10/21, is the file has been accessed for backup. This file is in the 'changed' list in mmbackup: This list has just been created: -rw-r--r--. 1 root root 6591914 Jan 26 11:12 mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa Listing the last few files in the file (selecting the last one) 11:17:52 [root at scale-sk-pn-1 .mmbackupCfg]# tail mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604556977.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557039.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557102.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557164.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557226.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557288.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557351.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557413.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557476.png" "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" Check the file stats (access time just before last backup) 11:18:05 [root at scale-sk-pn-1 .mmbackupCfg]# stat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" File: '/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png' Size: 545 Blocks: 32 IO Block: 4194304 regular file Device: 2bh/43d Inode: 212618897 Links: 1 Access: (0644/-rw-r--r--) Uid: (1399613896/NHM\edwab) Gid: (1399647564/NHM\dg-mbl-urban-nature-project-rw) Context: unconfined_u:object_r:unlabeled_t:s0 Access: 2022-01-25 06:40:58.334961446 +0000 Modify: 2020-12-01 15:20:40.122053000 +0000 Change: 2021-10-20 17:55:18.265746459 +0100 Birth: - Check if migrated 11:18:16 [root at scale-sk-pn-1 .mmbackupCfg]# dsmls "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" File name : /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png On-line size : 545 Used blocks : 16 Data Version : 1 Meta Version : 1 State : Co-resident Container Index : 1 Base Name : 34C0B77D20194B0B.EACEB2055F6CAA58.56D56C5F140C8C9D.0000000000000000.2197396D.000000000CAC4E91 Check if immutable 11:18:26 [root at scale-sk-pn-1 .mmbackupCfg]# mstat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" file name: /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png metadata replication: 2 max 2 data replication: 2 max 2 immutable: no appendOnly: no flags: storage pool name: data fileset name: hpc-workspaces-fset snapshot name: creation time: Wed Oct 20 17:55:18 2021 Misc attributes: ARCHIVE Encrypted: no Check active and inactive backups (it was backed up yesterday) 11:18:52 [root at scale-sk-pn-1 .mmbackupCfg]# dsmcqbi "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" IBM Spectrum Protect Command Line Backup-Archive Client Interface Client Version 8, Release 1, Level 10.0 Client date/time: 01/26/2022 11:19:02 (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. Node Name: SC-PN-SK-01 Session established with server TSM-JERSEY: Windows Server Version 8, Release 1, Level 10.100 Server date/time: 01/26/2022 11:19:02 Last access: 01/26/2022 11:07:05 Accessing as node: SCALE Size Backup Date Mgmt Class A/I File ---- ----------- ---------- --- ---- 545 B 01/25/2022 06:41:17 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png It will be backed up again shortly, why? And it was backed up again: # dsmcqbi /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png IBM Spectrum Protect Command Line Backup-Archive Client Interface Client Version 8, Release 1, Level 10.0 Client date/time: 01/26/2022 15:54:09 (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. Node Name: SC-PN-SK-01 Session established with server TSM-JERSEY: Windows Server Version 8, Release 1, Level 10.100 Server date/time: 01/26/2022 15:54:10 Last access: 01/26/2022 15:30:03 Accessing as node: SCALE Size Backup Date Mgmt Class A/I File ---- ----------- ---------- --- ---- 545 B 01/26/2022 12:23:02 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png 545 B 01/25/2022 06:41:17 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png Kindest regards, Paul Paul Ward TS Infrastructure Architect Natural History Museum T: 02079426450 E: p.ward at nhm.ac.uk -----Original Message----- From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of Skylar Thompson Sent: 24 January 2022 15:37 To: gpfsug main discussion list Cc: gpfsug-discuss-bounces at spectrumscale.org Subject: Re: [gpfsug-discuss] mmbackup file selections Hi Paul, Did you look for dot files? At least for us on 5.0.5 there's a .list.1. file while the backups are running: /gpfs/grc6/.mmbackupCfg/updatedFiles/: -r-------- 1 root nickers 6158526821 Jan 23 18:28 .list.1.gpfs-grc6 /gpfs/grc6/.mmbackupCfg/expiredFiles/: -r-------- 1 root nickers 85862211 Jan 23 18:28 .list.1.gpfs-grc6 On Mon, Jan 24, 2022 at 02:31:54PM +0000, Paul Ward wrote: > Those directories are empty > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: gpfsug-discuss-bounces at spectrumscale.org > On Behalf Of IBM Spectrum > Scale > Sent: 22 January 2022 00:35 > To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > Hi Paul, > > Instead of calculating *.ix.* files, please look at a list file in these directories. > > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta > info update expiredFiles : cantains a file that lists all candidates > for expiration > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > org>> > Cc: > "gpfsug-discuss-bounces at spectrumscale.org s at spectrumscale.org>" > s at spectrumscale.org>> > Date: 01/21/2022 09:38 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > by: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > > ________________________________ > > > > Thank you Right in the command line seems to have worked. At the end > of the script I now copy the contents of the .mmbackupCfg folder to a > date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you > > Right in the command line seems to have worked. > At the end of the script I now copy the contents of the .mmbackupCfg > folder to a date stamped logging folder > > Checking how many entries in these files compared to the Summary: > wc -l mmbackup* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 754 total > From Summary > Total number of objects inspected: 755 > I can live with a discrepancy of 1. > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > From Summary > Total number of objects expired: 2 > That matches > > wc -l mmbackupC* mmbackupS* > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > 752 total > Summary: > Total number of objects backed up: 751 > > A difference of 1 I can live with. > > What does Statech stand for? > > Just this to sort out: > Total number of objects failed: 1 > I will add: > --tsm-errorlog TSMErrorLogFile > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > Sent: 19 January 2022 15:09 > To: gpfsug main discussion list > org>> > Cc: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > This is to set environment for mmbackup. > If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. > e.g) in your script > .... > export DEBUGmmbackup=2 > mmbackup .... > > Or, you can set it in the same command line like > DEBUGmmbackup=2 mmbackup .... > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. > > From: "Paul Ward" > > To: "gpfsug main discussion list" > org>> > Cc: > "gpfsug-discuss-bounces at spectrumscale.org s at spectrumscale.org>" > s at spectrumscale.org>> > Date: 01/19/2022 06:04 AM > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > by: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > > ________________________________ > > > > > Thank you. We run a script on all our nodes that checks to see if they > are the cluster manager. If they are, then they take responsibility to > start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Thank you. > > We run a script on all our nodes that checks to see if they are the cluster manager. > If they are, then they take responsibility to start the backup script. > The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. > > Where does this command belong? > I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > > From: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > Sent: 18 January 2022 22:54 > To: gpfsug main discussion list > org>> > Cc: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > Subject: Re: [gpfsug-discuss] mmbackup file selections > > Hi Paul, > > If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). > In .mmbackupCfg directory, there are 3 directories: > updatedFiles : contains a file that lists all candidates for backup > statechFiles : cantains a file that lists all candidates for meta > info update expiredFiles : cantains a file that lists all candidates > for expiration > > > Regards, The Spectrum Scale (GPFS) team > > ---------------------------------------------------------------------- > -------------------------------------------- > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. > > From: "Paul Ward" > > To: > "gpfsug-discuss at spectrumscale.org org>" > org>> > Date: 01/18/2022 11:56 AM > Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: > gpfsug-discuss-bounces at spectrumscale.org @spectrumscale.org> > > ________________________________ > > > > > > Hi, I am trying to work out what files have been sent to backup using > mmbackup. I have increased the -L value from 3 up to 6 but only seem > to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > ZjQcmQRYFpfptBannerEnd > Hi, > > I am trying to work out what files have been sent to backup using mmbackup. > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. > Wrong assumption? > > Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? > > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > [A picture containing drawing Description automatically generated] > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > =0 fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > d4c8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8ey > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > 0&sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reser > ved=0> > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > =0 fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8ey > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > 0&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&res > erved=0> > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > ed=0 gpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp. > ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437f > a0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8 > eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2 > 000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&r > eserved=0> > > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > ed=0 -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserved=0 From skylar2 at uw.edu Wed Jan 26 16:50:13 2022 From: skylar2 at uw.edu (Skylar Thompson) Date: Wed, 26 Jan 2022 08:50:13 -0800 Subject: [gpfsug-discuss] mmbackup file selections In-Reply-To: References: <20220124153631.oxu4ytbq4vqcotr3@utumno.gs.washington.edu> Message-ID: <20220126165013.z7vo3m4d666el7wr@utumno.gs.washington.edu> Awesome, glad that you found them (I missed them the first time too). As for the anomalous changed files, do you have these options set in your client option file? skipacl yes skipaclupdatecheck yes updatectime yes We had similar problems where metadata and ACL updates were interpreted as data changes by mmbackup/dsmc. We also have a case open with IBM where mmbackup will both expire and backup a file in the same run, even in the absence of mtime changes, but it's unclear whether that's program error or something with our include/exclude rules. I'd be curious if you're running into that as well. On Wed, Jan 26, 2022 at 03:55:48PM +0000, Paul Ward wrote: > Good call! > > Yes they are dot files. > > > New issue. > > Mmbackup seems to be backup up the same files over and over without them changing: > areas are being backed up multiple times. > The example below is a co-resident file, the only thing that has changed since it was created 20/10/21, is the file has been accessed for backup. > This file is in the 'changed' list in mmbackup: > > This list has just been created: > -rw-r--r--. 1 root root 6591914 Jan 26 11:12 mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa > > Listing the last few files in the file (selecting the last one) > 11:17:52 [root at scale-sk-pn-1 .mmbackupCfg]# tail mmbackupChanged.ix.197984.22A38AA7.39.nhmfsa > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604556977.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557039.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557102.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557164.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557226.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557288.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557351.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557413.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557476.png" > "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > > Check the file stats (access time just before last backup) > 11:18:05 [root at scale-sk-pn-1 .mmbackupCfg]# stat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > File: '/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png' > Size: 545 Blocks: 32 IO Block: 4194304 regular file > Device: 2bh/43d Inode: 212618897 Links: 1 > Access: (0644/-rw-r--r--) Uid: (1399613896/NHM\edwab) Gid: (1399647564/NHM\dg-mbl-urban-nature-project-rw) > Context: unconfined_u:object_r:unlabeled_t:s0 > Access: 2022-01-25 06:40:58.334961446 +0000 > Modify: 2020-12-01 15:20:40.122053000 +0000 > Change: 2021-10-20 17:55:18.265746459 +0100 > Birth: - > > Check if migrated > 11:18:16 [root at scale-sk-pn-1 .mmbackupCfg]# dsmls "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > File name : /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > On-line size : 545 > Used blocks : 16 > Data Version : 1 > Meta Version : 1 > State : Co-resident > Container Index : 1 > Base Name : 34C0B77D20194B0B.EACEB2055F6CAA58.56D56C5F140C8C9D.0000000000000000.2197396D.000000000CAC4E91 > > Check if immutable > 11:18:26 [root at scale-sk-pn-1 .mmbackupCfg]# mstat "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > file name: /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > metadata replication: 2 max 2 > data replication: 2 max 2 > immutable: no > appendOnly: no > flags: > storage pool name: data > fileset name: hpc-workspaces-fset > snapshot name: > creation time: Wed Oct 20 17:55:18 2021 > Misc attributes: ARCHIVE > Encrypted: no > > Check active and inactive backups (it was backed up yesterday) > 11:18:52 [root at scale-sk-pn-1 .mmbackupCfg]# dsmcqbi "/gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png" > IBM Spectrum Protect > Command Line Backup-Archive Client Interface > Client Version 8, Release 1, Level 10.0 > Client date/time: 01/26/2022 11:19:02 > (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. > > Node Name: SC-PN-SK-01 > Session established with server TSM-JERSEY: Windows > Server Version 8, Release 1, Level 10.100 > Server date/time: 01/26/2022 11:19:02 Last access: 01/26/2022 11:07:05 > > Accessing as node: SCALE > Size Backup Date Mgmt Class A/I File > ---- ----------- ---------- --- ---- > 545 B 01/25/2022 06:41:17 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > > > It will be backed up again shortly, why? > > And it was backed up again: > # dsmcqbi /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > IBM Spectrum Protect > Command Line Backup-Archive Client Interface > Client Version 8, Release 1, Level 10.0 > Client date/time: 01/26/2022 15:54:09 > (c) Copyright by IBM Corporation and other(s) 1990, 2020. All Rights Reserved. > > Node Name: SC-PN-SK-01 > Session established with server TSM-JERSEY: Windows > Server Version 8, Release 1, Level 10.100 > Server date/time: 01/26/2022 15:54:10 Last access: 01/26/2022 15:30:03 > > Accessing as node: SCALE > Size Backup Date Mgmt Class A/I File > ---- ----------- ---------- --- ---- > 545 B 01/26/2022 12:23:02 DEFAULT A /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 12/28/2021 21:19:18 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:17:35 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/04/2022 06:18:05 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > 545 B 01/25/2022 06:41:17 DEFAULT I /gpfs/nhmfsa/bulk/share/data/mbl/share/workspaces/groups/urban-nature-project/audiowaveform/300_40/unp-grounds-01-1604557538.png > > Kindest regards, > Paul > > Paul Ward > TS Infrastructure Architect > Natural History Museum > T: 02079426450 > E: p.ward at nhm.ac.uk > > > -----Original Message----- > From: gpfsug-discuss-bounces at spectrumscale.org On Behalf Of Skylar Thompson > Sent: 24 January 2022 15:37 > To: gpfsug main discussion list > Cc: gpfsug-discuss-bounces at spectrumscale.org > Subject: Re: [gpfsug-discuss] mmbackup file selections > > Hi Paul, > > Did you look for dot files? At least for us on 5.0.5 there's a .list.1. file while the backups are running: > > /gpfs/grc6/.mmbackupCfg/updatedFiles/: > -r-------- 1 root nickers 6158526821 Jan 23 18:28 .list.1.gpfs-grc6 > /gpfs/grc6/.mmbackupCfg/expiredFiles/: > -r-------- 1 root nickers 85862211 Jan 23 18:28 .list.1.gpfs-grc6 > > On Mon, Jan 24, 2022 at 02:31:54PM +0000, Paul Ward wrote: > > Those directories are empty > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > > > From: gpfsug-discuss-bounces at spectrumscale.org > > On Behalf Of IBM Spectrum > > Scale > > Sent: 22 January 2022 00:35 > > To: gpfsug main discussion list > > Cc: gpfsug-discuss-bounces at spectrumscale.org > > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > > > > Hi Paul, > > > > Instead of calculating *.ix.* files, please look at a list file in these directories. > > > > updatedFiles : contains a file that lists all candidates for backup > > statechFiles : cantains a file that lists all candidates for meta > > info update expiredFiles : cantains a file that lists all candidates > > for expiration > > > > Regards, The Spectrum Scale (GPFS) team > > > > ---------------------------------------------------------------------- > > -------------------------------------------- > > > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > > > > [Inactive hide details for "Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked.]"Paul Ward" ---01/21/2022 09:38:49 AM---Thank you Right in the command line seems to have worked. > > > > From: "Paul Ward" > > > To: "gpfsug main discussion list" > > > org>> > > Cc: > > "gpfsug-discuss-bounces at spectrumscale.org > s at spectrumscale.org>" > > > s at spectrumscale.org>> > > Date: 01/21/2022 09:38 AM > > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > > by: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > > ________________________________ > > > > > > > > Thank you Right in the command line seems to have worked. At the end > > of the script I now copy the contents of the .mmbackupCfg folder to a > > date stamped logging folder Checking how many entries in these files compared to the Summary: ???????ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > > ZjQcmQRYFpfptBannerEnd > > Thank you > > > > Right in the command line seems to have worked. > > At the end of the script I now copy the contents of the .mmbackupCfg > > folder to a date stamped logging folder > > > > Checking how many entries in these files compared to the Summary: > > wc -l mmbackup* > > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > > 754 total > > From Summary > > Total number of objects inspected: 755 > > I can live with a discrepancy of 1. > > > > 2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa > > From Summary > > Total number of objects expired: 2 > > That matches > > > > wc -l mmbackupC* mmbackupS* > > 188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa > > 47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa > > 188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa > > 40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa > > 141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa > > 148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa > > 752 total > > Summary: > > Total number of objects backed up: 751 > > > > A difference of 1 I can live with. > > > > What does Statech stand for? > > > > Just this to sort out: > > Total number of objects failed: 1 > > I will add: > > --tsm-errorlog TSMErrorLogFile > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > > > From: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > > Sent: 19 January 2022 15:09 > > To: gpfsug main discussion list > > > org>> > > Cc: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > > > > This is to set environment for mmbackup. > > If mmbackup is invoked within a script, you can set "export DEBUGmmbackup=2" right above mmbackup command. > > e.g) in your script > > .... > > export DEBUGmmbackup=2 > > mmbackup .... > > > > Or, you can set it in the same command line like > > DEBUGmmbackup=2 mmbackup .... > > > > Regards, The Spectrum Scale (GPFS) team > > > > ---------------------------------------------------------------------- > > -------------------------------------------- > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > > [Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to se]"Paul Ward" ---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes that checks to see if they are the cluster manager. > > > > From: "Paul Ward" > > > To: "gpfsug main discussion list" > > > org>> > > Cc: > > "gpfsug-discuss-bounces at spectrumscale.org > s at spectrumscale.org>" > > > s at spectrumscale.org>> > > Date: 01/19/2022 06:04 AM > > Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections Sent > > by: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > > ________________________________ > > > > > > > > > > Thank you. We run a script on all our nodes that checks to see if they > > are the cluster manager. If they are, then they take responsibility to > > start the backup script. The script then randomly selects one of the available backup nodes and uses ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > > ZjQcmQRYFpfptBannerEnd > > Thank you. > > > > We run a script on all our nodes that checks to see if they are the cluster manager. > > If they are, then they take responsibility to start the backup script. > > The script then randomly selects one of the available backup nodes and uses dsmsh mmbackup on it. > > > > Where does this command belong? > > I have seen it listed as a export command, again where should that be run ? on all backup nodes, or all nodes? > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > > > From: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > s at spectrumscale.org>> On Behalf Of IBM Spectrum Scale > > Sent: 18 January 2022 22:54 > > To: gpfsug main discussion list > > > org>> > > Cc: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > Subject: Re: [gpfsug-discuss] mmbackup file selections > > > > Hi Paul, > > > > If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even after successful backup. They are available at MMBACKUP_RECORD_ROOT (default is FSroot or FilesetRoot directory). > > In .mmbackupCfg directory, there are 3 directories: > > updatedFiles : contains a file that lists all candidates for backup > > statechFiles : cantains a file that lists all candidates for meta > > info update expiredFiles : cantains a file that lists all candidates > > for expiration > > > > > > Regards, The Spectrum Scale (GPFS) team > > > > ---------------------------------------------------------------------- > > -------------------------------------------- > > If your query concerns a potential software error in Spectrum Scale (GPFS) and you have an IBM software maintenance contract please contact 1-800-237-5511 in the United States or your local IBM Service Center in other countries. > > > > [Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to back]"Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have been sent to backup using mmbackup. > > > > From: "Paul Ward" > > > To: > > "gpfsug-discuss at spectrumscale.org > org>" > > > org>> > > Date: 01/18/2022 11:56 AM > > Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections Sent by: > > gpfsug-discuss-bounces at spectrumscale.org > @spectrumscale.org> > > > > ________________________________ > > > > > > > > > > > > Hi, I am trying to work out what files have been sent to backup using > > mmbackup. I have increased the -L value from 3 up to 6 but only seem > > to see the files that are in scope, not the ones that are selected. I can see the three file lists generated ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. > > ZjQcmQRYFpfptBannerEnd > > Hi, > > > > I am trying to work out what files have been sent to backup using mmbackup. > > I have increased the -L value from 3 up to 6 but only seem to see the files that are in scope, not the ones that are selected. > > > > I can see the three file lists generated during a backup, but can?t seem to find a list of what files were backed up. > > > > It should be the diff of the shadow and shadow-old, but the wc -l of the diff doesn?t match the number of files in the backup summary. > > Wrong assumption? > > > > Where should I be looking ? surely it shouldn?t be this hard to see what files are selected? > > > > > > Kindest regards, > > Paul > > > > Paul Ward > > TS Infrastructure Architect > > Natural History Museum > > T: 02079426450 > > E: p.ward at nhm.ac.uk > > [A picture containing drawing Description automatically generated] > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > > =0 > fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > > d4c8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8ey > > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > > 0&sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reser > > ved=0> > > > > > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879087616%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=72gqmRJEgZ97s3%2BjmFD12PpfcJJKUVJuyvyJf4beXS8%3D&reserved > > =0 > fsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.wa > > rd%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0 > > d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8ey > > JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C200 > > 0&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&res > > erved=0> > > > > > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > > ed=0 > gpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp. > > ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437f > > a0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8 > > eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2 > > 000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&r > > eserved=0> > > > > > > > > > > > > _______________________________________________ > > gpfsug-discuss mailing list > > gpfsug-discuss at spectrumscale.org > > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsu > > g.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward% > > 40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c > > 8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWI > > joiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&a > > mp;sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserv > > ed=0 > > > -- > -- Skylar Thompson (skylar2 at u.washington.edu) > -- Genome Sciences Department (UW Medicine), System Administrator > -- Foege Building S046, (206)-685-7354 > -- Pronouns: He/Him/His > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss&data=04%7C01%7Cp.ward%40nhm.ac.uk%7Cd4c22f3c612c4cb6deb908d9df4fd706%7C73a29c014e78437fa0d4c8553e1960c1%7C1%7C0%7C637786356879243834%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=ng2wVGN4u37lfaRjVYe%2F7sq9AwrXTWnVIQ7iVB%2BZWuc%3D&reserved=0 > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss -- -- Skylar Thompson (skylar2 at u.washington.edu) -- Genome Sciences Department (UW Medicine), System Administrator -- Foege Building S046, (206)-685-7354 -- Pronouns: He/Him/His