[gpfsug-discuss] mmbackup file selections

IBM Spectrum Scale scale at us.ibm.com
Sat Jan 22 00:35:24 GMT 2022



Hi Paul,



Instead of calculating *.ix.* files,  please look at a list file in these
directories.


updatedFiles  : contains a file that lists all candidates for backup
statechFiles  : cantains a file that lists all candidates for meta info
update
expiredFiles  : cantains a file that lists all candidates for expiration



Regards, The Spectrum Scale (GPFS) team

------------------------------------------------------------------------------------------------------------------


If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact
1-800-237-5511 in the United States or your local IBM Service Center in
other countries.




From:	"Paul Ward" <p.ward at nhm.ac.uk>
To:	"gpfsug main discussion list"
            <gpfsug-discuss at spectrumscale.org>
Cc:	"gpfsug-discuss-bounces at spectrumscale.org"
            <gpfsug-discuss-bounces at spectrumscale.org>
Date:	01/21/2022 09:38 AM
Subject:	[EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections
Sent by:	gpfsug-discuss-bounces at spectrumscale.org



Thank you Right in the command line seems to have worked. At the end of the
script I now copy the contents of the .mmbackupCfg folder to a date stamped
logging folder Checking how many entries in these files compared to the
Summary: ‍‍‍‍‍‍‍ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.
ZjQcmQRYFpfptBannerEnd
Thank you

Right in the command line seems to have worked.
At the end of the script I now copy the contents of the .mmbackupCfg folder
to a date stamped logging folder

Checking how many entries in these files compared to the Summary:
wc -l mmbackup*
  188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa
   47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa
  188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa
   40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa
    2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa
  141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa
  148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa
  754 total
From Summary
        Total number of objects inspected:      755
I can live with a discrepancy of 1.

    2 mmbackupExpired.ix.78683.2DD25239.1.nhmfsa
From Summary
        Total number of objects expired:        2
That matches

wc -l mmbackupC* mmbackupS*
  188 mmbackupChanged.ix.155513.6E9E8BE2.1.nhmfsa
   47 mmbackupChanged.ix.219901.8E89AB35.1.nhmfsa
  188 mmbackupChanged.ix.37893.EDFB8FA7.1.nhmfsa
   40 mmbackupChanged.ix.81032.78717A00.1.nhmfsa
  141 mmbackupStatech.ix.219901.8E89AB35.1.nhmfsa
  148 mmbackupStatech.ix.81032.78717A00.1.nhmfsa
  752 total
Summary:
        Total number of objects backed up:      751

A difference of 1 I can live with.

What does Statech stand for?

Just this to sort out:
        Total number of objects failed:         1
I will add:
--tsm-errorlog TSMErrorLogFile


Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.ward at nhm.ac.uk
A picture containing drawing

Description automatically generated

From: gpfsug-discuss-bounces at spectrumscale.org
<gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of IBM Spectrum Scale
Sent: 19 January 2022 15:09
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Cc: gpfsug-discuss-bounces at spectrumscale.org
Subject: Re: [gpfsug-discuss] mmbackup file selections



This is to set environment for mmbackup.
If mmbackup is invoked within a script, you can set "export
DEBUGmmbackup=2" right above mmbackup command.
e.g)  in your script
            ....
export DEBUGmmbackup=2
              mmbackup ....

Or, you can set it in the same command line like
DEBUGmmbackup=2 mmbackup ....

Regards, The Spectrum Scale (GPFS) team

------------------------------------------------------------------------------------------------------------------

If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact
1-800-237-5511 in the United States or your local IBM Service Center in
other countries.

Inactive hide details for "Paul Ward" ---01/19/2022 06:04:03 AM---Thank
you. We run a script on all our nodes that checks to se"Paul Ward"
---01/19/2022 06:04:03 AM---Thank you. We run a script on all our nodes
that checks to see if they are the cluster manager.

From: "Paul Ward" <p.ward at nhm.ac.uk>
To: "gpfsug main discussion list" <gpfsug-discuss at spectrumscale.org>
Cc: "gpfsug-discuss-bounces at spectrumscale.org" <
gpfsug-discuss-bounces at spectrumscale.org>
Date: 01/19/2022 06:04 AM
Subject: [EXTERNAL] Re: [gpfsug-discuss] mmbackup file selections
Sent by: gpfsug-discuss-bounces at spectrumscale.org




Thank you. We run a script on all our nodes that checks to see if they are
the cluster manager. If they are, then they take responsibility to start
the backup script. The script then randomly selects one of the available
backup nodes and uses ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.
ZjQcmQRYFpfptBannerEnd
Thank you.

We run a script on all our nodes that checks to see if they are the cluster
manager.
If they are, then they take responsibility to start the backup script.
The script then randomly selects one of the available backup nodes and uses
dsmsh mmbackup on it.

Where does this command belong?
I have seen it listed as a export command, again where should that be run –
on all backup nodes, or all nodes?


Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.ward at nhm.ac.uk
A picture containing drawing

Description automatically generated

From: gpfsug-discuss-bounces at spectrumscale.org <
gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of IBM Spectrum Scale
Sent: 18 January 2022 22:54
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Cc: gpfsug-discuss-bounces at spectrumscale.org
Subject: Re: [gpfsug-discuss] mmbackup file selections



Hi Paul,

If you run mmbackup with "DEBUGmmbackup=2", it keeps all working files even
after successful backup. They are available at MMBACKUP_RECORD_ROOT
(default is FSroot or FilesetRoot directory).
In .mmbackupCfg directory, there are 3 directories:
updatedFiles  : contains a file that lists all candidates for backup
statechFiles  : cantains a file that lists all candidates for meta info
update
expiredFiles  : cantains a file that lists all candidates for expiration


Regards, The Spectrum Scale (GPFS) team

------------------------------------------------------------------------------------------------------------------

If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact
1-800-237-5511 in the United States or your local IBM Service Center in
other countries.

Inactive hide details for "Paul Ward" ---01/18/2022 11:56:40 AM---Hi, I am
trying to work out what files have been sent to back"Paul Ward"
---01/18/2022 11:56:40 AM---Hi, I am trying to work out what files have
been sent to backup using mmbackup.

From: "Paul Ward" <p.ward at nhm.ac.uk>
To: "gpfsug-discuss at spectrumscale.org" <gpfsug-discuss at spectrumscale.org>
Date: 01/18/2022 11:56 AM
Subject: [EXTERNAL] [gpfsug-discuss] mmbackup file selections
Sent by: gpfsug-discuss-bounces at spectrumscale.org





Hi, I am trying to work out what files have been sent to backup using
mmbackup. I have increased the -L value from 3 up to 6 but only seem to see
the files that are in scope, not the ones that are selected. I can see the
three file lists generated ZjQcmQRYFpfptBannerStart
This Message Is From an External Sender
This message came from outside your organization.
ZjQcmQRYFpfptBannerEnd
Hi,

I am trying to work out what files have been sent to backup using mmbackup.
I have increased the -L value from 3 up to 6 but only seem to see the files
that are in scope, not the ones that are selected.

I can see the three file lists generated during a backup, but can’t seem to
find a list of what files were backed up.

It should be the diff of the shadow and shadow-old, but the wc -l of the
diff doesn’t match the number of files in the backup summary.
Wrong assumption?

Where should I be looking – surely it shouldn’t be this hard to see what
files are selected?


Kindest regards,
Paul

Paul Ward
TS Infrastructure Architect
Natural History Museum
T: 02079426450
E: p.ward at nhm.ac.uk
A picture containing drawing

Description automatically generated
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss


_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220121/6b81e8e5/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220121/6b81e8e5/attachment-0002.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 29915401.jpg
Type: image/jpeg
Size: 5356 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20220121/6b81e8e5/attachment-0002.jpg>


More information about the gpfsug-discuss mailing list