[gpfsug-discuss] mmbackup monitoring

Skylar Thompson skylar2 at u.washington.edu
Wed Mar 25 15:25:15 GMT 2020


IIRC, I think you need to set 2 in the bit field of the DEBUGmmbackup
environment variable. I had a long-term task to see what I could get out of
that, but this just reminded me of it and current events might actually let
me have time to look into it now...

On Wed, Mar 25, 2020 at 10:38:55AM -0400, Jaime Pinto wrote:
> Additionally, mmbackup creates by default a .mmbackupCfg directory on the root of the fileset where it dumps several files and directories with the progress of the backup. For instance: expiredFiles/, prepFiles/, updatedFiles/, dsminstr.log, ...
> 
> You may then create a script to search these directories for logs/lists of what has happened, and generate a more detailed report of what happened during the backup. In our case I generate a daily report of how many files and how much data have been sent to the TSM server and deleted for each user, including their paths. You can do more tricks if you want.
> 
> Jaime
> 
> 
> On 3/25/2020 10:15:59, Skylar Thompson wrote:
> > We execute mmbackup via a regular TSM client schedule with an incremental
> > action, with a virtualmountpoint set to an empty, local "canary" directory.
> > mmbackup runs as a preschedule command, and the client -domain parameter is
> > set only to backup the canary directory. dsmc will backup the canary
> > directory as a filespace only if mmbackup succeeds (exits with 0). We can
> > then monitor the canary and infer the status of the associated GPFS
> > filespace or fileset.
> > 
> > On Wed, Mar 25, 2020 at 10:01:04AM +0000, Jonathan Buzzard wrote:
> > > 
> > > What is the best way of monitoring whether or not mmbackup has managed to
> > > complete a backup successfully?
> > > 
> > > Traditionally one use a TSM monitoring solution of your choice to make sure
> > > nodes where backing up (I am assuming mmbackup is being used in conjunction
> > > with TSM here).
> > > 
> > > However mmbackup does not update the backup_end column in the filespaceview
> > > table (at least in 4.2) which makes things rather more complicated.
> > > 
> > > The best I can come up with is querying the events table to see if the
> > > client schedule completed, but that gives a false sense of security as the
> > > schedule completing does not mean the backup completed as far as I know.
> > > 
> > > What solutions are you all using, or does mmbackup in 5.x update the
> > > filespaceview table?
> > 
> 
> .
> .
> .        ************************************
>           TELL US ABOUT YOUR SUCCESS STORIES
>          http://www.scinethpc.ca/testimonials
>          ************************************
> ---
> Jaime Pinto - Storage Analyst
> SciNet HPC Consortium - Compute/Calcul Canada
> www.scinet.utoronto.ca - www.computecanada.ca
> University of Toronto
> 661 University Ave. (MaRS), Suite 1140
> Toronto, ON, M5G1M1
> P: 416-978-2755
> C: 416-505-1477
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss

-- 
-- Skylar Thompson (skylar2 at u.washington.edu)
-- Genome Sciences Department, System Administrator
-- Foege Building S046, (206)-685-7354
-- University of Washington School of Medicine



More information about the gpfsug-discuss mailing list