[gpfsug-discuss] mmbackup feature request
Stephan Graf
st.graf at fz-juelich.de
Wed Sep 6 11:26:26 BST 2023
We have written a python scheduler which is using the mmlsfileset
command. By options we can decide how many filesets are backed up in
parallel.
Stephan
On 9/6/23 11:44, Christian Petersson wrote:
> Just a follow up question, how do you backup multiple filesets?
> We have a 50 filesets to backup, at the moment do we have a text file
> that contains all of them and we run a for loop. But that is not at all
> scalable.
>
> Is it any other ways that are much better?
>
> /Christian
>
> ons 6 sep. 2023 kl. 11:35 skrev Marcus Koenig <marcus at koenighome.de
> <mailto:marcus at koenighome.de>>:
>
> I'm using this one liner to get the progress
>
> grep 'mmbackup:Backup job finished'|cut -d ":" -f 6|awk '{print
> $1}'|awk '{s+=$1}END{print s}'
>
> That can be compared to the files identified during the scan.
>
> On Wed, 6 Sept 2023, 21:29 Stephan Graf, <st.graf at fz-juelich.de
> <mailto:st.graf at fz-juelich.de>> wrote:
>
> Hi
>
> I think it should be possible because mmbackup know, how many
> files are
> to be backed up, which have been already processed and how many are
> still to go.
>
> BTW it would also be nice to have an option in mmbackup to generate
> machine readable log file like JSON or CSV.
>
> But the right way to ask for a new feature or to look if there is
> already a request open is the IBM IDEA portal:
>
> https://ideas.ibm.com <https://ideas.ibm.com>
>
> Stephan
>
> On 9/6/23 11:02, Jonathan Buzzard wrote:
> >
> > Would it be possible to have the mmbackup output display the
> percentage
> > output progress when backing up files?
> >
> > So at the top we you see something like this
> >
> > Tue Sep 5 23:13:35 2023 mmbackup:changed=747204,
> expired=427702,
> > unsupported=0 for server [XXXX]
> >
> > Then after it does the expiration you see during the backup
> lines like
> >
> > Wed Sep 6 02:43:53 2023 mmbackup:Backing up files: 527024
> backed up,
> > 426018 expired, 4408 failed. (Backup job exit with 4)
> >
> > It would IMHO be helpful if it looked like
> >
> > Wed Sep 6 02:43:53 2023 mmbackup:Backing up files: 527024
> (70.5%)
> > backed up, 426018 (100%) expired, 4408 failed. (Backup job
> exit with 4)
> >
> > Just based on the number of files. Though as I look at it now
> I am
> > curious about the discrepancy in the number of files expired,
> given that
> > the expiration stage allegedly concluded with no errors?
> >
> > Tue Sep 5 23:21:49 2023 mmbackup:Completed policy expiry run
> with 0
> > policy errors, 0 files failed, 0 severe errors, returning rc=0.
> > Tue Sep 5 23:21:49 2023 mmbackup:Policy for expiry returned
> 0 Highest
> > TSM error 0
> >
> >
> >
> > JAB.
> >
>
> --
> Stephan Graf
> Juelich Supercomputing Centre
>
> Phone: +49-2461-61-6578
> Fax: +49-2461-61-6656
> E-mail: st.graf at fz-juelich.de <mailto:st.graf at fz-juelich.de>
> WWW: http://www.fz-juelich.de/jsc/ <http://www.fz-juelich.de/jsc/>
> ---------------------------------------------------------------------------------------------
> ---------------------------------------------------------------------------------------------
> Forschungszentrum Juelich GmbH
> 52425 Juelich
> Sitz der Gesellschaft: Juelich
> Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
> Vorsitzender des Aufsichtsrats: MinDir Volker Rieke
> Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt
> (Vorsitzender),
> Karsten Beneke (stellv. Vorsitzender), Dr. Astrid Lambrecht,
> Prof. Dr. Frauke Melchior
> ---------------------------------------------------------------------------------------------
> ---------------------------------------------------------------------------------------------
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org <http://gpfsug.org>
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org
> <http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org <http://gpfsug.org>
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org
> <http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org>
>
>
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at gpfsug.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss_gpfsug.org
--
Stephan Graf
Juelich Supercomputing Centre
Phone: +49-2461-61-6578
Fax: +49-2461-61-6656
E-mail: st.graf at fz-juelich.de
WWW: http://www.fz-juelich.de/jsc/
---------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDir Volker Rieke
Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
Karsten Beneke (stellv. Vorsitzender), Dr. Astrid Lambrecht,
Prof. Dr. Frauke Melchior
---------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5938 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20230906/c6e0acea/attachment-0001.bin>
More information about the gpfsug-discuss
mailing list