<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Dominic, <br>
<br>
Speculatively, when is TSM converting from DMAPI to Light Weight
Events?<br>
Is there an up-to-date slide share we can put on the UG website
regarding the 7.1.11 / public roadmap?<br>
<br>
Jez<br>
<br>
<br>
<div class="moz-cite-prefix">On 11/04/16 16:26, Dominic
Mueller-Wicke01 wrote:<br>
</div>
<blockquote
cite="mid:201604111529.u3BFT51c027238@d06av02.portsmouth.uk.ibm.com"
type="cite">
<p>Spectrum Protect backup (under the hood of mmbackup) and
Spectrum Protect for Space Management (HSM) can be combined on
the same data. There are some valuable integration topics
between the products that can reduce the overall network traffic
if using backup and HSM on the same files. With the combination
of the products you have the ability to free file system space
from cold data and migrate them out to tape and to have several
versions of frequently used files in backup in the same file
system. <br>
<br>
Greetings, Dominic.<br>
<br>
______________________________________________________________________________________________________________<br>
Dominic Mueller-Wicke | IBM Spectrum Protect Development |
Technical Lead | +49 7034 64 32794 | <a class="moz-txt-link-abbreviated" href="mailto:dominic.mueller@de.ibm.com">dominic.mueller@de.ibm.com</a><br>
<br>
Vorsitzende des Aufsichtsrats: Martina Koederitz;
Geschäftsführung: Dirk Wittkopp<br>
Sitz der Gesellschaft: Böblingen; Registergericht: Amtsgericht
Stuttgart, HRB 243294<br>
<br>
<img src="cid:part1.00010808.02050004@gpfsug.org" alt="Inactive
hide details for gpfsug-discuss-request---11.04.2016
17:11:55---Send gpfsug-discuss mailing list submissions to
gpfsu" border="0" height="16" width="16"><font color="#424282">gpfsug-discuss-request---11.04.2016
17:11:55---Send gpfsug-discuss mailing list submissions to
<a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a></font><br>
<br>
<font color="#5F5F5F" size="2">From: </font><font size="2"><a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss-request@spectrumscale.org">gpfsug-discuss-request@spectrumscale.org</a></font><br>
<font color="#5F5F5F" size="2">To: </font><font size="2"><a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a></font><br>
<font color="#5F5F5F" size="2">Date: </font><font size="2">11.04.2016
17:11</font><br>
<font color="#5F5F5F" size="2">Subject: </font><font size="2">gpfsug-discuss
Digest, Vol 51, Issue 9</font><br>
<font color="#5F5F5F" size="2">Sent by: </font><font size="2"><a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a></font><br>
</p>
<hr style="color:#8091A5; " align="left" size="2"
noshade="noshade" width="100%"><br>
<br>
<br>
<tt>Send gpfsug-discuss mailing list submissions to<br>
<a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
</tt><tt><a moz-do-not-send="true"
href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br>
or, via email, send a message with subject or body 'help' to<br>
<a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss-request@spectrumscale.org">gpfsug-discuss-request@spectrumscale.org</a><br>
<br>
You can reach the person managing the list at<br>
<a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss-owner@spectrumscale.org">gpfsug-discuss-owner@spectrumscale.org</a><br>
<br>
When replying, please edit your Subject line so it is more
specific<br>
than "Re: Contents of gpfsug-discuss digest..."<br>
Today's Topics:<br>
<br>
1. backup and disaster recovery solutions (Damir Krstic)<br>
2. Re: backup and disaster recovery solutions (Jaime Pinto)<br>
3. Re: backup and disaster recovery solutions (Jonathan
Buzzard)<br>
4. Re: backup and disaster recovery solutions (Marc A Kaplan)<br>
</tt><font color="#800080"><br>
----- Message from Damir Krstic <a class="moz-txt-link-rfc2396E" href="mailto:damir.krstic@gmail.com"><damir.krstic@gmail.com></a>
on Mon, 11 Apr 2016 13:15:30 +0000 -----</font>
<table border="0" cellpadding="0" cellspacing="0">
<tbody>
<tr valign="top">
<td valign="middle" width="55">
<div align="right"><b><font size="4">To:</font></b></div>
</td>
<td valign="middle" width="391"><font size="4">gpfsug main
discussion list <a class="moz-txt-link-rfc2396E" href="mailto:gpfsug-discuss@spectrumscale.org"><gpfsug-discuss@spectrumscale.org></a></font></td>
</tr>
<tr valign="top">
<td valign="middle" width="55">
<div align="right"><b><font size="4">Subject:</font></b></div>
</td>
<td valign="middle" width="391"><font size="4">[gpfsug-discuss]
backup and disaster recovery solutions</font></td>
</tr>
</tbody>
</table>
<font size="4">We have implemented 1.5PB ESS solution recently in
our HPC environment. Today we are kicking of backup and disaster
recovery discussions so I was wondering what everyone else is
using for their backup?</font><br>
<br>
<font size="4">In our old storage environment we simply rsync-ed
home and software directories and projects were not backed up. </font><br>
<br>
<font size="4">With ESS we are looking for more of a GPFS based
backup solution - something to tape possibly and also something
that will have life cycle feature - so if the file is not
touched for number of days, it's moved to a tape (something like
LTFS).</font><br>
<br>
<font size="4">Thanks in advance.</font><br>
<br>
<font size="4">DAmir </font><font color="#800080"><br>
----- Message from Jaime Pinto <a class="moz-txt-link-rfc2396E" href="mailto:pinto@scinet.utoronto.ca"><pinto@scinet.utoronto.ca></a>
on Mon, 11 Apr 2016 10:34:54 -0400 -----</font>
<table border="0" cellpadding="0" cellspacing="0">
<tbody>
<tr valign="top">
<td valign="middle" width="55">
<div align="right"><b><font size="4">To:</font></b></div>
</td>
<td valign="middle" width="646"><font size="4">gpfsug main
discussion list
<a class="moz-txt-link-rfc2396E" href="mailto:gpfsug-discuss@spectrumscale.org"><gpfsug-discuss@spectrumscale.org></a>, Damir Krstic
<a class="moz-txt-link-rfc2396E" href="mailto:damir.krstic@gmail.com"><damir.krstic@gmail.com></a></font></td>
</tr>
<tr valign="top">
<td valign="middle" width="55">
<div align="right"><b><font size="4">Subject:</font></b></div>
</td>
<td valign="middle" width="646"><font size="4">Re:
[gpfsug-discuss] backup and disaster recovery solutions</font></td>
</tr>
</tbody>
</table>
<tt>Do you want backups or periodic frozen snapshots of the file
system?<br>
<br>
Backups can entail some level of version control, so that you or
<br>
end-users can get files back on certain points in time, in case
of <br>
accidental deletions. Besides 1.5PB is a lot of material, so you
may <br>
not want to take full snapshots that often. In that case, a <br>
combination of daily incremental backups using TSM with GPFS's <br>
mmbackup can be a good option. TSM also does a very good job at
<br>
controlling how material is distributed across multiple tapes,
and <br>
that is something that requires a lot of micro-management if you
want <br>
a home grown solution of rsync+LTFS.<br>
<br>
On the other hand, you could use gpfs built-in tools such a <br>
mmapplypolicy to identify candidates for incremental backup, and
send <br>
them to LTFS. Just more micro management, and you may have to
come up <br>
with your own tool to let end-users restore their stuff, or
you'll <br>
have to act on their behalf.<br>
<br>
Jaime<br>
<br>
<br>
<br>
<br>
Quoting Damir Krstic <a class="moz-txt-link-rfc2396E" href="mailto:damir.krstic@gmail.com"><damir.krstic@gmail.com></a>:<br>
<br>
> We have implemented 1.5PB ESS solution recently in our HPC
environment.<br>
> Today we are kicking of backup and disaster recovery
discussions so I was<br>
> wondering what everyone else is using for their backup?<br>
><br>
> In our old storage environment we simply rsync-ed home and
software<br>
> directories and projects were not backed up.<br>
><br>
> With ESS we are looking for more of a GPFS based backup
solution -<br>
> something to tape possibly and also something that will
have life cycle<br>
> feature - so if the file is not touched for number of days,
it's moved to a<br>
> tape (something like LTFS).<br>
><br>
> Thanks in advance.<br>
><br>
> DAmir<br>
><br>
<br>
<br>
<br>
<br>
<br>
<br>
************************************<br>
TELL US ABOUT YOUR SUCCESS STORIES<br>
</tt><tt><a moz-do-not-send="true"
href="http://www.scinethpc.ca/testimonials">http://www.scinethpc.ca/testimonials</a></tt><tt><br>
************************************<br>
---<br>
Jaime Pinto<br>
SciNet HPC Consortium - Compute/Calcul Canada<br>
</tt><tt><a class="moz-txt-link-abbreviated" href="http://www.scinet.utoronto.ca">www.scinet.utoronto.ca</a></tt><tt> - </tt><tt><a class="moz-txt-link-abbreviated" href="http://www.computecanada.org">www.computecanada.org</a></tt><tt><br>
University of Toronto<br>
256 McCaul Street, Room 235<br>
Toronto, ON, M5T1W5<br>
P: 416-978-2755<br>
C: 416-505-1477<br>
<br>
----------------------------------------------------------------<br>
This message was sent using IMP at SciNet Consortium, University
of Toronto.<br>
<br>
<br>
<br>
</tt><font color="#800080"><br>
----- Message from Jonathan Buzzard
<a class="moz-txt-link-rfc2396E" href="mailto:jonathan@buzzard.me.uk"><jonathan@buzzard.me.uk></a> on Mon, 11 Apr 2016 16:02:45
+0100 -----</font>
<table border="0" cellpadding="0" cellspacing="0">
<tbody>
<tr valign="top">
<td valign="middle" width="55">
<div align="right"><b><font size="4">To:</font></b></div>
</td>
<td valign="middle" width="361"><font size="4"><a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss@spectrumscale.org">gpfsug-discuss@spectrumscale.org</a></font></td>
</tr>
<tr valign="top">
<td valign="middle" width="55">
<div align="right"><b><font size="4">Subject:</font></b></div>
</td>
<td valign="middle" width="361"><font size="4">Re:
[gpfsug-discuss] backup and disaster recovery solutions</font></td>
</tr>
</tbody>
</table>
<tt>On Mon, 2016-04-11 at 10:34 -0400, Jaime Pinto wrote:<br>
> Do you want backups or periodic frozen snapshots of the
file system?<br>
> <br>
> Backups can entail some level of version control, so that
you or <br>
> end-users can get files back on certain points in time, in
case of <br>
> accidental deletions. Besides 1.5PB is a lot of material,
so you may <br>
> not want to take full snapshots that often. In that case, a
<br>
> combination of daily incremental backups using TSM with
GPFS's <br>
> mmbackup can be a good option. TSM also does a very good
job at <br>
> controlling how material is distributed across multiple
tapes, and <br>
> that is something that requires a lot of micro-management
if you want <br>
> a home grown solution of rsync+LTFS.<br>
<br>
Is there any other viable option other than TSM for backing up
1.5PB of<br>
data? All other backup software does not handle this at all
well.<br>
<br>
> On the other hand, you could use gpfs built-in tools such a
<br>
> mmapplypolicy to identify candidates for incremental
backup, and send <br>
> them to LTFS. Just more micro management, and you may have
to come up <br>
> with your own tool to let end-users restore their stuff, or
you'll <br>
> have to act on their behalf.<br>
> <br>
<br>
I was not aware of a way of letting end users restore their
stuff from<br>
*backup* for any of the major backup software while respecting
the file<br>
system level security of the original file system. If you let
the end<br>
user have access to the backup they can restore any file to any
location<br>
which is generally not a good idea.<br>
<br>
I do have a concept of creating a read only Fuse mounted file
system<br>
from a TSM point in time synthetic backup, and then using the
shadow<br>
copy feature of Samba to enable restores using the "Previous
Versions"<br>
feature of windows file manager.<br>
<br>
I got as far as getting a directory tree you could browse
through but<br>
then had an enforced change of jobs and don't have access to a
TSM<br>
server any more to continue development.<br>
<br>
Note if anyone from IBM is listening that would be a super cool
feature.<br>
<br>
<br>
JAB.<br>
<br>
-- <br>
Jonathan A. Buzzard Email: jonathan (at)
buzzard.me.uk<br>
Fife, United Kingdom.<br>
<br>
<br>
<br>
</tt><font color="#800080"><br>
----- Message from "Marc A Kaplan" <a class="moz-txt-link-rfc2396E" href="mailto:makaplan@us.ibm.com"><makaplan@us.ibm.com></a>
on Mon, 11 Apr 2016 11:11:24 -0400 -----</font>
<table border="0" cellpadding="0" cellspacing="0">
<tbody>
<tr valign="top">
<td valign="middle" width="55">
<div align="right"><b><font size="4">To:</font></b></div>
</td>
<td valign="middle" width="391"><font size="4">gpfsug main
discussion list <a class="moz-txt-link-rfc2396E" href="mailto:gpfsug-discuss@spectrumscale.org"><gpfsug-discuss@spectrumscale.org></a></font></td>
</tr>
<tr valign="top">
<td valign="middle" width="55">
<div align="right"><b><font size="4">Subject:</font></b></div>
</td>
<td valign="middle" width="391"><font size="4">Re:
[gpfsug-discuss] backup and disaster recovery solutions</font></td>
</tr>
</tbody>
</table>
Since you write "<font size="4">so if the file is not touched for
number of days, it's moved to a tape</font>" -<br>
that is what we call the HSM feature. This is additional function
beyond backup. IBM has two implementations. <font size="4"><br>
</font><br>
(1) TSM/HSM now called IBM Spectrum Protect.<br>
<font size="4"> </font><a moz-do-not-send="true"
href="http://www-03.ibm.com/software/products/en/spectrum-protect-for-space-management"><u><font
color="#0000FF" size="4">http://www-03.ibm.com/software/products/en/spectrum-protect-for-space-management</font></u></a><font
size="4"><br>
</font><br>
(2) HPSS <a moz-do-not-send="true"
href="http://www.hpss-collaboration.org/"><u><font
color="#0000FF">http://www.hpss-collaboration.org/</font></u></a><font
size="4"><br>
</font><br>
The GPFS (Spectrum Scale File System) policy feature supports
both, so that mmapplypolicy and GPFS policy rules can be used to
perform<br>
accelerated metadata scans to identify which files should be
migrated.<font size="4"><br>
</font><br>
Also, GPFS supports on-demand recall (on application reads) of
data from long term storage (tape) to GPFS storage (disk or SSD).
See also DMAPI.<font size="4"><br>
<br>
<br>
</font><br>
<img src="cid:part6.05050408.07080309@gpfsug.org" alt="Marc A
Kaplan" align="top" height="135" width="237"><font size="4"><br>
<br>
<br>
</font><font color="#5F5F5F" size="2"><br>
From: </font><font size="2">Damir Krstic
<a class="moz-txt-link-rfc2396E" href="mailto:damir.krstic@gmail.com"><damir.krstic@gmail.com></a></font><font color="#5F5F5F"
size="2"><br>
To: </font><font size="2">gpfsug main discussion list
<a class="moz-txt-link-rfc2396E" href="mailto:gpfsug-discuss@spectrumscale.org"><gpfsug-discuss@spectrumscale.org></a></font><font
color="#5F5F5F" size="2"><br>
Date: </font><font size="2">04/11/2016 09:16 AM</font><font
color="#5F5F5F" size="2"><br>
Subject: </font><font size="2">[gpfsug-discuss] backup and
disaster recovery solutions</font><font color="#5F5F5F" size="2"><br>
Sent by: </font><font size="2"><a class="moz-txt-link-abbreviated" href="mailto:gpfsug-discuss-bounces@spectrumscale.org">gpfsug-discuss-bounces@spectrumscale.org</a></font><font
size="4"><br>
</font>
<hr align="left" size="2" noshade="noshade" width="100%"><font
size="4"><br>
<br>
<br>
We have implemented 1.5PB ESS solution recently in our HPC
environment. Today we are kicking of backup and disaster
recovery discussions so I was wondering what everyone else is
using for their backup?<br>
<br>
In our old storage environment we simply rsync-ed home and
software directories and projects were not backed up. <br>
<br>
With ESS we are looking for more of a GPFS based backup solution
- something to tape possibly and also something that will have
life cycle feature - so if the file is not touched for number of
days, it's moved to a tape (something like LTFS).<br>
<br>
Thanks in advance.<br>
<br>
DAmir </font><tt>_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org</tt><u><font color="#0000FF"
size="4"><br>
</font></u><a moz-do-not-send="true"
href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss"><tt><u><font
color="#0000FF">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</font></u></tt></a><font
size="4"><br>
<br>
</font><tt>_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
</tt><tt><a moz-do-not-send="true"
href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt><tt><br>
</tt><br>
<br>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
<a class="moz-txt-link-freetext" href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a>
</pre>
</blockquote>
<br>
</body>
</html>