<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.acopre
{mso-style-name:acopre;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-GB" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Hi Jordi,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Thanks, yes it is a disk pool:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Protect: TSM01>q stg BACKUP_DISK f=d<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Storage Pool Name: BACKUP_DISK<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Storage Pool Type: Primary<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Device Class Name: DISK<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Storage Type: DEVCLASS<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"> Next Storage Pool: BACKUP_ONSTAPE<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">So it is a disk pool … though it is made up of multiple disk files …<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">/tsmdisk/stgpool/tsmins- BACKUP_DISK DISK 200.0 G 0.0 On-Line<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">t3/bkup_diskvol01.dsm<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">/tsmdisk/stgpool/tsmins- BACKUP_DISK DISK 200.0 G 0.0 On-Line<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">t3/bkup_diskvol02.dsm<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">/tsmdisk/stgpool/tsmins- BACKUP_DISK DISK 200.0 G 0.0 On-Line<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">t3/bkup_diskvol03.dsm<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Will look into the FILE pool as this sounds like it might be less single threaded than now
</span><span style="font-family:"Apple Color Emoji";mso-fareast-language:EN-US">😊</span><span style="mso-fareast-language:EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Thanks<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Simon<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black"><gpfsug-discuss-bounces@spectrumscale.org> on behalf of "jordi.caubet@es.ibm.com" <jordi.caubet@es.ibm.com><br>
<b>Reply to: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><br>
<b>Date: </b>Monday, 4 January 2021 at 13:36<br>
<b>To: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><br>
<b>Subject: </b>Re: [gpfsug-discuss] Spectrum Protect and disk pools<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif">Simon,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif">which kind of storage pool are you using, DISK or FILE ? I understand DISK pool from your mail. DISK pool does not behave the same as FILE pool.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif">DISK pool is limited by the number of nodes or MIGProcess setting (the minimum of both) as the document states. Using proxy helps you backup in parallel from multiple nodes
to the stg pool but from Protect perspective it is a single node. Even multiple nodes are sending they run "<span class="acopre">asnodename"</span> so single node from Protect perspective.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif">If using FILE pool, you can define the number of volumes within the FILE pool and when migrating to tape, it will migrate each volume in parallel with the limit of MIGProcess
setting. So it would be the minimum of #volumes and MIGProcess value.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif">I know more deep technical skills in Protect are on this mailing list so feel free to add something or correct me.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif">Best Regards,<br>
--<br>
Jordi Caubet Serrabou<br>
IBM Storage Client Technical Specialist (IBM Spain)<br>
Ext. Phone: (+34) 679.79.17.84 (internal 55834)<br>
E-mail: <a href="mailto:jordi.caubet@es.ibm.com" target="_blank">jordi.caubet@es.ibm.com</a><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><br>
<br>
<span style="color:#990099"><a href="mailto:-----gpfsug-discuss-bounces@spectrumscale.org" target="_blank">-----gpfsug-discuss-bounces@spectrumscale.org</a> wrote: -----</span>
<o:p></o:p></span></p>
<div>
<div style="border:none;border-left:solid black 1.5pt;padding:0cm 0cm 0cm 4.0pt">
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif">To: "<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a>" <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank">gpfsug-discuss@spectrumscale.org</a>><br>
From: Simon Thompson <br>
Sent by: <a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">
gpfsug-discuss-bounces@spectrumscale.org</a><br>
Date: 01/04/2021 01:21PM<br>
Subject: [EXTERNAL] [gpfsug-discuss] Spectrum Protect and disk pools<br>
<br>
<br>
<o:p></o:p></span></p>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-family:"Verdana",sans-serif">Hi All,</span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
<p><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-family:"Verdana",sans-serif">We use Spectrum Protect (TSM) to backup our Scale filesystems. We have the backup setup to use multiple nodes with the PROXY node
function turned on (and to some extent also use multiple target servers).</span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
<p><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-family:"Verdana",sans-serif">This all feels like it is nice and parallel, on the TSM servers, we have disk pools for any “small” files to drop into (I think we
set anything smaller than 20GB) to prevent lots of small files stalling tape drive writes.</span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
<p><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-family:"Verdana",sans-serif">Whilst digging into why we have slow backups at times, we found that the disk pool empties with a single thread (one drive). And looking
at the docs:</span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-family:"Verdana",sans-serif"><a href="https://www.ibm.com/support/pages/concurrent-migration-processes-and-constraints">https://www.ibm.com/support/pages/concurrent-migration-processes-and-constraints</a></span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
<p><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-family:"Verdana",sans-serif">This implies that we are limited to the number of client nodes stored in the pool. i.e. because we have one node and PROXY nodes,
we are essentially limited to a single thread streaming out of the disk pool when full.</span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
<p><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-family:"Verdana",sans-serif">Have we understood this correctly as if so, this appears to make the whole purpose of PROXY nodes sort of pointless if you have lots
of small files. Or is there some other setting we should be looking at to increase the number of threads when the disk pool is emptying? (The disk pool itself has Migration Processes: 6)</span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
<p><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-family:"Verdana",sans-serif">Thanks</span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
<p><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"> <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-family:"Verdana",sans-serif">Simon</span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a> </span><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><o:p></o:p></span></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana",sans-serif"><br>
Salvo indicado de otro modo más arriba / Unless stated otherwise above:<br>
International Business Machines, S.A.<br>
Santa Hortensia, 26-28, 28002 Madrid<br>
Registro Mercantil de Madrid; Folio 1; Tomo 1525; Hoja M-28146<br>
CIF A28-010791<o:p></o:p></span></p>
</div>
</div>
</body>
</html>