<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:12pt" ><div dir="ltr" >Does Aspera require a license? </div>
<div dir="ltr" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div dir="ltr" ><br><span style="font-size:1.143em;" >Fred<br>__________________________________________________<br>Fred Stock | IBM Pittsburgh Lab | 720-430-8821<br>stockf@us.ibm.com</span></div></div></div>
<div dir="ltr" > </div>
<div dir="ltr" > </div>
<blockquote data-history-content-modified="1" dir="ltr" style="border-left:solid #aaaaaa 2px; margin-left:5px; padding-left:5px; direction:ltr; margin-right:0px" >----- Original message -----<br>From: "Yaron Daniel" <YARD@il.ibm.com><br>Sent by: gpfsug-discuss-bounces@spectrumscale.org<br>To: gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>Cc:<br>Subject: Re: [gpfsug-discuss] Migrating billions of files?<br>Date: Wed, Mar 6, 2019 4:18 AM<br> <br><span style=" font-size:10pt;font-family:sans-serif" >Hi</span><br><br><span style=" font-size:10pt;font-family:sans-serif" >U can also use today Aspera - which will replicate gpfs extended attr.</span><br><br><span style=" font-size:11pt;font-family:sans-serif" ><b>Integration of IBM Aspera Sync with IBM Spectrum Scale: Protecting and Sharing Files Globally</b></span><br><a href="http://www.redbooks.ibm.com/redpieces/abstracts/redp5527.html?Open" target="_blank">http://www.redbooks.ibm.com/redpieces/abstracts/redp5527.html?Open</a><br><br><br><span style=" font-size:9pt;font-family:Arial" > </span><br><span style=" font-size:10pt;font-family:Arial" >Regards</span><br><span style=" font-size:9pt;font-family:Arial" > </span>
<table style="border-collapse:collapse;" width="780" >        <tbody>                <tr height="8" >                        <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="780" >                        <div align="center" >                        <hr noshade="noshade" ></div>                        <br>                        <span style=" font-size:1pt;font-family:Arial" > </span></td>                </tr>                <tr height="8" >                        <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="780" ><span style=" font-size:1pt;font-family:Arial" > </span></td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><span style=" font-size:10pt;color:blue;font-family:Arial" ><b>Yaron Daniel</b></span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > 94 Em Ha'Moshavot Rd</span></td>                        <td rowspan="3" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" >                        <div align="right" ><img src="cid:_1_0D9491980D948BE4003315D3C22583B5" style="border:0px solid;"  align="bottom" ></div>                        </td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><span style=" font-size:10pt;color:blue;font-family:Arial" ><b>Storage Architect – IL Lab Services (Storage)</b></span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > Petach Tiqva, 49527</span></td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><span style=" font-size:10pt;color:blue;font-family:Arial" ><b>IBM Global Markets, Systems HW Sales</b></span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > Israel</span></td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><span style=" font-size:10pt;color:blue;font-family:Arial" ><b> </b></span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:9pt;font-family:Arial" > </span></td>                </tr>                <tr height="8" >                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="90" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >Phone:</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="426" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >+972-3-916-5672</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt" > </span></td>                </tr>                <tr height="8" >                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="90" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >Fax:</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="426" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >+972-3-916-5672</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >  </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt" > </span></td>                </tr>                <tr height="8" >                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="90" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >Mobile:</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="426" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >+972-52-8395593</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >  </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt" > </span></td>                </tr>                <tr height="8" >                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="90" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >e-mail:</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="426" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >yard@il.ibm.com</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >  </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt" > </span></td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><a href="http://www.ibm.com/il/he/" target="_blank"><span style=" font-size:10pt;color:blue;font-family:Arial" ><u>IBM Israel</u></span></a></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >  </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt" > </span></td>                </tr>                <tr height="8" >                        <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="780" ><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial" > </span></td>                </tr>                <tr height="8" >                        <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="780" ><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial" > </span></td>                </tr>        </tbody></table>
<p style="margin-top:0px;margin-Bottom:0px" > </p><br><img alt="IBM Storage Strategy and Solutions v1" src="cid:_1_0CDF62E00CDF5ED0003315D3C22583B5" style="border:0px solid;" ><img alt="IBM Storage Management and Data Protection v1" src="cid:_1_0CDF64E80CDF5ED0003315D3C22583B5" style="border:0px solid;" ><img src="cid:_1_0CDF66F00CDF5ED0003315D3C22583B5" style="border:0px solid;" ><img src="cid:_1_0CDF68F80CDF5ED0003315D3C22583B5" style="border:0px solid;" ><span style=" font-size:12pt" > </span><img alt="https://acclaim-production-app.s3.amazonaws.com/images/6c2c3858-6df8-45be-ac2b-f93b8da74e20/Data%2BDriven%2BMulti%2BCloud%2BStrategy%2BV1%2Bver%2B4.png" src="cid:_1_0CDF6B180CDF5ED0003315D3C22583B5" style="border:0px solid;" ><span style=" font-size:12pt" > </span><img alt="FlashSystem A9000/R Foundations" src="cid:_1_0CDF6D640CDF5ED0003315D3C22583B5" style="border:0px solid;" ><img alt="All Flash Storage Foundations V2" src="cid:_1_0CDF6F6C0CDF5ED0003315D3C22583B5" style="border:0px solid;" ><br><br><br><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" >From:        </span><span style=" font-size:9pt;font-family:sans-serif" >Simon Thompson <S.J.Thompson@bham.ac.uk></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" >To:        </span><span style=" font-size:9pt;font-family:sans-serif" >gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" >Date:        </span><span style=" font-size:9pt;font-family:sans-serif" >03/06/2019 11:08 AM</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" >Subject:        </span><span style=" font-size:9pt;font-family:sans-serif" >Re: [gpfsug-discuss] Migrating billions of files?</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" >Sent by:        </span><span style=" font-size:9pt;font-family:sans-serif" >gpfsug-discuss-bounces@spectrumscale.org</span>
<hr noshade="noshade" > 
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:11pt;font-family:Calibri" >AFM doesn’t work well if you have dependent filesets though .. which we did for quota purposes.</span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:11pt;font-family:Calibri" > </span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:11pt;font-family:Calibri" >Simon</span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:11pt;font-family:Calibri" > </span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:12pt;font-family:Calibri" ><b>From: </b><gpfsug-discuss-bounces@spectrumscale.org> on behalf of "YARD@il.ibm.com" <YARD@il.ibm.com><br><b>Reply-To: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><br><b>Date: </b>Wednesday, 6 March 2019 at 09:01<br><b>To: </b>"gpfsug-discuss@spectrumscale.org" <gpfsug-discuss@spectrumscale.org><br><b>Subject: </b>Re: [gpfsug-discuss] Migrating billions of files?</span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:11pt;font-family:Calibri" > </span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:10pt;font-family:Arial" >Hi</span><br><br><span style=" font-size:10pt;font-family:Arial" >What permissions you have ? Do u have only Posix , or also SMB attributes ?</span><br><br><span style=" font-size:10pt;font-family:Arial" >If only posix attributes you can do the following:</span><br><br><span style=" font-size:10pt;font-family:Arial" >- rsync (which will work on different filesets/directories in parallel.<br>- AFM (but in case you need rollback - it will be problematic) </span><br><br><br><span style=" font-size:10pt;font-family:Arial" >Regards</span></p> 

<table style="border-collapse:collapse;" width="780" >        <tbody>                <tr height="8" >                        <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="780" >                        <div align="center" >                        <hr noshade="noshade" ></div>
                        <p style="margin-top:0px;margin-Bottom:0px" > </p>                        </td>                </tr>                <tr height="8" >                        <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="780" ><span style=" font-size:1pt;font-family:Arial" > </span></td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><span style=" font-size:10pt;color:blue;font-family:Arial" ><b>Yaron Daniel</b></span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > 94 Em Ha'Moshavot Rd</span></td>                        <td rowspan="3" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" >                        <div align="right" ><img alt="cid:_1_0FC36C500FC3669C00318CDBC22583B5" src="cid:_1_0FC365680FC36184003315D3C22583B5" style="border:0px solid;"  align="bottom" ></div>                        </td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><span style=" font-size:10pt;color:blue;font-family:Arial" ><b>Storage Architect – IL Lab Services (Storage)</b></span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > Petach Tiqva, 49527</span></td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><span style=" font-size:10pt;color:blue;font-family:Arial" ><b>IBM Global Markets, Systems HW Sales</b></span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > Israel</span></td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><span style=" font-size:10pt;color:blue;font-family:Arial" ><b> </b></span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:9pt;font-family:Arial" > </span></td>                </tr>                <tr height="8" >                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="90" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >Phone:</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="426" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >+972-3-916-5672</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" > </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt;font-family:Calibri" > </span></td>                </tr>                <tr height="8" >                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="90" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >Fax:</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="426" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >+972-3-916-5672</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >  </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt;font-family:Calibri" > </span></td>                </tr>                <tr height="8" >                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="90" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >Mobile:</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="426" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >+972-52-8395593</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >  </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt;font-family:Calibri" > </span></td>                </tr>                <tr height="8" >                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="90" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >e-mail:</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="426" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >yard@il.ibm.com</span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >  </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt;font-family:Calibri" > </span></td>                </tr>                <tr height="8" >                        <td colspan="2" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="516" ><a href="http://www.ibm.com/il/he/" target="_blank"><span style=" font-size:10pt;color:blue;font-family:Arial" ><u>IBM Israel</u></span></a></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="168" ><span style=" font-size:10pt;color:#5f5f5f;font-family:Arial" >  </span></td>                        <td style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="96" ><span style=" font-size:10pt;font-family:Calibri" > </span></td>                </tr>                <tr height="8" >                        <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="780" ><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial" > </span></td>                </tr>                <tr height="8" >                        <td colspan="4" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" width="780" ><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial" > </span></td>                </tr>        </tbody></table>
<p style="margin-top:0px;margin-Bottom:0px" ><br><img alt="IBM Storage Strategy and Solutions v1" src="cid:_1_0FC2FF280CDE5DD0003315D3C22583B5" style="border:0px solid;" ><img alt="IBM Storage Management and Data Protection v1" src="cid:_1_0FC301300CDE5DD0003315D3C22583B5" style="border:0px solid;" ><img alt="cid:_1_0FA0428C0FA03A6C00318CDBC22583B5" src="cid:_1_0FC303380CDE5DD0003315D3C22583B5" style="border:0px solid;" ><img alt="cid:_1_0FA044940FA03A6C00318CDBC22583B5" src="cid:_1_0FC305400CDE5DD0003315D3C22583B5" style="border:0px solid;" ><img alt="https://acclaim-production-app.s3.amazonaws.com/images/6c2c3858-6df8-45be-ac2b-f93b8da74e20/Data%2BDriven%2BMulti%2BCloud%2BStrategy%2BV1%2Bver%2B4.png" src="cid:_1_0FC307480CDE5DD0003315D3C22583B5" style="border:0px solid;" ><span style=" font-size:12pt;font-family:Calibri" > </span><img alt="FlashSystem A9000/R Foundations" src="cid:_1_0FC309500CDE5DD0003315D3C22583B5" style="border:0px solid;" ><img alt="All Flash Storage Foundations V2" src="cid:_1_0FC30B580CDE5DD0003315D3C22583B5" style="border:0px solid;" ><br><br><br><br><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial" >From:        </span><span style=" font-size:9pt;font-family:Arial" >"Oesterlin, Robert" <Robert.Oesterlin@nuance.com></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial" >To:        </span><span style=" font-size:9pt;font-family:Arial" >gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial" >Date:        </span><span style=" font-size:9pt;font-family:Arial" >03/05/2019 11:57 PM</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial" >Subject:        </span><span style=" font-size:9pt;font-family:Arial" >[gpfsug-discuss] Migrating billions of files?</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial" >Sent by:        </span><span style=" font-size:9pt;font-family:Arial" >gpfsug-discuss-bounces@spectrumscale.org</span></p>
<div align="center" ><hr noshade="noshade" ></div>
<p style="margin-top:0px;margin-Bottom:240px" ><span style=" font-size:11pt;font-family:Calibri" > </span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:12pt" >I’m looking at migration 3-4 Billion files, maybe 3PB of data between GPFS clusters. Most of the files are small - 60% 8K or less. Ideally I’d like to copy at least 15-20M files per day - ideally 50M.</span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:12pt" > </span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:12pt" >Any thoughts on how achievable this is? Or what to use? Either with AFM, mpifileutils, rsync.. other? Many of these files would be in 4k inodes. Destination is ESS.</span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:12pt" > </span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:12pt" > </span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:12pt" >Bob Oesterlin</span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:12pt" >Sr Principal Storage Engineer, Nuance</span></p>
<p style="margin-top:0px;margin-Bottom:0px" ><span style=" font-size:12pt" > </span><span style=" font-size:10pt;font-family:Courier New" >_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</span><br><u><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></u></p>
<p style="margin-top:0px;margin-Bottom:0px" ><br><tt><span style=" font-size:10pt" >_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org</span></tt><br><tt><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></tt></p>
<p style="margin-top:0px;margin-Bottom:0px" > </p>
<p style="margin-top:0px;margin-Bottom:0px" > </p> 

<div><font size="2" face="Default Monospace,Courier New,Courier,monospace" >_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></font></div></blockquote>
<div dir="ltr" > </div></div>
<BR>