<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div dir="ltr" >Using a placement policy to an external pool seems an excellent idea.</div>
<div dir="ltr" > </div>
<div dir="ltr" >However as I understand it every file has a GPFS attribute as to which *internal* pool it belongs.</div>
<div dir="ltr" >If a file is transparently fetched back from an external pool such as S3 Object , TSM or LTFS tape then it is is to this pool that it returns.</div>
<div dir="ltr" >Also it is this internal pool that the first block resides even if the rest of the file is HSMed somewhere else?</div>
<div dir="ltr" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial, Helvetica, sans-serif;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family:Arial;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div dir="ltr" style="margin-top: 20px;" ><div style="font-family: sans-serif; font-size: 8pt; margin-top: 10px;" ><div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" ><span style="font-size:1.286em;" ><span style="font-family: Verdana,Geneva,sans-serif;" >Daniel</span></span></div>
<div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" ><br> </div>
<table cellspacing="0" cellpadding="0" border="0" > <tbody> <tr> <td style="width: 150px; padding: 0cm;" > <div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" ><a href="https://www.youracclaim.com/user/danel-kidger" target="_blank" ><img alt="IBM Storage Professional Badge" src="" src="https://acclaim-production-app.s3.amazonaws.com/images/ea52b12f-97ac-4e72-8d24-b0ced8054e7d/Storage%2BTechnical%2BV1.png" style="width: 120px; height: 120px; float: left;" ></a></div>
<div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" > </div> </td> <td style="width:21px;padding:0cm 0cm 0cm 0cm;" > </td> <td style="width:202px;padding:0cm 0cm 0cm 0cm;" > <div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" ><strong><span style="font-family:Arial, Helvetica, sans-serif" ><span style="font-size:10.0pt;" >Dr Daniel Kidger</span></span></strong><br> <span style="font-family:Arial, Helvetica, sans-serif" ><span style="font-size:7.5pt;" >IBM Technical Sales Specialist<br> Software Defined Solution Sales<br> <br> +</span></span><span style="color:#5F5F5F;" ><span style="font-family:Verdana, Geneva, sans-serif" ><span style="font-size:10.0pt;" >44-(0)7818 522 266 </span></span></span><br> <span style="color:#5F5F5F;" ><span style="font-family:Arial, Helvetica, sans-serif" ><span style="font-size:8.0pt;" >daniel.kidger@uk.ibm.com</span></span></span></div> </td> </tr> </tbody></table><font size="2" face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" > </font></div></div></div></div></div></div></div></div></div></div></div></div></div>
<div dir="ltr" > </div>
<div dir="ltr" > </div>
<blockquote data-history-content-modified="1" dir="ltr" style="border-left:solid #aaaaaa 2px; margin-left:5px; padding-left:5px; direction:ltr; margin-right:0px" >----- Original message -----<br>From: Edward Wahl <ewahl@osc.edu><br>Sent by: gpfsug-discuss-bounces@spectrumscale.org<br>To: <gpfsug-discuss@spectrumscale.org><br>Cc:<br>Subject: Re: [gpfsug-discuss] Introduction/Question<br>Date: Mon, Nov 6, 2017 7:43 PM<br>
<div><font size="2" face="Default Monospace,Courier New,Courier,monospace" >On Mon, 6 Nov 2017 09:20:11 +0000<br>"Chase, Peter" <peter.chase@metoffice.gov.uk> wrote:<br><br>> how can I automate sending files to a cloud object store as they arrive in<br>> GPFS and keep a copy of the file in GPFS?<br><br>Sounds like you already have an idea how to do this by using ILM policies.<br>Either quota based as you mention or 'placement' policies should work, though I<br>cannot speak to placement in an S3 environment, the policy engine has a way to<br>call external commands for that if necessary. Though if you create an external<br>pool, a placement policy may be much simpler and possibly faster as well as<br>data would be sent to S3 on write, rather than on a quota trigger. <br><br><br>If an external storage pool works properly for S3, I'd probably use a placement<br>policy myself. This also would depend on how/when I needed the data on S3 and<br>your mention of timeliness tells me placement rather than quota may be best.<br>Weighing the solutions for this may be better tested(and timed!) than anything. <br><br>EVERYONE wants a timely weather forecast. ^_-<br><br>Ed<br><br><br>--<br><br>Ed Wahl<br>Ohio Supercomputer Center<br>614-292-9302<br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HlQDuUjgJx4p54QzcXd0_zTwf4Cr2t3NINalNhLTA2E&m=lkq-3LnnOZn49mjQUkTsxZogZSU7Wlu9JgMssyfPGy8&s=mSz97ZpTbPWXyFjwhJi4mPF6S_dtloQOTmDWfR2UYfw&e=" target="_blank" >https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=HlQDuUjgJx4p54QzcXd0_zTwf4Cr2t3NINalNhLTA2E&m=lkq-3LnnOZn49mjQUkTsxZogZSU7Wlu9JgMssyfPGy8&s=mSz97ZpTbPWXyFjwhJi4mPF6S_dtloQOTmDWfR2UYfw&e=</a></font><br> </div></blockquote>
<div dir="ltr" > </div></div>Unless stated otherwise above:<BR>
IBM United Kingdom Limited - Registered in England and Wales with number 741598. <BR>
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU<BR>
<BR>