[gpfsug-discuss] Question about Policies

[david_johnson at brown.edu]

You would want to look for examples of external scripts that work on the result of running the policy engine in listing mode.  The one issue that might need some attention is the way that gpfs quotes unprintable characters in the pathname. So the policy engine generates the list and your external script does the moving.  

  -- ddj
Dave Johnson

> On Dec 27, 2019, at 9:11 AM, Yaron Daniel <YARD at il.ibm.com> wrote:
> 
> Hi
> 
> As you said it migrate between different pools (ILM/External - Tape) - so in case you need to move directory to different location - you will have to use the OS mv command.
> From what i remember there is no directory policy for the same pool.
> 
> 
>  
> Regards
>  
> 
>  
>  
> Yaron Daniel	 94 Em Ha'Moshavot Rd	
> <mime-attachment.gif>
> Storage Architect – IL Lab Services (Storage)	 Petach Tiqva, 49527
> IBM Global Markets, Systems HW Sales	 Israel
>  	 	 
> Phone:	+972-3-916-5672	 	 
> Fax:	+972-3-916-5672	 	 
> Mobile:	+972-52-8395593	 	 
> e-mail:	yard at il.ibm.com	 	 
> Webex:            https://ibm.webex.com/meet/yard
> IBM Israel		 
>  
>  
> 
>   
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> 
> 
> 
> 
> From:        Kevin Doyle <kevin.doyle at manchester.ac.uk>
> To:        gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
> Date:        27/12/2019 15:57
> Subject:        [EXTERNAL] Re: [gpfsug-discuss] Question about Policies
> Sent by:        gpfsug-discuss-bounces at spectrumscale.org
> 
> 
> Hi
>  
> Thanks for your reply, once I have a set of files that are older than 30 days would I then use the migration rule to move them ?
>  
> Looking at the migration Rule syntax implies a “From” pool and a “To” pool, I only have a single pool so would I use the same pool name for From and To ? if it is the same pool
> How do I specify the folder to move it to which needs to be different from the current location.
>  
> Thanks
> Kevin
>  
> RULE['RuleName'] [WHENTimeBooleanExpression]
>   MIGRATE [COMPRESS({'yes' | 'no' | 'lz4' | 'z'})]
>     [FROM POOL'FromPoolName']
>     [THRESHOLD(HighPercentage[,LowPercentage[,PremigratePercentage]])]
>     [WEIGHT(WeightExpression)]
>   TO POOL'ToPoolName'    
>     [LIMIT(OccupancyPercentage)]
>     [REPLICATE(DataReplication)]
>     [FOR FILESET('FilesetName'[,'FilesetName']...)]
>     [SHOW(['String'] SqlExpression)]
>     [SIZE(numeric-sql-expression)]
>     [ACTION(SqlExpression)]
>     [WHERESqlExpression]
>  
>  
> Kevin Doyle | Linux Administrator, Scientific Computing
> Cancer Research UK, Manchester Institute
> The University of Manchester
> Room 13G40, Alderley Park, Macclesfield SK10 4TG
> Mobile:  07554 223480
> Email: Kevin.Doyle at manchester.ac.uk
>  
> <mime-attachment.png>
>  
>  
>  
> From: <gpfsug-discuss-bounces at spectrumscale.org> on behalf of Yaron Daniel <YARD at il.ibm.com>
> Reply-To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
> Date: Friday, 27 December 2019 at 12:55
> To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
> Subject: Re: [gpfsug-discuss] Question about Policies
>  
> Hi
> 
> U can create list of diretories in output file which were not modify in the last 30 days, and than second script will move this directories to the new location that u want.
> 
> 
> 
> Regards
> 
> 
>  
> Yaron Daniel	 94 Em Ha'Moshavot Rd	
> <mime-attachment.gif>
> Storage Architect – IL Lab Services (Storage)	 Petach Tiqva, 49527
> IBM Global Markets, Systems HW Sales	 Israel
>  	 	 
> Phone:	+972-3-916-5672	 	 
> Fax:	+972-3-916-5672	 	 
> Mobile:	+972-52-8395593	 	 
> e-mail:	yard at il.ibm.com	 	 
> Webex:            https://ibm.webex.com/meet/yard
> IBM Israel		 
>  
>  
> 
>  
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> <mime-attachment.jpg>
> 
> 
> 
> 
> From:        Kevin Doyle <kevin.doyle at manchester.ac.uk>
> To:        "gpfsug-discuss at spectrumscale.org" <gpfsug-discuss at spectrumscale.org>
> Date:        27/12/2019 13:45
> Subject:        [EXTERNAL] [gpfsug-discuss] Question about Policies
> Sent by:        gpfsug-discuss-bounces at spectrumscale.org
>  
> 
> Hi
>  
> I work for Cancer Research UK MI in Manchester UK. I am new to GPFS and have been tasked with creating a policy that will
> Move files older that 30 days to a new folder within the same pool. There are a lot of files so using a policy based move will be faster.
> I have read about the migration Rule but it states a source and destination pool, we only have one pool. Will it work if I define the same source and destination pool ?
>  
> Many thanks
> Kevin
>  
>  
> Kevin Doyle | Linux Administrator, Scientific Computing
> Cancer Research UK, Manchester Institute
> The University of Manchester
> Room 13G40, Alderley Park, Macclesfield SK10 4TG
> Mobile:  07554 223480
> Email: Kevin.Doyle at manchester.ac.uk
>  
> <mime-attachment.png>
>  
>  
> 
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
> 
> 
> 
> 
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
> 
> 
> 
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
> http://gpfsug.org/mailman/listinfo/gpfsug-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20191227/c010a297/attachment-0002.htm>