[gpfsug-discuss] Migrate/syncronize data from Isilon to Scale over NFS?

[Chris Schlipalius]

So at my last job we used to rsync data between isilons across campus, and isilon to Windows File Cluster (and back).

I recommend using dry run to generate a list of files and then use this to run with rysnc.

This allows you also to be able to break up the transfer into batches, and check if files have changed before sync (say if your isilon files are not RO.

Also ensure you have a recent version of rsync that preserves extended attributes and check your ACLS.

 

A dry run example:

https://unix.stackexchange.com/a/261372

 

I always felt more comfortable having a list of files before a sync….

 

 

 

Regards,

Chris Schlipalius

 

Team Lead, Data Storage Infrastructure, Supercomputing Platforms, Pawsey Supercomputing Centre (CSIRO)

1 Bryce Avenue

Kensington  WA  6151

Australia

 

Tel  +61 8 6436 8815 

Email  chris.schlipalius at pawsey.org.au

Web  www.pawsey.org.au

 

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20201118/c99c2fb1/attachment-0002.htm>