[gpfsug-discuss] Migrating billions of files? mmfind ... mmxcp

Marc A Kaplan makaplan at us.ibm.com
Wed Mar 6 15:01:57 GMT 2019


mmxcp may be in samples/ilm  if not, perhaps we can put it on an approved 
file sharing service ...


   + mmxcp script, for use with mmfind ... -xargs mmxcp ...
      Which makes parallelized file copy relatively easy and super fast!

Usage: /gh/bin/mmxcp -t target -p strip_count source_pathname1 
source_pathname2 ...

 Run "cp" in a  mmfind ... -xarg ... pipeline, e.g.

  mmfind -polFlags '-N all -g /gpfs/tmp' /gpfs/source -gpfsWeight 
DIRECTORY_HASH -xargs mmxcp -t /target -p 2

 Options:
  -t target_path : Copy files to this path.
  -p strip_count : Remove this many directory names from the pathnames of 
the source files.
  -a  : pass -a to cp
  -v  : pass -v to cp




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20190306/0361a3dd/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 21994 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20190306/0361a3dd/attachment-0002.gif>


More information about the gpfsug-discuss mailing list