[gpfsug-discuss] 200 filesets and AFM

Mon Feb 20 17:03:29 GMT 2017

Hi

Split rsync into the directory level so u can run parallel rsync session , 
this way you maximize the network usage.

Regards

Yaron Daniel
 94 Em Ha'Moshavot Rd

Server, Storage and Data Services - Team Leader  
 Petach Tiqva, 49527
Global Technology Services
 Israel
Phone:
+972-3-916-5672

Fax:
+972-3-916-5672

Mobile:
+972-52-8395593

e-mail:
yard at il.ibm.com

IBM Israel

From:   "Mark.Bush at siriuscom.com" <Mark.Bush at siriuscom.com>
To:     gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date:   02/20/2017 06:54 PM
Subject:        Re: [gpfsug-discuss] 200 filesets and AFM
Sent by:        gpfsug-discuss-bounces at spectrumscale.org

Regular rsync apparently takes one week to sync up.  I?m just the 
messenger getting more info from my client soon. 

From: <gpfsug-discuss-bounces at spectrumscale.org> on behalf of Yaron Daniel 
<YARD at il.ibm.com>
Reply-To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date: Monday, February 20, 2017 at 10:05 AM
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] 200 filesets and AFM

Hi

Which protocols used to access data ? GPFS + NFS ?
If yes, you  can use standard rsync.

Regards

Yaron Daniel
 94 Em Ha'Moshavot Rd

Server, Storage and Data Services- Team Leader 
 Petach Tiqva, 49527
Global Technology Services
 Israel
Phone:
+972-3-916-5672

Fax:
+972-3-916-5672

Mobile:
+972-52-8395593

e-mail:
yard at il.ibm.com

IBM Israel

From:        "Mark.Bush at siriuscom.com" <Mark.Bush at siriuscom.com>
To:        gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date:        02/20/2017 05:56 PM
Subject:        Re: [gpfsug-discuss] 200 filesets and AFM
Sent by:        gpfsug-discuss-bounces at spectrumscale.org

Not sure.  It?s a 3.5 based cluster currently.

From: <gpfsug-discuss-bounces at spectrumscale.org> on behalf of Yaron Daniel 
<YARD at il.ibm.com>
Reply-To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date: Monday, February 20, 2017 at 9:47 AM
To: gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Subject: Re: [gpfsug-discuss] 200 filesets and AFM

Hi

Which ACLs you have in your FS ? 

Do u have NFSv4 Acls - which use NFS + Windows Acls ?

Regards

Yaron Daniel
 94 Em Ha'Moshavot Rd

Server, Storage and Data Services- Team Leader 
 Petach Tiqva, 49527
Global Technology Services
 Israel
Phone:
+972-3-916-5672

Fax:
+972-3-916-5672

Mobile:
+972-52-8395593

e-mail:
yard at il.ibm.com

IBM Israel

From:        "Buterbaugh, Kevin L" <Kevin.Buterbaugh at Vanderbilt.Edu>
To:        gpfsug main discussion list <gpfsug-discuss at spectrumscale.org>
Date:        02/20/2017 05:41 PM
Subject:        Re: [gpfsug-discuss] 200 filesets and AFM
Sent by:        gpfsug-discuss-bounces at spectrumscale.org

Hi Mark, 

Are you referring to this?

http://www.spectrumscale.org/pipermail/gpfsug-discuss/2012-October/000169.html

It?s not magical, but it?s pretty good!  ;-)  Seriously, we use it any 
time we want to move stuff around in our GPFS filesystems.

Kevin

On Feb 20, 2017, at 9:35 AM, Mark.Bush at siriuscom.comwrote:

I have a client that has around 200 filesets (must be a good reason for 
it) and they need to migrate data but it?s really looking like this might 
bring AFM to its knees.  At one point, I had heard of some magical version 
of RSYNC that IBM developed that could do something like this.  Anyone 
have any details on such a tool and is it available.  Or is there some 
other way I might do this?

<image001.png>
Mark R. Bush| Storage Architect
Mobile: 210-237-8415 
Twitter: @bushmr| LinkedIn: /markreedbush
10100 Reunion Place, Suite 500, San Antonio, TX 78216
www.siriuscom.com|mark.bush at siriuscom.com

?
Kevin Buterbaugh - Senior System Administrator
Vanderbilt University - Advanced Computing Center for Research and 
Education
Kevin.Buterbaugh at vanderbilt.edu- (615)875-9633

_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

This message (including any attachments) is intended only for the use of 
the individual or entity to which it is addressed and may contain 
information that is non-public, proprietary, privileged, confidential, and 
exempt from disclosure under applicable law. If you are not the intended 
recipient, you are hereby notified that any use, dissemination, 
distribution, or copying of this communication is strictly prohibited. 
This message may be viewed by parties at Sirius Computer Solutions other 
than those named in the message header. This message does not contain an 
official representation of Sirius Computer Solutions. If you have received 
this communication in error, notify Sirius Computer Solutions immediately 
and (i) destroy this message if a facsimile or (ii) delete this message 
immediately if this is an electronic communication. Thank you. 
Sirius Computer Solutions _______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
 _______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20170220/ece10b41/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1851 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20170220/ece10b41/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1852 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20170220/ece10b41/attachment-0001.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/gif
Size: 1853 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20170220/ece10b41/attachment-0002.gif>