[gpfsug-discuss] naive question about rsync: run it on a client or on NSD server?

Skylar Thompson skylar2 at uw.edu
Fri Feb 14 17:24:46 GMT 2020


Our experience matches Ed. I have a vague memory that clients will balance
traffic across all NSD servers based on the preferred list for each NSD,
whereas NSD servers will just read from each NSD directly.

On Fri, Feb 14, 2020 at 04:13:30PM +0000, Wahl, Edward wrote:
> Disregarding all the other reasons not to run it on the NSDs,  many years of rsync on GPFS has shown us it is ALWAYS faster from clients with reasonable networks and no other overhead.
> 
> Ed
> 
> -----Original Message-----
> From: gpfsug-discuss-bounces at spectrumscale.org <gpfsug-discuss-bounces at spectrumscale.org> On Behalf Of Giovanni Bracco
> Sent: Friday, February 14, 2020 8:25 AM
> To: gpfsug-discuss at spectrumscale.org
> Subject: [gpfsug-discuss] naive question about rsync: run it on a client or on NSD server?
> 
> We must replicate about 100 TB data between two filesystems supported by two different storages (DDN9900 and DDN7990) both connected to the same NSD servers (6 of them) and we plan to use rsync.
> 
> Non special GPFS attributes, just the standard POSIX one, we plan to use the standard rsync.
> 
> The question:
> is there any advantage in running the rsync on one of the NSD server or is better to run it on a client?
> 
> The environment:
> GPFS 4.2.3.19, NSD CentOS7.4,  clients mostly CentOS6.4 (connected by IB
> QDR) and CentOS7.3 (connected by OPA), connection between NSD and storage with IB QDR)

-- 
-- Skylar Thompson (skylar2 at u.washington.edu)
-- Genome Sciences Department, System Administrator
-- Foege Building S046, (206)-685-7354
-- University of Washington School of Medicine



More information about the gpfsug-discuss mailing list