[gpfsug-discuss] Using AFM to migrate files

[Loic Tortay]

On 10/25/2016 09:24 AM, Radhika A Parameswaran wrote:
> 
> Loic,
> We will add about removing .ptrash to the migration usecase documentation. 
> Can you please share some details about your dataset and performance for 
> migrating the 100M (time for listfile processing and actual transfer) ?
> 
Hello,
According to my logs, the files lists processing by "mmafmctl prefetch"
with 2M files took between ~30 minutes and ~70 minutes.
>From what I can see, the longer processing times were for filesets with
many directories (less files per directory).

For the actual data transfers, it varied widely from a few minutes
(small files stored in the inode on a Flash-based storage unit) to a few
hours (1 or 2 TB of files not large enough to trigger the parallel
migration, while many batch jobs were accessing the "home" filesystem).


Loïc.
-- 
|       Loïc Tortay <tortay at cc.in2p3.fr> - IN2P3 Computing Centre      |