[gpfsug-discuss] AFM Alternative?

[Andrew Beattie]

Why don’t you look at packaging your small files into larger files which
will be handled more effectively.

There is no simple way to replicate / move billions of small files,

But surely you can build your work flow to package the files up into a zip
or tar format which will simplify not only the number of IO transactions
but also make the whole process more palatable to the NFS protocol

Sent from my iPhone

> On 26 Feb 2020, at 22:58, Andi Christiansen <andi at christiansen.xxx>
wrote:
>
> 
> Hi all,
>
> Does anyone know of an alternative to AFM ?
>
> We have been working on tuning AFM for a few weeks now and see little to
no improvement.. And now we are searching for an alternative.. So if anyone
knows of a product that can implement with Spectrum Scale i am open to any
suggestions :)
>
> We have a good mix of files but primarily billions of very small files
which AFM does not handle well on long distances.
>
>
> Best Regards
> A. Christiansen
> _______________________________________________
> gpfsug-discuss mailing list
> gpfsug-discuss at spectrumscale.org
>
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=STXkGEO2XATS_s2pRCAAh2wXtuUgwVcx1XjUX7ELNdk&m=BDsYqP0is2zoDGYU5Ej1lSJ4s9DJhMsW40equi5dqCs&s=22KcLJbUqsq3nfr3qWnxDqA3kuHnFxSDeiENVUITmdA&e=

>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20200226/371d0e82/attachment-0002.htm>