<!doctype html>
<html>
<head>
<meta charset="UTF-8">
</head>
<body>
<div>
i seem to have read somewhere that packing is just wasting time on zipping as the same file will be transfered so i havent really looked to much into that? and i dont think that is even possible in our use case as that would also mean that we in theory need to store the same data twice at source site (unzipped and zipped data).
</div>
<div>
<br>
</div>
<div>
Best Regards
<br>Andi Christiansen
</div>
<blockquote type="cite">
<div>
On February 26, 2020 2:04 PM Andrew Beattie <abeattie@au1.ibm.com> wrote:
</div>
<div>
<br>
</div>
<div>
<br>
</div>
<p><span style="font-size: small;">Why don’t you look at packaging your small files into larger files which will be handled more effectively.<br></span><span style="font-size: small;"><br></span><span style="font-size: small;">There is no simple way to replicate / move billions of small files,<br></span><span style="font-size: small;"><br></span><span style="font-size: small;">But surely you can build your work flow to package the files up into a zip or tar format which will simplify not only the number of IO transactions but also make the whole process more palatable to the NFS protocol<br></span><span style="font-size: small;"><br></span><span style="font-size: small;">Sent from my iPhone<br></span><span style="font-size: small;"><br></span><span style="font-size: small;">> On 26 Feb 2020, at 22:58, Andi Christiansen <andi@christiansen.xxx> wrote:<br></span><span style="font-size: small;">> <br></span><span style="font-size: small;">> <br></span><span style="font-size: small;">> Hi all,<br></span><span style="font-size: small;">> <br></span><span style="font-size: small;">> Does anyone know of an alternative to AFM ?<br></span><span style="font-size: small;">> <br></span><span style="font-size: small;">> We have been working on tuning AFM for a few weeks now and see little to no improvement.. And now we are searching for an alternative.. So if anyone knows of a product that can implement with Spectrum Scale i am open to any suggestions :)<br></span><span style="font-size: small;">> <br></span><span style="font-size: small;">> We have a good mix of files but primarily billions of very small files which AFM does not handle well on long distances.<br></span><span style="font-size: small;">> <br></span><span style="font-size: small;">> <br></span><span style="font-size: small;">> Best Regards<br></span><span style="font-size: small;">> A. Christiansen<br></span><span style="font-size: small;">> _______________________________________________<br></span><span style="font-size: small;">> gpfsug-discuss mailing list<br></span><span style="font-size: small;">> gpfsug-discuss at spectrumscale.org<br></span><span style="font-size: small;">> <a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br></span><span style="font-size: small;">> <br></span><br></p>
</blockquote>
</body>
</html>