<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
Hi,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
We have here around 2PB GPFS (4.2.2) accessed through an HPC cluster with GPFS client on each node.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
We will have to open GPFS to all our users over CIFS and kerberized NFS with ACL support for both protocol for around +1000 users</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
All users have different use case and needs: </div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
- some will do random I/O through a large set of opened files (~5k files)</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
- some will do large write with 500GB-1TB files</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
- other will arrange sequential I/O with ~10k opened files</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
NFS and CIFS will share the same server, so I through to use SSD drive, at least 128GB memory with 2 sockets.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
Regarding tuning parameters, I thought at: </div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
maxFilesToCache 10000<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
syncIntervalStrict yes<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
workerThreads (8*core)<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
prefetchPct 40 (for now and update if needed)</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
I read the wiki 'Sizing Guidance for Protocol Node', but I was wondering if someone could share his experience/best practice regarding hardware sizing and/or tuning parameters.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
Thank by advance,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; margin-top:0px; margin-bottom:0px">
Frank</div>
</div>
</body>
</html>