<html><body><p><font size="2">That is fair, there certainly are compromises that have to be made with regards to file space/size/performance when choosing a block size, especially with varied workloads or users who may create 200,000 files at a time :). With an increased the number of subblocks, the compromises and parameters going into this choice change.</font><br><br><font size="2">However, I just didn't want to lose sight of the fact that the remainder of the 5.0.0 features and enhancements (and there are a lot :-) ) are available to all systems, with no need to go through painful data movement or recreating of filesystems.</font><br><br><font size="2">Thanks,</font><br><font size="2">Nikhil Khandelwal</font><br><font size="2">Spectrum Scale Development</font><br><font size="2">Client Adoption</font><br><br><img width="16" height="16" src="cid:1__=88BB0B7BDFC92A238f9e8a93df938690918c88B@" border="0" alt="Inactive hide details for Jonathan Buzzard ---11/30/2017 09:13:47 AM---On Wed, 2017-11-29 at 12:08 -0700, Nikhil Khandelwal wro"><font size="2" color="#424282">Jonathan Buzzard ---11/30/2017 09:13:47 AM---On Wed, 2017-11-29 at 12:08 -0700, Nikhil Khandelwal wrote: [SNIP]</font><br><br><font size="2" color="#5F5F5F">From: </font><font size="2">Jonathan Buzzard <jonathan.buzzard@strath.ac.uk></font><br><font size="2" color="#5F5F5F">To: </font><font size="2">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><br><font size="2" color="#5F5F5F">Date: </font><font size="2">11/30/2017 09:13 AM</font><br><font size="2" color="#5F5F5F">Subject: </font><font size="2">Re: [gpfsug-discuss] Online data migration tool</font><br><font size="2" color="#5F5F5F">Sent by: </font><font size="2">gpfsug-discuss-bounces@spectrumscale.org</font><br><hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br><br><br><tt><font size="2">On Wed, 2017-11-29 at 12:08 -0700, Nikhil Khandelwal wrote:<br><br>[SNIP]<br><br>> Since file systems created at 4.X.X and earlier used a block size<br>> that kept this allocation in mind, there should be very little impact<br>> on existing file systems.<br><br>That is quite a presumption. I would say that file systems created at<br>4.X.X and earlier potentially used a block size that was the best<br>*compromise*, and the new options would work a lot better.<br><br>So for example supporting a larger block size for users who have sane<br>workflows while still not wasting a ton of space for the biomedical<br>folks who abuse the file system as a database.<br><br>Though I have come to the conclusion to stop them using the file system<br>as a database (no don't do ls in that directory there is 200,000 files<br>and takes minutes to come back) is to put your BOFH hat on quota them<br>on maximum file numbers and suggest to them that they use a database<br>even if it is just sticking it all in SQLite :-D<br><br>JAB.<br><br>-- <br>Jonathan A. Buzzard Tel: +44141-5483420<br>HPC System Administrator, ARCHIE-WeSt.<br>University of Strathclyde, John Anderson Building, Glasgow. G4 0NG<br><br>_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br></font></tt><tt><font size="2"><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=WUJ15T9xHCCIfLm1wqC74jhfu28fXGLotYoHQvJlMCg&m=RrwCj4KWyu_ykACVG1SYu8EJiDZnH6edu-2rnoalOg4&s=p7xlojuTYL5csXYA94NyL-R5hk7OgLH0qKGTN0peGFk&e=">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=WUJ15T9xHCCIfLm1wqC74jhfu28fXGLotYoHQvJlMCg&m=RrwCj4KWyu_ykACVG1SYu8EJiDZnH6edu-2rnoalOg4&s=p7xlojuTYL5csXYA94NyL-R5hk7OgLH0qKGTN0peGFk&e=</a></font></tt><tt><font size="2"><br><br></font></tt><br><br><BR>
</body></html>