<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none"><!-- p { margin-top: 0px; margin-bottom: 0px; }--></style>
</head>
<body dir="ltr" style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
<p></p>
<span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 16px; background-color: rgb(255, 255, 255);">If you are still running out of space when mmdf shows preallocated inodes left I'd check MaxInodes vs AllocInodes for that fileset.</span><br style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 16px;">
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 16px;"><br>
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 16px;">You can run:<br>
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 16px;">mmlsfileset <fs> -L<br>
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 16px;"><br>
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 16px;">Thanks,<br>
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 16px;">Chris<br>
</p>
<div><br>
<br>
</div>
<p><br>
</p>
<div style="color: rgb(33, 33, 33);">
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> gpfsug-discuss-bounces@spectrumscale.org <gpfsug-discuss-bounces@spectrumscale.org> on behalf of Frederick Stock <stockf@us.ibm.com><br>
<b>Sent:</b> Tuesday, January 23, 2018 9:25 AM<br>
<b>To:</b> gpfsug main discussion list<br>
<b>Subject:</b> Re: [gpfsug-discuss] Metadata only system pool</font>
<div> </div>
</div>
<div><font size="2" face="sans-serif">One possibility is the creation/expansion of directories or allocation of indirect blocks for large files.</font><br>
<br>
<font size="2" face="sans-serif">Not sure if this is the issue here but at one time inode allocation was considered slow and so folks may have pre-allocated inodes to avoid that overhead during file creation. To my understanding inode creation time is not
so slow that users need to pre-allocate inodes. Yes, there are likely some applications where pre-allocating may be necessary but I expect they would be the exception. I mention this because you have a lot of free inodes and of course once they are allocated
they cannot be de-allocated. </font><br>
<br>
<font size="3" face="sans-serif">Fred<br>
__________________________________________________<br>
Fred Stock | IBM Pittsburgh Lab | 720-430-8821<br>
stockf@us.ibm.com</font><br>
<br>
<br>
<br>
<font size="1" color="#5f5f5f" face="sans-serif">From: </font><font size="1" face="sans-serif">"Buterbaugh, Kevin L" <Kevin.Buterbaugh@Vanderbilt.Edu></font><br>
<font size="1" color="#5f5f5f" face="sans-serif">To: </font><font size="1" face="sans-serif">gpfsug main discussion list <gpfsug-discuss@spectrumscale.org></font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Date: </font><font size="1" face="sans-serif">01/23/2018 12:17 PM</font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Subject: </font><font size="1" face="sans-serif">[gpfsug-discuss] Metadata only system pool</font><br>
<font size="1" color="#5f5f5f" face="sans-serif">Sent by: </font><font size="1" face="sans-serif">gpfsug-discuss-bounces@spectrumscale.org</font><br>
<hr noshade="">
<br>
<br>
<br>
<font size="3">Hi All, </font><br>
<br>
<font size="3">I was under the (possibly false) impression that if you have a filesystem where the system pool contains metadata only then the only thing that would cause the amount of free space in that pool to change is the creation of more inodes … is that
correct? In other words, given that I have a filesystem with 130 million free (but allocated) inodes:</font><br>
<br>
<font size="3">Inode Information</font><br>
<font size="3">-----------------</font><br>
<font size="3">Number of used inodes: 218635454</font><br>
<font size="3">Number of free inodes: 131364674</font><br>
<font size="3">Number of allocated inodes: 350000128</font><br>
<font size="3">Maximum number of inodes: 350000128</font><br>
<font size="3"><br>
I would not expect that a user creating a few hundred or thousands of files could cause a “no space left on device” error (which I’ve got one user getting). There’s plenty of free data space, BTW.</font><br>
<br>
<font size="3">Now my system pool is almost “full”:</font><br>
<br>
<font size="3">(pool total) 2.878T 34M ( 0%) 140.9M ( 0%)</font><br>
<br>
<font size="3">But again, what - outside of me creating more inodes - would cause that to change??</font><br>
<br>
<font size="3">Thanks…</font><br>
<br>
<font size="3">Kevin</font><br>
<br>
<font size="3">—</font><br>
<font size="3">Kevin Buterbaugh - Senior System Administrator</font><br>
<font size="3">Vanderbilt University - Advanced Computing Center for Research and Education</font><br>
<a href="mailto:Kevin.Buterbaugh@vanderbilt.edu"><font size="3" color="blue"><u>Kevin.Buterbaugh@vanderbilt.edu</u></font></a><font size="3">- (615)875-9633</font><br>
<br>
<br>
<tt><font size="2">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at spectrumscale.org<br>
</font></tt><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=p_1XEUyoJ7-VJxF_w8h9gJh8_Wj0Pey73LCLLoxodpw&m=gou0xYZwz8M-5i8mT6Tthafi8JW2aMrzQGMK1hUEUls&s=jcHOB_vmJjE8PnrpfHqzMkm1nk6QWwkn2npTEP6kcKs&e="><tt><font size="2">https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=p_1XEUyoJ7-VJxF_w8h9gJh8_Wj0Pey73LCLLoxodpw&m=gou0xYZwz8M-5i8mT6Tthafi8JW2aMrzQGMK1hUEUls&s=jcHOB_vmJjE8PnrpfHqzMkm1nk6QWwkn2npTEP6kcKs&e=</font></tt></a><tt><font size="2"><br>
</font></tt><br>
<br>
<br>
</div>
</div>
</body>
</html>