<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial;font-size:10.5pt" ><div dir="ltr" >As Simon says, Quota measures used blocks in the filesystem.</div>
<div dir="ltr" >Hence users can and should have behaviour that keeps within these limits.</div>
<div dir="ltr" > </div>
<div dir="ltr" >GPFS Replication though is a system-administrator level concept - to protect data access in the case of power outages or though gross hardware failures. So as such should be transparent to the end users.</div>
<div dir="ltr" > </div>
<div dir="ltr" >Unless users are enabled to choose 1 or 2 (or 3) way replication of their own files dependent on their importance (eg 1 copy for scratch files) then imho replication should not be measured in quota reporting.</div>
<div dir="ltr" > </div>
<div dir="ltr" >On a related note, compression is great new feature, but it may confuse users if they delete some older but big 100GB files then try and recreate them only to find they can't because their quota is now exceeded (as compression is not at file creation but driven later by policies.</div>
<div dir="ltr" > </div>
<div dir="ltr" >Thoughts?</div>
<div class="socmaildefaultfont" dir="ltr" style="font-family:Arial;font-size:10.5pt" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div class="socmaildefaultfont" dir="ltr" style="font-family: Arial; font-size: 10.5pt;" ><div dir="ltr" style="margin-top: 20px;" ><div style="font-family: sans-serif; font-size: 8pt; margin-top: 10px;" ><div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" ><span style="font-family:Verdana, Geneva, sans-serif" ><span style="font-size:11.5pt;" >Daniel</span></span></div>
<div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" ><img alt="/spectrum_storage-banne" src="" src="http://ausgsa.ibm.com/projects/t/tivoli_visual_design/public/2015/Spectrum-Storage/Email-signatures/Storage/spectrum_storage-banner.png" style="width: 601px; height: 5px;" ></div>
<div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" ><br> </div>
<table border="0" cellpadding="0" cellspacing="0" > <tbody> <tr> <td style="width:201px;padding:0cm 0cm 0cm 0cm;" > <div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" ><img alt="Spectrum Scale Logo" src="" src="http://ausgsa.ibm.com/projects/t/tivoli_visual_design/public/2015/Spectrum-Storage/Email-signatures/Storage/spectrum_scale-logo.png" style="width: 75px; height: 120px; float: left;" ></div>
<div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" > </div> </td> <td style="width:21px;padding:0cm 0cm 0cm 0cm;" > </td> <td style="width:202px;padding:0cm 0cm 0cm 0cm;" > <div style="margin-bottom:0cm;margin-bottom:.0001pt;line-height:normal;" ><strong><span style="font-family:Arial, Helvetica, sans-serif" ><span style="font-size:10.0pt;" >Dr Daniel Kidger</span></span></strong><br> <span style="font-family:Arial, Helvetica, sans-serif" ><span style="font-size:7.5pt;" >IBM Technical Sales Specialist<br> Software Defined Solution Sales<br> <br> +</span></span><span style="color:#5F5F5F;" ><span style="font-family:Verdana, Geneva, sans-serif" ><span style="font-size:10.0pt;" >44-07818 522 266 </span></span></span><br> <span style="color:#5F5F5F;" ><span style="font-family:Arial, Helvetica, sans-serif" ><span style="font-size:8.0pt;" >daniel.kidger@uk.ibm.com</span></span></span></div> </td> </tr> </tbody></table>
<div> </div>
<div><br><font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2" > </font></div></div></div></div></div></div></div></div></div></div>
<div dir="ltr" > </div>
<div dir="ltr" > </div>
<blockquote data-history-content-modified="1" dir="ltr" style="border-left:solid #aaaaaa 2px; margin-left:5px; padding-left:5px; direction:ltr; margin-right:0px" >----- Original message -----<br>From: "Oesterlin, Robert" <Robert.Oesterlin@nuance.com><br>Sent by: gpfsug-discuss-bounces@spectrumscale.org<br>To: gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>Cc:<br>Subject: Re: [gpfsug-discuss] Data replication and fileset quotas<br>Date: Wed, May 4, 2016 12:19 PM<br> <br><!--Notes ACF
<meta http-equiv="Content-Type" content="text/html; charset=utf8" >-->
<div><div><div>From the documentation:</div>
<div> </div>
<div><span style="color: rgb(51, 51, 51); font-family: Arial, sans-serif; font-variant-ligatures: normal; font-variant-position: normal; font-variant-numeric: normal; font-variant-alternates: normal; font-variant-east-asian: normal; line-height: 20px; widows: 1; background-color: rgb(245, 245, 245);" >"When setting quota limits for a file system, replication within the file system should be considered. GPFS quota management takes replication into account when reporting on and determining if quota limits have been exceeded for both block and file usage. In a file system that has either type of replication set to a value of two, the values reported on by both the mmlsquota command and the mmrepquota command are double the value reported by the ls command."</span></div>
<div><div id="MAC_OUTLOOK_SIGNATURE" ><div style="color: rgb(0, 0, 0); font-family: Calibri, sans-serif; font-size: 14px;" > </div>
<div style="color: rgb(0, 0, 0); font-family: Helvetica, sans-serif; font-size: 14px;" ><font face="Helvetica" >Bob Oesterlin<br>Sr Storage Engineer, Nuance HPC Grid<br>507-269-0413</font></div>
<div style="color: rgb(0, 0, 0); font-family: Calibri, sans-serif; font-size: 14px;" > </div></div></div></div></div>
<div> </div><span id="OLK_SRC_BODY_SECTION" > </span>
<div style="font-family:Calibri; font-size:12pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt" ><span id="OLK_SRC_BODY_SECTION" ><span style="font-weight:bold" >From: </span><<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank" >gpfsug-discuss-bounces@spectrumscale.org</a>> on behalf of "Simon Thompson (Research Computing - IT Services)" <<a href="mailto:S.J.Thompson@bham.ac.uk" target="_blank" >S.J.Thompson@bham.ac.uk</a>><br><span style="font-weight:bold" >Reply-To: </span>gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank" >gpfsug-discuss@spectrumscale.org</a>><br><span style="font-weight:bold" >Date: </span>Wednesday, May 4, 2016 at 2:11 AM<br><span style="font-weight:bold" >To: </span>'gpfsug main discussion list' <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank" >gpfsug-discuss@spectrumscale.org</a>><br><span style="font-weight:bold" >Subject: </span>[EXTERNAL] Re: [gpfsug-discuss] Data replication and fileset quotas</span></div><span id="OLK_SRC_BODY_SECTION" > </span>
<div> </div><span id="OLK_SRC_BODY_SECTION" > <span style="mso-bookmark:_MailOriginalBody" > </span></span>
<div><div><br><br><br><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >Yes, this correct (I think there was some discussion on the mailing list a little while back).<br><br>The quota is the space used on disk, so if you run compression its the compressed size, tape hsm don't count until you recall them.<br><br>I assume mcstore is the same, I.e. Only counts on recall, but I haven't tested this.<br><br>Simon<br><br>--<br><br>Simon Thompson<br><br>Research Computing Team, IT Services<br><br>+44 121 415 8675<br><br>-----Original Message-----<br><b>From: </b>Bryan Banister [<a href="mailto:bbanister@jumptrading.com" target="_blank" >bbanister@jumptrading.com</a>]<br><b>Sent: </b>Tuesday, May 03, 2016 09:33 PM GMT Standard Time<br><b>To: </b>gpfsug main discussion list<br><b>Subject: </b>Re: [gpfsug-discuss] Data replication and fileset quotas<br><br><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit" >
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--> </span></span>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" ><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D" >Yes, I believe that is the case due to the fact that every file is replicated therefore taking twice as much space within the file system.</span></span></span></p>
<p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" ><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D" >-Bryan</span></span></span></p>
<p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" ><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D" > </span></span></span></p>
<div><div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in" ><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" ><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" >From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif" ><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank" >gpfsug-discuss-bounces@spectrumscale.org</a> [<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank" >mailto:gpfsug-discuss-bounces@spectrumscale.org</a>] <b>On Behalf Of</b> Buterbaugh, Kevin L<br><b>Sent:</b> Tuesday, May 03, 2016 3:27 PM<br><b>To:</b> gpfsug main discussion list <<a href="mailto:gpfsug-discuss@spectrumscale.org" target="_blank" >gpfsug-discuss@spectrumscale.org</a>><br><b>Subject:</b> [gpfsug-discuss] Data replication and fileset quotas</span></span></span></p></div></div>
<p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p>
<p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >Hi again all,</span></span></p>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >I have another question on a completely different topic and therefore I decided it was better to send two separate e-mails.</span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >For a number of years now we have had a GPFS filesystem where we use filesets and set fileset quotas. Data replication is set to one. I understand how that all works.</span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >We are creating another GPFS filesystem where we intend to also use filesets and fileset quotas, but set data replication to two. Based on my experience with data replication on a filesystem that doesn’t use filesets, I am expecting that setting data replication to two means that I will need to double the quota for each fileset (i.e. if a group has bought 5 TB of space I’ll need to set their fileset quota to 10 TB) but haven’t found where that is explicitly documented. Is that correct?</span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >Thanks again, all…</span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >Kevin</span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p>
<div><div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >—</span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >Kevin Buterbaugh - Senior System Administrator</span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" >Vanderbilt University - Advanced Computing Center for Research and Education</span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" ><a href="mailto:Kevin.Buterbaugh@vanderbilt.edu" target="_blank" >Kevin.Buterbaugh@vanderbilt.edu</a> - (615)875-9633</span></span></p></div>
<div><p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p></div>
<p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p></div>
<p><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span></p></div></div><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span>
<hr><br><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" ><font face="Arial" color="gray" size="1" >Note: This email is for the confidential use of the named addressee(s) only and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you are hereby notified that any review, dissemination or copying of this email is strictly prohibited, and to please notify the sender immediately and destroy this email and any attachments. Email transmission cannot be guaranteed to be secure or error-free. The Company, therefore, does not make any guarantees as to the completeness or accuracy of this email or any attachments. This email is for informational purposes only and does not constitute a recommendation, offer, request or solicitation of any kind to buy, sell, subscribe, redeem or perform any type of transaction of a financial product.</font></span></span></div></div><span id="OLK_SRC_BODY_SECTION" ><span style="mso-bookmark:_MailOriginalBody" > </span></span>
<div><font face="Default Monospace,Courier New,Courier,monospace" size="2" >_______________________________________________<br>gpfsug-discuss mailing list<br>gpfsug-discuss at spectrumscale.org<br><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" target="_blank" >http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></font></div></blockquote>
<div dir="ltr" > </div></div>Unless stated otherwise above:<BR>
IBM United Kingdom Limited - Registered in England and Wales with number 741598. <BR>
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU<BR>
<BR>