<div dir="ltr"><div dir="ltr">mmlspool might suggest there's only 1 system pool per cluster. We have 2 clusters and it has id=0 on both.<div><br></div><div>One of our clusters has 2 filesystems that have same id for two different dataonly pools:<br><div><div>[root@cl001 ~]# mmlspool home all</div><div>Name Id</div><div>system 0 </div><div>fc_8T 65537 </div><div>fc_ssd400G 65538 </div><div>[root@cl001 ~]# mmlspool work all</div><div>Name Id</div><div>system 0 </div><div>sas_6T 65537 </div></div><div><br></div><div>I know md lives in the system pool and if you do encryption you can forget about putting data into you inodes for small files</div><div><br></div><div><br></div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Mar 27, 2019 at 10:57 AM Stephen Ulmer <<a href="mailto:ulmer@ulmer.org">ulmer@ulmer.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="overflow-wrap: break-word;"><div>This presentation contains lots of good information about file system structure in general, and GPFS in specific, and I appreciate that and enjoyed reading it.</div><div><br></div>However, it states outright (both graphically and in text) that storage pools are a feature of the cluster, not of a file system — which I believe to be completely incorrect. For example, it states that there is "only one system pool per cluster", rather than one per file system.<div><br></div><div>Given that this was written by IBMers and presented at an actual users’ group, can someone please weigh in on this? I’m asking because it represents a fundamental misunderstanding of a very basic GPFS concept, which makes me wonder how authoritative the rest of it is...</div><div><div><br><div>
<div style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px">-- <br>Stephen<br><br><br></div>
</div>
<div><br><blockquote type="cite"><div>On Mar 26, 2019, at 12:27 PM, Dorigo Alvise (PSI) <<a href="mailto:alvise.dorigo@psi.ch" target="_blank">alvise.dorigo@psi.ch</a>> wrote:</div><br class="gmail-m_871237091420363041Apple-interchange-newline"><div><div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;direction:ltr;font-family:Tahoma;font-size:10pt"><div>Hi Marc,<br></div><div>"Indirect block size" is well explained in this presentation:<span class="gmail-m_871237091420363041Apple-converted-space"> </span><br></div><div><br></div><div><a href="http://files.gpfsug.org/presentations/2016/south-bank/D2_P2_A_spectrum_scale_metadata_dark_V2a.pdf" target="_blank">http://files.gpfsug.org/presentations/2016/south-bank/D2_P2_A_spectrum_scale_metadata_dark_V2a.pdf</a></div><div><br></div><div>pages 37-41<br></div><div><br></div><div>Cheers,</div><div><br></div><div> Alvise<br></div><div><br></div><div style="font-family:"Times New Roman";font-size:16px"><hr><div id="gmail-m_871237091420363041divRpF933280" style="direction:ltr"><font size="2" face="Tahoma"><b>From:</b><span class="gmail-m_871237091420363041Apple-converted-space"> </span><a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectrumscale.org</a><span class="gmail-m_871237091420363041Apple-converted-space"> </span>[<a href="mailto:gpfsug-discuss-bounces@spectrumscale.org" target="_blank">gpfsug-discuss-bounces@spectrumscale.org</a>] on behalf of Caubet Serrabou Marc (PSI) [<a href="mailto:marc.caubet@psi.ch" target="_blank">marc.caubet@psi.ch</a>]<br><b>Sent:</b><span class="gmail-m_871237091420363041Apple-converted-space"> </span>Tuesday, March 26, 2019 4:39 PM<br><b>To:</b><span class="gmail-m_871237091420363041Apple-converted-space"> </span>gpfsug main discussion list<br><b>Subject:</b><span class="gmail-m_871237091420363041Apple-converted-space"> </span>[gpfsug-discuss] GPFS v5: Blocksizes and subblocks<br></font><br></div><div></div><div><div style="direction:ltr;font-family:Tahoma;font-size:10pt"><div>Hi all,</div><div><br></div><div>according to several GPFS presentations as well as according to the man pages:</div><div><br></div><div><font face="Courier New"> Table 1. Block sizes and subblock sizes<br><br>+-------------------------------+-------------------------------+<br>| Block size | Subblock size |<br>+-------------------------------+-------------------------------+<br>| 64 KiB | 2 KiB |<br>+-------------------------------+-------------------------------+<br>| 128 KiB | 4 KiB |<br>+-------------------------------+-------------------------------+<br>| 256 KiB, 512 KiB, 1 MiB, 2 | 8 KiB |<br>| MiB, 4 MiB | |<br>+-------------------------------+-------------------------------+<br>| 8 MiB, 16 MiB | 16 KiB |<br>+-------------------------------+-------------------------------+</font><br><br></div><div>A block size of 8MiB or 16MiB should contain subblocks of 16KiB.</div><div><br></div><div>However, when creating a new filesystem with 16MiB blocksize, looks like is using 128KiB subblocks:</div><div><br></div><div><font face="Courier New">[root@merlindssio01 ~]# mmlsfs merlin<br>flag value description<br>------------------- ------------------------ -----------------------------------<br> -f 8192 Minimum fragment (subblock) size in bytes (system pool)<br> 131072 Minimum fragment (subblock) size in bytes (other pools)<br> -i 4096 Inode size in bytes<br> -I 32768 Indirect block size in bytes<br>.</font></div><div><font face="Courier New">.</font></div><div><font face="Courier New">.<br></font></div><div><font face="Courier New"> -n 128 Estimated number of nodes that will mount file system<br> -B 1048576 Block size (system pool)<br> 16777216 Block size (other pools)<br>.</font></div><div><font face="Courier New">.</font></div><div><font face="Courier New">.</font><br></div><div><br></div><div>What am I missing? According to documentation, I expect this to be a fixed value, or it isn't at all?<br></div><div><br></div><div>On the other hand, I don't really understand the concept 'Indirect block size in bytes', can somebody clarify or provide some details about this setting?</div><div><br></div><div>Thanks a lot and best regards,</div><div>Marc <span class="gmail-m_871237091420363041Apple-converted-space"> </span><br><div style="font-family:Tahoma;font-size:13px"><div style="font-family:Tahoma;font-size:13px"><div class="gmail-m_871237091420363041BodyFragment"><font size="2"><span style="font-size:10pt"><div class="gmail-m_871237091420363041PlainText">_________________________________________<br>Paul Scherrer Institut<span class="gmail-m_871237091420363041Apple-converted-space"> </span><br>High Performance Computing<br>Marc Caubet Serrabou<br>Building/Room: WHGA/019A</div><div class="gmail-m_871237091420363041PlainText"><font size="2"><span style="font-size:10pt">Forschungsstrasse, 111</span></font></div><div class="gmail-m_871237091420363041PlainText">5232 Villigen PSI<br>Switzerland<br><br>Telephone: +41 56 310 46 67<br>E-Mail:<span class="gmail-m_871237091420363041Apple-converted-space"> </span><a href="mailto:marc.caubet@psi.ch" target="_blank">marc.caubet@psi.ch</a></div></span></font></div></div></div></div></div></div></div></div><span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">_______________________________________________</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none"><span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">gpfsug-discuss mailing list</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none"><span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline">gpfsug-discuss at<span class="gmail-m_871237091420363041Apple-converted-space"> </span></span><a href="http://spectrumscale.org/" style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" target="_blank">spectrumscale.org</a><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none"><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></div></blockquote></div><br></div></div></div>_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at <a href="http://spectrumscale.org" rel="noreferrer" target="_blank">spectrumscale.org</a><br>
<a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss" rel="noreferrer" target="_blank">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a><br>
</blockquote></div>