<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto">Hi, from phone so sorry for typos. <div><br></div><div>I really think you should look into Spectrum Scale Erasure Code Edition (ECE) for this. </div><div><br></div><div>Sure you could do a RAID on each node as you mention here but that sounds like a lot of waste to me on storage capacity. Not to forget you get other goodies like end to end checksum and rapid rebuilds with ECE, among others. </div><div><br></div><div>Four servers is the minimum requirement for ECE (4+3p) and from top of my head 12 disk per RG, you are fine with both requirements. <br><br>There is a presentation on ECE on the user group web page from London May 2019 were we talk about ECE. </div><div><br></div><div>And the ibm page of the product <a href="https://www.ibm.com/support/knowledgecenter/STXKQY_ECE_5.0.3/com.ibm.spectrum.scale.ece.v5r03.doc/b1lece_intro.htm">https://www.ibm.com/support/knowledgecenter/STXKQY_ECE_5.0.3/com.ibm.spectrum.scale.ece.v5r03.doc/b1lece_intro.htm</a><br><div dir="ltr" id="AppleMailSignature">--<div>Cheers</div></div><div dir="ltr"><br>El 29 jul 2019, a las 19:06, David Johnson <<a href="mailto:david_johnson@brown.edu">david_johnson@brown.edu</a>> escribió:<br><br></div><blockquote type="cite"><div dir="ltr"><span>We are planning a 5.0.x upgrade onto new hardware to make use of the new 5.x GPFS features.</span><br><span>The goal is to use up to four NSD nodes for metadata, each one with 6 NVMe drives (to be determined</span><br><span>whether we use Intel VROC for raid 5 or raid 1, or just straight disks). </span><br><span></span><br><span>So questions — </span><br><span>Has anyone done system pool on shared nothing cluster? How did you set it up?</span><br><span>With default metadata replication set at 3, can you make use of four NSD nodes effectively?</span><br><span>How would one design the location vectors and failure groups so that the system metadata is</span><br><span>spread evenly across the four servers?</span><br><span></span><br><span>Thanks,</span><br><span> — ddj</span><br><span>Dave Johnson</span><br><span>_______________________________________________</span><br><span>gpfsug-discuss mailing list</span><br><span>gpfsug-discuss at <a href="http://spectrumscale.org">spectrumscale.org</a></span><br><span><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a> </span><br><span></span><br></div></blockquote></div><BR>
Ellei edellä ole toisin mainittu: / Unless stated otherwise above:<BR>
Oy IBM Finland Ab<BR>
PL 265, 00101 Helsinki, Finland<BR>
Business ID, Y-tunnus: 0195876-3 <BR>
Registered in Finland<BR>
<BR>
</body></html>