<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Aptos;
panose-1:2 11 0 4 2 2 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="en-SE" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">HI,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">I now been told that its also a Scale license violation to mix Lenovo DSS with IBM ESS in same cluster<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">Mvh Roger Eriksson<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">--------------------------------------------------------<o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">IBM Partner Technical Specialist Storage<o:p></o:p></span></b></p>
<p class="MsoNormal"><i><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">Phone:</span></i><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> +46-70-7933518<o:p></o:p></span></p>
<p class="MsoNormal"><i><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">E-mail:</span></i><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">
</span><span lang="SV" style="font-size:11.0pt;font-family:"Calibri",sans-serif"><a href="mailto:roger_eriksson@se.ibm.com"><span lang="EN-US" style="color:#0563C1">roger_eriksson@se.ibm.com</span></a></span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">IBM Storage User Group Sweden</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> next live
meeting 2</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">9-30 May</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> 202</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">4</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">
@IBM Innovation Studio Kista, Sweden<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">Registration links and agenda to be avail in April 24</span><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div id="mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">gpfsug-discuss <gpfsug-discuss-bounces@gpfsug.org> on behalf of ROGER ERIKSSON <roger_eriksson@se.ibm.com><br>
<b>Date: </b>Monday, 15 January 2024 at 11:32<br>
<b>To: </b>gpfsug main discussion list <gpfsug-discuss@gpfsug.org>, Dorigo Alvise <alvise.dorigo@psi.ch><br>
<b>Subject: </b>[EXTERNAL] Re: [gpfsug-discuss] Merge of IBM and Lenovo building blocks: issue with topology discover<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white">Hi, Even if this would work technically, as far as Im aware its not supported to have Lenovo GSS and IBM ESS in same cluster, for support reasons. If you go ahead
anyway, you might get into problems if you ever need to call for support. Mvh <o:p>
</o:p></span></p>
</div>
<div>
<p class="MsoNormal" style="mso-line-height-alt:.75pt"><span style="font-size:1.0pt;color:white"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">Hi,</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">Even if this would work technically, as far as Im aware its not supported to have Lenovo GSS and IBM ESS in same cluster, for support reasons.</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt">If you go ahead anyway, you might get into problems if you ever need to call for support.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">Mvh Roger Eriksson</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">--------------------------------------------------------</span><o:p></o:p></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">IBM Partner Technical Specialist Storage</span></b><o:p></o:p></p>
<p class="MsoNormal"><i><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">Phone:</span></i><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> +46-70-7933518</span><o:p></o:p></p>
<p class="MsoNormal"><i><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">E-mail:</span></i><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">
</span><span lang="SV" style="font-size:11.0pt;font-family:"Calibri",sans-serif"><a href="mailto:roger_eriksson@se.ibm.com"><span lang="EN-US" style="color:#0563C1">roger_eriksson@se.ibm.com</span></a></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">IBM Storage User Group Sweden</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> next live meeting 2</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">9-30
May</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> 202</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">4</span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> @IBM Innovation Studio
Kista, Sweden</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">Registration links and agenda to be avail in April 24</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt"> </span><o:p></o:p></p>
<div id="mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">gpfsug-discuss <gpfsug-discuss-bounces@gpfsug.org> on behalf of Dorigo Alvise <alvise.dorigo@psi.ch><br>
<b>Date: </b>Monday, 15 January 2024 at 10:29<br>
<b>To: </b>gpfsug-discuss@gpfsug.org <gpfsug-discuss@gpfsug.org><br>
<b>Subject: </b>[EXTERNAL] [gpfsug-discuss] Merge of IBM and Lenovo building blocks: issue with topology discover</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:1.0pt;color:white">Dear All, Happy new year to everyone! My goal here at the Paul Scherrer Institut is to merge two different GPFS building blocks. In partucular, these are not the same technology or not even the
same brand: - an IBM ESS-3500 (a NVMe/Performance </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Dear All,<br>
Happy new year to everyone!</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">My goal here at the Paul Scherrer Institut is to merge two different GPFS building blocks. In partucular, these are not the same technology or not even the same brand:</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">- an IBM ESS-3500 (a NVMe/Performance storage system) consisting of a Power9 confluent node and two AMD canisters, and 12 NVMe drives</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">- a Lenovo G242 "hybrid" consisting of 4 HDD enclosures, 2 SSD enclosures, 1 Intel support node and 2 Intel storage nodes.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">The final configuration I would expect is a single building block with 4 IO nodes, 3 declustered array: 1 for HDDs, 1 for SSDs, 1 for NVMe (the last one to be used as a cache pool).</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">First of all, I would like to know if anyone has already tried this solution successfully.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Then, below is the description of what I have done.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">I will preface by saying that I was able to configure the two storage clusters separately without any problem; therefore, I would exclude any inherent problem in each building block (which was installed from scratch).
But when I try to have a single cluster, with different node classes, I have problems.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">The steps I followed (based on documentation I found in IBM pages, https://www.ibm.com/docs/en/ess-p8/5.3.1?topic=command-outline-mmvdisk-use-case) are as follows:</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">1 access one of the 2 building blocks (that already has a storage cluster configured, with no recoverygroups defined)</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">2 run "mmaddnode -N <the_two_IO_nodes_to_add_from_the_other_BB>"</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">3 mmchlicense...</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">3 mmvdisk nodeclass create ... to isolate the two "new" IO nodes in a dedicated nodeclass for the purpose of differentiating configuration parameters, connected drive topology, and then recovery groups</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">4 perform topology discovery with: mmvdisk server list --node-class ess --disk-topology</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">In the following the cluster and node classes:</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-family:"Courier New";color:black"><br>
Node Daemon node name IP address Admin node name Designation <br>
---------------------------------------------------------------------- <br>
1 sfdssio1.psi.ch 129.129.241.67 sfdssio1.psi.ch quorum-manager <br>
2 sfdssio2.psi.ch 129.129.241.68 sfdssio2.psi.ch quorum-manager <br>
3 sfessio1.psi.ch 129.129.241.27 sfessio1.psi.ch quorum-manager <br>
4 sfessio2.psi.ch 129.129.241.28 sfessio2.psi.ch quorum-manager <br>
<br>
Node Class Name Members <br>
--------------------- -----------------------------------------------------------
<br>
ess sfessio1.psi.ch,sfessio2.psi.ch <br>
dss sfdssio1.psi.ch,sfdssio2.psi.ch</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">The "mmnodeadd" operation was performed while logged into sfdssio1 (which belongs to the Lenovo G242).<br>
Then:</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black;background:white">[root@sfdssio1 ~]# mmvdisk server list --node-class ess --disk-topology
</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black"><br>
node needs matching <br>
number server attention metric disk topology <br>
------ -------------------------------- --------- -------- ------------- <br>
3 sfessio1.psi.ch yes - unmatched server topology
<br>
4 sfessio2.psi.ch yes - unmatched server topology
<br>
<br>
mmvdisk: To see what needs attention, use the command: <br>
mmvdisk: mmvdisk server list -N sfessio1.psi.ch --disk-topology -L <br>
mmvdisk: mmvdisk server list -N sfessio2.psi.ch --disk-topology -L</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black;background:white">[root@sfdssio1 ~]# mmvdisk server list -N sfessio1.psi.ch --disk-topology -L
</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Courier New";color:black">Unable to find a matching topology specification for topology file '/var/mmfs/tmp/cmdTmpDir.mmvdisk.1468913/pdisk-topology.sfessio1.psi.ch'.
<br>
<br>
Topology component identification is using these CST stanza files: <br>
<br>
/usr/lpp/mmfs/data/compSpec-1304.stanza <br>
/usr/lpp/mmfs/data/compSpec-1400.stanza <br>
/usr/lpp/mmfs/data/cst/compSpec-Lenovo.stanza <br>
/usr/lpp/mmfs/data/cst/compSpec-topology.stanza <br>
<br>
Server component: serverType 'ESS3500-5141-FN2' serverArch 'x86_64' serverName 'sfessio1.psi.ch'
<br>
<br>
Enclosure components: 1 found connected to HBAs <br>
Enclosure component: serialNumber '78E4395' enclosureClass 'unknown' <br>
<br>
HBA components: none found connected to enclosures <br>
<br>
Cabling: enclosure '78E4395' controller '' cabled to HBA slot 'UNKNOWN' port 'unknown'
<br>
<br>
Disks: 12 SSDs 0 HDDs <br>
NVRAM: 0 devices/partitions <br>
<br>
Unable to match these components to a serverTopology specification. <br>
mmvdisk: Command failed. Examine previous error messages to determine cause.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">If I try to do a symmetric operation (I access an IO node of the IBM ESS3500 and try to add Lenovo nodes, trying to discover their drive topology) I get the same error; but, of course, the topology involved this
time is that of the Lenovo hardware.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Now, I suspect there is a (hidden?) step I would be supposed to know, but unfortunately I don't (this is my first experience with different and etherogenous building blocks merge). So I'd like to receive from you
any suggestions, including a better documentation page (if any) covering this particular use case I have.<br>
<br>
Hope the description of the context is clear enough, in case it is not I apologize and please just ask for any further details required to understand my environment.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black">Thank you very much,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:black"> Alvise Dorigo</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal">Unless otherwise stated above:<br>
<br>
IBM Svenska AB<br>
Organisationsnummer: 556026-6883<br>
Address: 164 92 Stockholm<o:p></o:p></p>
</div>
</div>
</div>
</div>
<DIV>
Unless otherwise stated above:<BR>
<BR>
IBM Svenska AB<BR>
Organisationsnummer: 556026-6883<BR>
Address: 164 92 Stockholm<BR>
</DIV></body>
</html>