<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle19
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Sorry a bit behind the discussion…<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">We were using GPFS’s internal TBD2 method for UID and GID assignment (15 years ago GPFS was purchased for a single purpose with a handful of accounts)<br>
I have just been through 88 million files ADDING NFSv4 ACEs with UIDs and GIDs derived from AD RIDs. We have both the TBD2 and AD RID ACEs in the ACLs.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">This allowed us to do a single switch over between the authentication methods for all the data at once. The testing and prep work took months though.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">We have Spectrum protect and SP Space management with a tape library in the mix, so I needed to make sure ACL changes didn’t cause a backup and recall then backup for migrated files.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">My scripts made use of mmgetacl and mmputacl.
<br>
I had less than 50 unique ACEs to construct and I created a spreadsheet that auto created the commands. This could have been automated, but for that number it was just as quick for me to do by hand than learn to program it.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">I wrote my own scripts, with a lot of safety checks, as it went AWOL at one point and started changing permissions at the root for the GPFS file system, removing access for everyone.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">We had a mix of posix only and nfsv4 ACLs. Testing them revealed a lot of skeletons in the way some systems had been set up – allow a lot of time for unknowns if you have systems using GPFS as a
back end. <o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Some way into it to this, I discovered IBM have created code to do this – I didn’t keep the link as it was too late for me.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">The switch over went seamlessly btw, it had to with all the prep work!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Kindest regards,<o:p></o:p></p>
<p class="MsoNormal">Paul<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Paul Ward<o:p></o:p></p>
<p class="MsoNormal">TS Infrastructure Architect<o:p></o:p></p>
<p class="MsoNormal">Natural History Museum<o:p></o:p></p>
<p class="MsoNormal">T: 02079426450<o:p></o:p></p>
<p class="MsoNormal">E: <a href="mailto:p.ward@nhm.ac.uk"><span style="color:#0563C1">p.ward@nhm.ac.uk</span></a><o:p></o:p></p>
<p class="MsoNormal"><img border="0" width="197" height="107" style="width:2.05in;height:1.1166in" id="Picture_x0020_4" src="cid:image001.jpg@01D64FFD.68496910" alt="A picture containing drawing
Description automatically generated"><o:p></o:p></p>
</div>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> gpfsug-discuss-bounces@spectrumscale.org <gpfsug-discuss-bounces@spectrumscale.org>
<b>On Behalf Of </b>Lohit Valleru<br>
<b>Sent:</b> 08 June 2020 18:44<br>
<b>To:</b> gpfsug main discussion list <gpfsug-discuss@spectrumscale.org><br>
<b>Subject:</b> [gpfsug-discuss] Change uidNumber and gidNumber for billions of files<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif">Hello Everyone,<o:p></o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif">We are planning to migrate from LDAP to AD, and one of the best solution was to change the uidNumber and gidNumber to what SSSD or Centrify would resolve.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif">May I know, if anyone has come across a tool/tools that can change the uidNumbers and gidNumbers of billions of files efficiently and in a reliable manner?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif">We could spend some time to write a custom script, but wanted to know if a tool already exists.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif">Please do let me know, if any one else has come across a similar situation, and the steps/tools used to resolve the same.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif">Regards,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Helvetica",sans-serif">Lohit<o:p></o:p></span></p>
</div>
</div>
</div>
</body>
</html>