<html><body>
<p><font size="2" face="sans-serif">Hi Luke,</font><br>
<font size="2" face="sans-serif">Your explanation below is correct, with some minor clarifications</font><br>
<br>
<font size="2" face="sans-serif">Manila is an OpenStack project which allows storage admins to create and destroy filesystem shares and make those available to vm instances and bare metal servers which would be accessed over NFS. The Manila driver runs in the control plane and creates a new gpfs independent fileset for each new share. It provides automation for giving vm's (and also bare metal servers) acces to the shares so that they can mount and use the share. There is work being done to allow automating the mount process when the vm instance boots.</font><br>
<br>
<font size="2" face="sans-serif">The tenants don’t have root access to the file system, but the Manila component acts as a wrapper to file system administrative equivalents like mmcrfileset, mmdelfileset, link and unlink. The shares are created as GPFS filesets which are then presented over NFS.</font><br>
<br>
<font size="2" face="sans-serif">The manila driver uses the following gpfs commands:</font><br>
<font size="2" face="sans-serif">When a share is created:</font><br>
<font size="2" face="sans-serif">mmcrfileset</font><br>
<font size="2" face="sans-serif">mmlinkfileset</font><br>
<font size="2" face="sans-serif">mmsetquota</font><br>
<br>
<font size="2" face="sans-serif">When a share is deleted:</font><br>
<font size="2" face="sans-serif">mmunlinkfileset</font><br>
<font size="2" face="sans-serif">mmdelfileset</font><br>
<br>
<font size="2" face="sans-serif">Snapshots of shares can be created and deleted:</font><br>
<font size="2" face="sans-serif">mmcrsnapshot</font><br>
<font size="2" face="sans-serif">mmdelsnapshot</font><br>
<br>
<font size="2" face="sans-serif">Today, the GPFS Manila driver supports creating NFS exports to VMs. We are considering adding native GPFS client support in the VM, but not sure if the benefit justifies the extra complexity of having gpfs client in vm image, and also the impact to cluster as vm's come up and down in a more dynamic way than physical nodes.</font><br>
<font size="2" face="sans-serif"> </font><br>
<font size="2" face="sans-serif">For multi-tenant deployments, we recommend using a different filesystem per tenant to provide better separation of data, and to minimize the "noisy neighbor" effect for operations like mmunlinkfileset.</font><br>
<br>
<font size="2" face="sans-serif">Here is a presentation that shows an overview of the GPFS Manila driver:</font><br>
<i>(See attached file: OpenStack_Storage_Manila_with_GPFS.pdf)</i><br>
<br>
<font size="2" face="sans-serif">Perhaps this, and other GPFS & OpenStack topics could be the subject of a future user group session.</font><br>
<font size="2" face="sans-serif"><br>
Regards,<br>
Bill Owen <br>
billowen@us.ibm.com<br>
GPFS and OpenStack<br>
520-799-4829<br>
</font><br>
<br>
<img width="16" height="16" src="cid:2__=08BBF4FBDF8607328f9e8a93df938@us.ibm.com" border="0" alt="Inactive hide details for Luke Raimbach ---06/16/2015 12:37:09 AM---So as I understand things, Manila is an OpenStack component"><font size="2" color="#424282" face="sans-serif">Luke Raimbach ---06/16/2015 12:37:09 AM---So as I understand things, Manila is an OpenStack component which allows tenants to create and destr</font><br>
<br>
<font size="1" color="#5F5F5F" face="sans-serif">From: </font><font size="1" face="sans-serif">Luke Raimbach <Luke.Raimbach@crick.ac.uk></font><br>
<font size="1" color="#5F5F5F" face="sans-serif">To: </font><font size="1" face="sans-serif">gpfsug main discussion list <gpfsug-discuss@gpfsug.org></font><br>
<font size="1" color="#5F5F5F" face="sans-serif">Date: </font><font size="1" face="sans-serif">06/16/2015 12:37 AM</font><br>
<font size="1" color="#5F5F5F" face="sans-serif">Subject: </font><font size="1" face="sans-serif">Re: [gpfsug-discuss] OpenStack Manila Driver</font><br>
<font size="1" color="#5F5F5F" face="sans-serif">Sent by: </font><font size="1" face="sans-serif">gpfsug-discuss-bounces@gpfsug.org</font><br>
<hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br>
<br>
<br>
<font size="2" color="#1F497D" face="Calibri">So as I understand things, Manila is an OpenStack component which allows tenants to create and destroy shares for their instances which would be accessed over NFS. Perhaps I’ve not done enough research in to this though – I’m also not an OpenStack expert.</font><br>
<font size="2" color="#1F497D" face="Calibri"> </font><br>
<font size="2" color="#1F497D" face="Calibri">The tenants don’t have root access to the file system, but the Manila component must act as a wrapper to file system administrative equivalents like mmcrfileset, mmdelfileset, link and unlink. The shares are created as GPFS filesets which are then presented over NFS.</font><br>
<font size="2" color="#1F497D" face="Calibri"> </font><br>
<font size="2" color="#1F497D" face="Calibri">The unlinking of the fileset worries me for the reasons stated previously.</font><br>
<a name="_MailEndCompose"></a><font size="2" color="#1F497D" face="Calibri"> </font><br>
<font size="2" face="Calibri"><b>From:</b></font><font size="2" face="Calibri"> gpfsug-discuss-bounces@gpfsug.org [</font><font size="2" face="Calibri"><a href="mailto:gpfsug-discuss-bounces@gpfsug.org">mailto:gpfsug-discuss-bounces@gpfsug.org</a></font><font size="2" face="Calibri">] </font><font size="2" face="Calibri"><b>On Behalf Of </b></font><font size="2" face="Calibri">Wahl, Edward</font><font size="2" face="Calibri"><b><br>
Sent:</b></font><font size="2" face="Calibri"> 15 June 2015 15:00</font><font size="2" face="Calibri"><b><br>
To:</b></font><font size="2" face="Calibri"> gpfsug main discussion list</font><font size="2" face="Calibri"><b><br>
Subject:</b></font><font size="2" face="Calibri"> Re: [gpfsug-discuss] OpenStack Manila Driver</font><br>
<font size="2" face="Calibri"> </font><br>
<font size="2" face="Tahoma">Perhaps I misunderstand here, but if the tenants have administrative (ie:root) privileges to the underlying file system management commands I think mmunlinkfileset might be a minor concern here. There are FAR more destructive things that could occur. <br>
<br>
I am not an OpenStack expert and I've not even looked at anything past Kilo, but my understanding was that these commands were not necessary for tenants. They access a virtual block device that backs to GPFS, correct? <br>
<br>
Ed Wahl<br>
OSC</font><div align="center"><hr width="100%" size="3" align="center"></div><font size="2" face="Tahoma"><b><br>
<br>
++<br>
From:</b></font><font size="2" face="Tahoma"> </font><a href="mailto:gpfsug-discuss-bounces@gpfsug.org"><font size="2" color="#0563C1" face="Tahoma"><u>gpfsug-discuss-bounces@gpfsug.org</u></font></a><font size="2" face="Tahoma"> [gpfsug-discuss-bounces@gpfsug.org] on behalf of Luke Raimbach [Luke.Raimbach@crick.ac.uk]</font><font size="2" face="Tahoma"><b><br>
Sent:</b></font><font size="2" face="Tahoma"> Monday, June 15, 2015 4:35 AM</font><font size="2" face="Tahoma"><b><br>
To:</b></font><font size="2" face="Tahoma"> </font><a href="mailto:gpfsug-discuss@gpfsug.org"><font size="2" color="#0563C1" face="Tahoma"><u>gpfsug-discuss@gpfsug.org</u></font></a><font size="2" face="Tahoma"><b><br>
Subject:</b></font><font size="2" face="Tahoma"> [gpfsug-discuss] OpenStack Manila Driver</font><br>
<font size="1" color="#222222" face="Helvetica">Dear All,</font><br>
<font size="1" color="#222222" face="Helvetica"> </font><br>
<font size="1" color="#222222" face="Helvetica">We are looking forward to using the manila driver for auto-provisioning of file shares using GPFS. However, I have some concerns...</font><br>
<font size="1" color="#222222" face="Helvetica"> </font><br>
<font size="1" color="#222222" face="Helvetica">Manila presumably gives tenant users access to file system commands like mmlinkfileset and mmunlinkfileset. Given that mmunlinkfileset quiesces the file system, there is potentially an impact from one tenant on another - i.e. someone unlinking and deleting a lot of filesets during a tenancy cleanup might cause a cluster pause long enough to trigger other failure events or even start evicting nodes. You can see why this would be bad in a cloud environment.</font><br>
<font size="1" color="#222222" face="Helvetica"> </font><br>
<font size="3" face="Times New Roman"> </font><br>
<font size="1" color="#222222" face="Helvetica">Has this scenario been addressed at all?</font><br>
<font size="1" color="#222222" face="Helvetica"> </font><br>
<font size="1" color="#222222" face="Helvetica">Cheers,</font><br>
<font size="1" color="#222222" face="Helvetica">Luke.</font><br>
<font size="2" face="Calibri"> </font><br>
<font size="2" face="Calibri"> </font><br>
<font size="2" color="#595959" face="Trebuchet MS"><b>Luke Raimbach</b></font><font size="2" color="#595959" face="Arial"><b></b></font><br>
<font size="2" color="#595959" face="Trebuchet MS">Senior HPC Data and Storage Systems Engineer</font><br>
<font size="2" color="#595959" face="Trebuchet MS">The Francis Crick Institute</font><br>
<font size="2" color="#595959" face="Trebuchet MS">Gibbs Building</font><br>
<font size="2" color="#595959" face="Trebuchet MS">215 Euston Road</font><br>
<font size="2" color="#595959" face="Trebuchet MS">London NW1 2BE</font><br>
<font size="2" color="#595959" face="Trebuchet MS"> </font><br>
<font size="2" color="#595959" face="Trebuchet MS">E: </font><a href="mailto:luke.raimbach@crick.ac.uk" target="_blank"><font size="2" color="#0000FF" face="Trebuchet MS"><u>luke.raimbach@crick.ac.uk</u></font></a><br>
<font size="2" color="#595959" face="Trebuchet MS">W: </font><a href="http://www.crick.ac.uk/" target="_blank"><font size="2" color="#0000FF" face="Trebuchet MS"><u>www.crick.ac.uk</u></font></a><br>
<font size="2" face="Calibri"> </font><br>
<font size="2" color="#707173" face="Trebuchet MS"><i>The Francis Crick Institute Limited is a registered charity in England and Wales no. 1140062 and a company registered in England and Wales no. 06885462, with its registered office at 215 Euston Road, London NW1 2BE. </i></font><br>
<font size="2" color="#707173" face="Trebuchet MS"><i>The Francis Crick Institute Limited is a registered charity in England and Wales no. 1140062 and a company registered in England and Wales no. 06885462, with its registered office at 215 Euston Road, London NW1 2BE. </i></font><tt><font size="2">_______________________________________________<br>
gpfsug-discuss mailing list<br>
gpfsug-discuss at gpfsug.org<br>
</font></tt><tt><font size="2"><a href="http://gpfsug.org/mailman/listinfo/gpfsug-discuss">http://gpfsug.org/mailman/listinfo/gpfsug-discuss</a></font></tt><tt><font size="2"><br>
</font></tt><br>
</body></html>