[gpfsug-discuss] Self service creation of filesets

[Kerner, Chad A]

We have a similar process. One of our customers has a web app that their managers use to provision spaces. That web app drops a json file into a specific location and a cron job kicks off a python script every so often to process the files and provision the space(fileset creation, link, quota, owner, group, perms, etc). Failures are queued and a jira ticket opened. Successes update the database for the web app. They are not requiring instant processing, so we process hourly on the back end side of things.

Chad
--
Chad Kerner, Senior Storage Engineer
Storage Enabling Technologies
National Center for Supercomputing Applications
University of Illinois, Urbana-Champaign

On 3/2/21, 4:38 PM, "gpfsug-discuss-bounces at spectrumscale.org on behalf of Simon Thompson" <gpfsug-discuss-bounces at spectrumscale.org on behalf of S.J.Thompson at bham.ac.uk> wrote:

    Not quite user self-service ....
    
    But we have some web tooling for project registration that pushes sanitised messages onto a redis (rq) backed message bus which then does "stuff". For example create and populate groups in AD and LDAP. Create and link a fileset, set quota etc ... Our consumer code is all built to be tolerant to running it a second time safely and has quite a bit of internal locking to prevent multiple instances running at the same time (though we have multiple consumer entities to handle fail-over). The fault tolerant thing is quite important as create a fileset can fail for a number of reasons (e.g. restripefs running), so we can always just requeue the requests again.
    
    Simon
    
    On 02/03/2021, 19:40, "gpfsug-discuss-bounces at spectrumscale.org on behalf of russell at nordquist.info" <gpfsug-discuss-bounces at spectrumscale.org on behalf of russell at nordquist.info> wrote:
    
        Hi all
    
        We are trying to use filesets quite a bit, but it’s a hassle that only the admins can create them. To the users it’s just a directory so it slows things down. Has anyone deployed a self service model for creating filesets? Maybe using the API? This feels like shared pain that someone has already worked on….
    
        thanks
        Russell
    
    
        _______________________________________________
        gpfsug-discuss mailing list
        gpfsug-discuss at spectrumscale.org
        https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!DZ3fjg!uQVokpQk0pPyjpae7a_Aui1wGk3k7xJzIxzX1DBNfOyNOfzZeJFUjVOqN3OVEyVqdw$ 
    
    _______________________________________________
    gpfsug-discuss mailing list
    gpfsug-discuss at spectrumscale.org
    https://urldefense.com/v3/__http://gpfsug.org/mailman/listinfo/gpfsug-discuss__;!!DZ3fjg!uQVokpQk0pPyjpae7a_Aui1wGk3k7xJzIxzX1DBNfOyNOfzZeJFUjVOqN3OVEyVqdw$