[gpfsug-discuss] Spectrum Scale - Spectrum Protect - SpaceManagement (GPFS HSM)
IBM Spectrum Scale
scale at us.ibm.com
Tue Jun 6 19:05:15 BST 2017
Hi,
Just as Jaime has explained, any GPFS node in the cluster, can induce a
recall (as he called "staged") by access to file data. It is not
optimized by tape order, and a dynamic file access of any pattern, such as
"find" or "cat *" will surely result in an inefficient processing of the
data recall if all data lives in physical tape. But if migrated data
lives on spinning disk on the TSM server, there is no harm in such a
recall pattern because recalls from a disk pool incur no significant
overhead or delay for tape loading and positioning.
Unprivileged users may not run "dsmcrecall" because creating a DMAPI
session as the dsmrecall program must do, requires admin user privilege on
that node. You may be able to wrap dsmrecall in a set-uid wrapper if you
want to permit users to run that, but of course that comes with the danger
that a recall storm could monopolize resources on your cluster.
Regards, The Spectrum Scale (GPFS) team
------------------------------------------------------------------------------------------------------------------
If you feel that your question can benefit other users of Spectrum Scale
(GPFS), then please post it to the public IBM developerWroks Forum at
https://www.ibm.com/developerworks/community/forums/html/forum?id=11111111-0000-0000-0000-000000000479
.
If your query concerns a potential software error in Spectrum Scale (GPFS)
and you have an IBM software maintenance contract please contact
1-800-237-5511 in the United States or your local IBM Service Center in
other countries.
The forum is informally monitored as time permits and should not be used
for priority messages to the Spectrum Scale (GPFS) team.
From: "Jaime Pinto" <pinto at scinet.utoronto.ca>
To: "Andrew Beattie" <abeattie at au1.ibm.com>
Cc: gpfsug-discuss at spectrumscale.org
Date: 06/02/2017 11:13 AM
Subject: Re: [gpfsug-discuss] Spectrum Scale - Spectrum Protect -
SpaceManagement (GPFS HSM)
Sent by: gpfsug-discuss-bounces at spectrumscale.org
It has been a while since I used HSM with GPFS via TSM, but as far as
I can remember, unprivileged users can run dsmmigrate and dsmrecall.
Based on the instructions on the link, dsmrecall may now leverage the
Recommended Access Order (RAO) available on enterprise drives, however
root would have to be the one to invoke that feature.
In that case we may have to develop a middleware/wrapper for dsmrecall
that will run as root and act on behalf of the user when optimization
is requested.
Someone here more familiar with the latest version of TSM-HSM may be
able to give us some hints on how people are doing this in practice.
Jaime
Quoting "Andrew Beattie" <abeattie at au1.ibm.com>:
> Thanks Jaime, How do you get around Optimised recalls? from what I
> can see the optimised recall process needs a root level account to
> retrieve a list of files
>
https://www.ibm.com/support/knowledgecenter/SSSR2R_7.1.1/com.ibm.itsm.hsmul.doc/c_recall_optimized_tape.html
[1]
> Regards, Andrew Beattie Software Defined Storage - IT Specialist
> Phone: 614-2133-7927 E-mail: abeattie at au1.ibm.com[2] -----
> Original message -----
> From: "Jaime Pinto" <pinto at scinet.utoronto.ca>
> To: "gpfsug main discussion list" <gpfsug-discuss at spectrumscale.org>,
> "Andrew Beattie" <abeattie at au1.ibm.com>
> Cc: gpfsug-discuss at spectrumscale.org
> Subject: Re: [gpfsug-discuss] Spectrum Scale - Spectrum Protect -
> Space Management (GPFS HSM)
> Date: Fri, Jun 2, 2017 7:28 PM
> We have that situation.
> Users don't need to login to NSD's
>
> What you need is to add at least one gpfs client to the cluster (or
> multi-cluster), mount the DMAPI enabled file system, and use that
> node
> as a gateway for end-users. They can access the contents on the mount
>
> point with their own underprivileged accounts.
>
> Whether or not on a schedule, the moment an application or linux
> command (such as cp, cat, vi, etc) accesses a stub, the file will be
>
> staged.
>
> Jaime
>
> Quoting "Andrew Beattie" <abeattie at au1.ibm.com>:
>
>> Quick question, Does anyone have a Scale / GPFS environment (HPC)
>> where users need the ability to recall data sets after they have
> been
>> stubbed, but only System Administrators are permitted to log onto
> the
>> NSD servers for security purposes. And if so how do you provide
> the
>> ability for the users to schedule their data set recalls?
> Regards,
>> Andrew Beattie Software Defined Storage - IT Specialist Phone:
>> 614-2133-7927 E-mail: abeattie at au1.ibm.com[1]
>>
>>
>> Links:
>> ------
>> [1] mailto:abeattie at au1.ibm.com[3]
>>
>
> ************************************
> TELL US ABOUT YOUR SUCCESS STORIES
> http://www.scinethpc.ca/testimonials[4]
> ************************************
> ---
> Jaime Pinto
> SciNet HPC Consortium - Compute/Calcul Canada
> www.scinet.utoronto.ca - www.computecanada.ca
> University of Toronto
> 661 University Ave. (MaRS), Suite 1140
> Toronto, ON, M5G1M1
> P: 416-978-2755
> C: 416-505-1477
>
----------------------------------------------------------------
This message was sent using IMP at SciNet Consortium, University of
Toronto.
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20170606/455b31dc/attachment-0002.htm>
More information about the gpfsug-discuss
mailing list