[gpfsug-discuss] Intro, and Spectrum Archive self-service recall interface question

[RICHARD RUPP]

I've heard that this works, but I have not tried it myself -
https://support.apple.com/en-us/HT208209

Regards,

Richard Rupp, Sales Specialist, Phone: 1-347-510-6746




From:	"Frederick Stock" <stockf at us.ibm.com>
To:	gpfsug-discuss at spectrumscale.org
Cc:	gpfsug-discuss at spectrumscale.org
Date:	05/20/2019 04:41 PM
Subject:	[EXTERNAL] Re: [gpfsug-discuss] Intro,	and Spectrum Archive
            self-service recall interface question
Sent by:	gpfsug-discuss-bounces at spectrumscale.org



Todd I am not aware of any tool that provides the out of band recall that
you propose, though it would be quite useful.  However, I wanted to note
that as I understand the reason the the Mac client initiates the file
recalls is because the Mac SMB client ignores the archive bit, indicating a
file does not reside in online storage, in the SMB protocol.  To date
efforts to have Apple change their SMB client to respect the archive bit
have not been successful but if you feel so inclined we would be grateful
if you would submit a request to Apple for them to change their SMB client
to honor the archive bit and thus avoid file recalls.

Fred
__________________________________________________
Fred Stock | IBM Pittsburgh Lab | 720-430-8821
stockf at us.ibm.com


 ----- Original message -----
 From: Todd Ruston <truston at mbari.org>
 Sent by: gpfsug-discuss-bounces at spectrumscale.org
 To: gpfsug-discuss at spectrumscale.org
 Cc:
 Subject: [EXTERNAL] [gpfsug-discuss] Intro, and Spectrum Archive
 self-service recall interface question
 Date: Mon, May 20, 2019 4:12 PM

 Greetings all,

 First post here, so by way of introduction we are a fairly new Spectrum
 Scale and Archive customer (installed last year and live in production Q1
 this year). We have a four node (plus EMS) ESS system with ~520TB of mixed
 spinning disk and SSD. Client access to the system is via CES (NFS and
 SMB, running on two protocol nodes), integrated with Active Directory, for
 a mixed population of Windows, Mac, and Linux clients. A separate pair of
 nodes run Spectrum Archive, with a TS4500 LTO-8 library behind them.

 We use the system for general institute data, with the largest data types
 being HD video, multibeam sonar, and hydrophone data. Video is the
 currently active data type in production; we will be migrating the rest
 over time. So far things are running pretty well.

 Our archive approach is to premigrate data, particularly the large,
 unchanging data like the above mentioned data types, almost immediately
 upon landing in the system. Then we migrate those that have not been
 accessed in a period of time (or manually if space demands require it). We
 do wish to allow users to recall archived data on demand as needed.

 Because we have a large contingent of Mac clients (accessing the system
 via SMB), one issue we want to get ahead of is inadvertent recalls
 triggered by Mac preview generation, Quick Look, Cover Flow/Gallery view,
 and the like. Going in we knew this was going to be something we'd need to
 address, and we anticipated being able to configure Finder to disable
 preview generation and train users to avoid Quick Look unless they
 intended to trigger a recall. In our testing however, even with those
 features disabled/avoided, we have seen Mac clients trigger inadvertent
 recalls just from CLI 'ls -lshrt' interactions with the system.

 While brainstorming ways to prevent these inadvertent recalls while still
 allowing users to initiate recalls on their own when needed, one thought
 that came to us is we might be able to turn off recalls via SMB
 (setgpfs:recalls = no via mmsmb), and create a simple self-service web
 portal that would allow users to browse the Scale file system with a web
 browser, select files for recall, and initiate the recall from there. The
 web interface could run on one of the Archive nodes, and the back end of
 it would simply send a list of selected file paths to ltfsee recall.

 Before possibly reinventing the wheel, I thought I'd check to see if
 something like this may already exist, either from IBM, the Scale user
 community, or a third-party/open source tool that could be leveraged for
 the purpose. I searched the list archive and didn't find anything, but
 please let me know if I missed something. And please let me know if you
 know of something that would fit this need, or other ideas as well.

 Cheers,

 --
 Todd E. Ruston
 Information Systems Manager
 Monterey Bay Aquarium Research Institute (MBARI)
 7700 Sandholdt Road, Moss Landing, CA, 95039
 Phone 831-775-1997      Fax 831-775-1652      http://www.mbari.org

 _______________________________________________
 gpfsug-discuss mailing list
 gpfsug-discuss at spectrumscale.org
 http://gpfsug.org/mailman/listinfo/gpfsug-discuss



_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__gpfsug.org_mailman_listinfo_gpfsug-2Ddiscuss&d=DwICAg&c=jf_iaSHvJObTbx-siA1ZOg&r=EXL-jEd1jmdzvOIhT87C7SIqmAS9uhVQ6J3kObct4OY&m=xkYegIiDkaPYiV4_T1Zd0mLhj-2r34rhi8EbFYw_ei8&s=bOxknFCPDWKJdnKbMs-BIU7zXcb0tsLSRw7YDzmRlgA&e=



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20190520/e45e78f1/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20190520/e45e78f1/attachment-0002.gif>