[gpfsug-discuss] Alternative to Scale S3 API.

[Nishaan Docrat]

Hi Andi

The current S3 compatibility in Spectrum Scale is delivered via the Swift3
middleware. This middleware has since been replaced by s3api in later
versions of Swift. Spectrum Scale 5.1 will make use of Swift Train release
which will include the new s3api middleware.

I've tested the S3 compatibility with a few applications including Spectrum
Scale itself (i.e. Cloud Data Sharing to another Scale Object store using
S3 API) and Spectrum Protect etc. and haven't had any issue. I've also ran
a few application tools to test for an S3 compliant object stores and again
had no issues.

You can use s3compat to test the current compatibility.. Or you can check
here for the current compatibility..
https://docs.openstack.org/swift/latest/s3_compat.html

Not sure if there is any other way to talk HTTPS without using HAProxy.

In any case, I've documented the process to setup an S3 compliant object
store including supporting virtual-hosted style bucket addressing which you
can find here..

https://www.linkedin.com/feed/update/urn:li:activity:6720227398756909056/

Most storage vendors including minio would not support the full S3 API
stack as alot of the calls are specific to AWS (like billing stuff etc.).

Anyway, good luck with your testing.

Kind Regards

Nishaan Docrat
Client Technical Specialist - Storage Systems
IBM Systems Hardware

Work: +27 (0)11 302 5001
Mobile: +27 (0)81 040 3793
Email: nishaan at za.ibm.com









From:	Andi Christiansen <andi at christiansen.xxx>
To:	"gpfsug-discuss at spectrumscale.org"
            <gpfsug-discuss at spectrumscale.org>
Date:	2020/10/27 13:59
Subject:	[EXTERNAL] [gpfsug-discuss] Alternative to Scale S3 API.
Sent by:	gpfsug-discuss-bounces at spectrumscale.org



Hi all,



We have over a longer period used the S3 API within spectrum Scale.. And
that has shown that it does not support very many applications because of
limitations of the API..



Has anyone got any experience with any other product we can deploy on-top
of Spectrum Scale that will give us a true S3 API with full functionalities
and able to answer on port 443? As of now we use HAProxy to forware ssl
request back and forth from Scale S3 API.



We have looked at MinIO which seems to be fairly simple and maybe might
solve a lot of incompatibilities with clients software. But the product
seems to be very badly documented at least for me.

The idea is basically that a client uses their backup application(rubrik,
veeam etc.) to connect to a domain(for example backup.mycompany.com) with
their access and secret key and have access to their bucket only. and it
must be over https/ssl.



If someone has any knowledge to minio or any other product that might solve
our problem I will be glad to hear from you! 😊

Thank you in advance!
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20201027/70cc1bc2/attachment-0002.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 52733301.jpg
Type: image/jpeg
Size: 35643 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20201027/70cc1bc2/attachment-0002.jpg>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <http://gpfsug.org/pipermail/gpfsug-discuss_gpfsug.org/attachments/20201027/70cc1bc2/attachment-0002.gif>