Differences
This shows you the differences between two versions of the page.
Next revision | Previous revisionNext revisionBoth sides next revision | ||
s3compatibleapi [2018_01_30 17:23] – external edit 127.0.0.1 | s3compatibleapi [2018_01_30 22:35] – [7 Useful Apps] steven | ||
---|---|---|---|
Line 1: | Line 1: | ||
+ | ====== Amazon S3 compatible API ====== | ||
+ | We provide support for another API that is becoming ubiquitous. In this case it is the Amazon S3 API. This is already used in solutions such as Eucalyptus Walrus, and we have now also added it as entry point for **any files** accessed through a SMEStorage Account. This means you can use the S3 compatible API to access your files on Google Docs, or Google Storage, or RackSpace Cloud Files, or Microsoft OneDrive, or any of the many other Clouds that we support. | ||
+ | For those interested, moving from a file based structure to a flat file object structure was achieved using the [[http:// | ||
- | + | Below is a practical implementation of using the S3 API. | |
- | ====== Amazon S3 compatible API ====== | + | |
- | + | ||
- | + | ||
- | We provide support for another API that is becoming ubiquitous. In this case it is the Amazon S3 API. This is already used in solutions such as Eucalyptus Walrus, and we have now also added it as entry point for **any files** accessed through a SMEStorage Account. This means you can use the S3 compatible API to access your files on Google Docs, or Google Storage, or RackSpace Cloud Files, or Microsoft OneDrive, or any of the many other Clouds that we support.\\ \\ For those interested, moving from a file based structure to a flat file object structure was achieved using the [[http:// | + | |
===== 1 Setting up an S3 Tool to work with SMEStorage ===== | ===== 1 Setting up an S3 Tool to work with SMEStorage ===== | ||
Line 14: | Line 13: | ||
{{:/ | {{:/ | ||
- | Lets look at a practical implementation of the S3 API using a tool that supports S3 compatible endpoints, CloudBerry explorer. | + | Lets look at a practical implementation of the S3 API using a tool that supports S3 compatible endpoints, CloudBerry explorer. |
===== 2 Creating a New Account ===== | ===== 2 Creating a New Account ===== | ||
+ | {{:/ | ||
+ | Choose to add an account and fill in the endpoint as either: | ||
- | {{:/s3compatibleapi: | + | **//s3.storagemadeeasy.com// |
- | Choose to add an account and fill in the endpoint as either:\\ \\ â**// | + | and the QueryID should be set as the SME username. You can obtain the API key from logging into SME going to **//My Account//** from the sidebar and copying the API key from where it says **//API secret Key//** |
===== 3 Confirm Connection ===== | ===== 3 Confirm Connection ===== | ||
- | |||
- | |||
{{:/ | {{:/ | ||
Now you can choose to access the service using the CloudBerry explorer: | Now you can choose to access the service using the CloudBerry explorer: | ||
- | |||
===== 4 Accessing Service ===== | ===== 4 Accessing Service ===== | ||
- | |||
- | |||
{{:/ | {{:/ | ||
You can can now browse, download, upload files directly from your SME Clouds which is happening over the S3 API. | You can can now browse, download, upload files directly from your SME Clouds which is happening over the S3 API. | ||
- | |||
===== 5 Working with Clouds ===== | ===== 5 Working with Clouds ===== | ||
- | |||
- | |||
{{:/ | {{:/ | ||
This screenshot shows the root view of the Google Docs folder being access via CloudBerry using the S3 compatible API. Accessing different Clouds is just as easy as changing directories for Clouds that are mapped to an account. | This screenshot shows the root view of the Google Docs folder being access via CloudBerry using the S3 compatible API. Accessing different Clouds is just as easy as changing directories for Clouds that are mapped to an account. | ||
- | |||
===== 6 Usefulness ===== | ===== 6 Usefulness ===== | ||
- | |||
- | |||
{{:/ | {{:/ | ||
- | The S3 API can be useful in a number of scenarios. For example:\\ \\ - Building an S3 compatible Cloud but using one or more different Storage implementations to deliver it, using the SMEStorage Cloud Appliance.\\ \\ - Transitioning from existing S3 use to a different Cloud but without having to change code ie. only changing the endpoint implementation\\ \\ - Using S3 Tools and scripts to work with Clouds other than S3 | + | The S3 API can be useful in a number of scenarios. For example: |
+ | * Building an S3 compatible Cloud but using one or more different Storage implementations to deliver it, using the SMEStorage Cloud Appliance. | ||
+ | * Transitioning from existing S3 use to a different Cloud but without having to change code ie. only changing the endpoint implementation | ||
+ | * Using S3 Tools and scripts to work with Clouds other than S3 | ||
===== 7 Useful Apps ===== | ===== 7 Useful Apps ===== | ||
- | |||
- | |||
{{:/ | {{:/ | ||
- | Useful Apps for interacting with SME over the Amazon S3 API are:\\ \\ [[http:// | + | Useful Apps for interacting with SME over the Amazon S3 API are: |
+ | * [[http:// | ||
+ | * [[http:// | ||
+ | * [[http:// | ||
===== 8 Note! ===== | ===== 8 Note! ===== | ||
+ | {{:/ | ||
+ | SME S3 API does not support multi-part upload (as it makes no sense as we interacting with back end clouds that do not support it). | ||
- | {{:/s3compatibleapi: | + | Certain S3 client tools may need you to change a setting to turn off multi-part upload. |
+ | |||
+ | For example you need to do this with Cyberduck.Multipart uploads can be disabled by setting the hidden option s3.upload.multipart to false.. See https:// | ||
- | SME S3 API does not support multi-part upload (as it makes no sense as we interacting with back end clouds that do not support it). \\ \\ Certain S3 client tools may need you to change a setting to turn off multi-part upload. \\ \\ For example you need to do this with Cyberduck.Multipart uploads can be disabled by setting the hidden option s3.upload.multipart to false.. See https:// | + | SME supports the following Amazon S3 API Requests:\\ \\ |
+ | **PUT request** to create a bucket http:// | ||