Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
Last revisionBoth sides next revision
cloudproviders/s3compatible [2020_03_23 17:25] – [S3 Compatible APIs] stevencloudproviders:s3compatible [2024_01_12 18:55] – steven
Line 1: Line 1:
 # Adding an S3 Compatible Cloud Provider # Adding an S3 Compatible Cloud Provider
-##### Last updated on March 20, 2020.+##### Last updated on Oct 24, 2023
  
-Storage Made Easy is able to connect to many on-premise and cloud object storage providers through our Open S3 connector. The connector supports all advanced functionality including real-time synchronization, trash, locking, and [[mstream]].+The File Fabric is able to connect to many on-premises and cloud object storage providers through the Open S3 connector. The connector supports all advanced functionality including real-time synchronization, trash, locking, and [[:mstream]].
  
 You can then easily manage and access object storage through the File Fabric desktop and mobile clients. You can then easily manage and access object storage through the File Fabric desktop and mobile clients.
Line 8: Line 8:
 ## Choosing the Open S3 Provider ## Choosing the Open S3 Provider
  
-{{ :cloudproviders:s3compatible:steps:sme_1_step_1_choosing_the.png?600 |}}+{{ :cloudproviders:s3compatible:steps:sme_1_step_1_choosing_the.png?400 |}}
  
-The first step is to choose to add the Open S3 provider to your SME Account either as a first step on activation or later from the **Dashboard** which is accessible from the top menu.+The first step is to choose to add the Open S3 provider to the File Fabric either as a first step on activation or later from the **Dashboard** which is accessible from the top menu.
  
  
Line 22: Line 22:
 ## Choosing Buckets ## Choosing Buckets
  
-{{ :cloudproviders:s3compatible:choose_buckets.png?nolink&600 |}}+{{ :cloudproviders:s3compatible:choose_buckets.png?nolink&400 |}}
  
 After you enter your authentication details and these are accepted the File Fabric will list any buckets that are available. You then choose which buckets you wish to manage through the File Fabric platform, and which will be the default bucket%%**%%. As part of this process you can choose to create a new default bucket if you wish. After you enter your authentication details and these are accepted the File Fabric will list any buckets that are available. You then choose which buckets you wish to manage through the File Fabric platform, and which will be the default bucket%%**%%. As part of this process you can choose to create a new default bucket if you wish.
Line 30: Line 30:
 Once buckets have been selected the File Fabric creates a background task to index all the metadata, or if you have selected it, the content for indexing. This may take several minutes, or longer if you have millions of files. Once buckets have been selected the File Fabric creates a background task to index all the metadata, or if you have selected it, the content for indexing. This may take several minutes, or longer if you have millions of files.
  
-%%**%% The default bucket is used for interactions with [[http://storagemadeeasy.com/wiki/top5things/#step2|Smart folders]].+%%**%% The default bucket is used for interactions with Smart folders.
  
  
Line 39: Line 39:
 ### Provider Options ### Provider Options
  
-* **Cloud Refresh Mode** - Determines whether folders are refreshed on demand using real-time refresh. Use this option when objects may be changed outside of the File Fabric. +* **Cloud Refresh Mode** - Determines whether folders are refreshed on demand using real-time refresh. Use this option when objects may be changed outside of the File Fabric (ie. the storage is being used in a bi-modal fashion). 
  
 * **Use Server Side Encryption for Upload** - Enables SSE if supported by the provider. * **Use Server Side Encryption for Upload** - Enables SSE if supported by the provider.
Line 51: Line 51:
 * **API Signature Version** - Choose Version 2 or Version 4. * **API Signature Version** - Choose Version 2 or Version 4.
  
-* **Allow direct upload in client apps** - Allows clients to upload to the storage  provider using pre-signed URLs. The provider endpoint must be accessible by the client device.+* **Allow direct upload in client apps** - Allows clients to upload to the storage provider using pre-signed URLs. The provider endpoint must be accessible by the client device.
  
 * **Support Trash** - Older versions of files that are deleted (or updated depending on policy) are moved to trash rather than being deleted. * **Support Trash** - Older versions of files that are deleted (or updated depending on policy) are moved to trash rather than being deleted.
Line 57: Line 57:
 ### Synchronisation ### Synchronisation
  
-Choose **Synchronize files** to refresh File Fabric metadata after changes have been made to the storage outside of File Fabric.+Choose **Synchronize files** to refresh File Fabric metadata after changes have been made to the storage outside of the File Fabric.
  
  
Line 64: Line 64:
 S3 Compatible Clouds that are known to work with the Open S3 provider include: S3 Compatible Clouds that are known to work with the Open S3 provider include:
  
- * [[http://open.eucalyptus.com/wiki/EucalyptusStorage_v1.4|Eucalyptus Walrus]] + * [[:cloudproviders/backblaze]] - Backblaze Provider also available 
- * [[http://cloud.google.com/products/cloud-storage.html|Google Storage]] + * [[https://www.cloudian.com|HyperStore Object Storage]] - Cloudian Provider also available 
- * OpenStack Swift + * [[https://www.constant.com/cloud/storage/|Constant Cloud Storage]]
- * [[http://cloud.nifty.com/storage/|Nifty Cloud Storage]]+
  * [[https://www.mh.connectria.com/rp/order/cloud_storage_index|Connectria]]  * [[https://www.mh.connectria.com/rp/order/cloud_storage_index|Connectria]]
- * [[http://www.constant.com/cloud/storage/|Constant Cloud Storage]] + * [[https://dunkel.de/s3/|Dunkel Storage]] 
- * [[http://business.tiscali.it/cloud/prodotti/storage|Tiscali Storage Cloud]]+ * [[https://www.exoscale.com/object-storage/|Exoscale Object Storage]] 
 + * [[http://open.eucalyptus.com/wiki/EucalyptusStorage_v1.4|Eucalyptus Walrus]] 
 + * [[http://cloud.google.com/products/cloud-storage.html|Google Storage]] - Google Storage Provider also available
  * [[http://greenqloud.com|GreenQloud]]  * [[http://greenqloud.com|GreenQloud]]
- * [[http://www.seeweb.it/|SeeWeb Storage Cloud]] + * [[https://www.hosteurope.de/produkte/Cloud-Storage|HostEurope]]
- * [[http://basho.com/products/riakcs/|Riakcs]] +
- * [[http://www.cloudian.com/cloud-storage-products/cloud-storage-overview.html|Cloudian]]+
  * [[https://www.lunacloud.com/en/cloud-storage|LunaCloud]]  * [[https://www.lunacloud.com/en/cloud-storage|LunaCloud]]
- * [[http://www.hosteurope.de/produkte/Cloud-Storage|HostEurope]] + * [[https://storagemadeeasy.com/lyvecloud/|Lyve Cloud]] 
- * [[http://dunkel.de/s3/|Dunkel Storage]]+ * [[https://www.netapp.com/data-storage/storagegrid/|NetApp StorageGRID]] - requires File Fabric 2006.03 
 + * [[https://cloud.nifty.com/storage/|Nifty Cloud Storage]] 
 + * [[https://object-matrix.com/|Object Matrix]] 
 + * OpenStack Swift 
 + * [[https://cloud.telekom.de/en|Open Telekom Cloud Storage]] 
 + * [[http://basho.com/products/riakcs/|Riakcs]] 
 + * [[https://www.rstor.io/products/space/|RSTOR Space]] 
 + * [[https://www.seeweb.it/|SeeWeb Storage Cloud]] 
 + * [[https://business.tiscali.it/cloud/prodotti/storage|Tiscali Storage Cloud]] 
 + * [[https://wasabi-support.zendesk.com/hc/en-us/articles/115002351372-How-do-I-use-Storage-Made-Easy-with-Wasabi-|Wasabi]] 
 + * [[https://www.zadara.com/|Zadara Storage]]
  
 Once Clouds are added they can be used with the web file manager and also the [[https://storagemadeeasy.com/LinuxDrive/|Linux]], [[https://storagemadeeasy.com/MacCloudTools/|Mac]], [[https://storagemadeeasy.com/WindowsPhone/|Windows]], [[https://storagemadeeasy.com/iphone|iOS]], [[https://storagemadeeasy.com/Android|Android]], [[https://storagemadeeasy.com/WindowsPhone|Windows Phone]], and [[https://storagemadeeasy.com/BlackBerry|BlackBerry]] Apps. Once Clouds are added they can be used with the web file manager and also the [[https://storagemadeeasy.com/LinuxDrive/|Linux]], [[https://storagemadeeasy.com/MacCloudTools/|Mac]], [[https://storagemadeeasy.com/WindowsPhone/|Windows]], [[https://storagemadeeasy.com/iphone|iOS]], [[https://storagemadeeasy.com/Android|Android]], [[https://storagemadeeasy.com/WindowsPhone|Windows Phone]], and [[https://storagemadeeasy.com/BlackBerry|BlackBerry]] Apps.
  
-Storage Made Easy also provides an S3 compatible interface that provides S3 access to any mapped clouds even if they do not support the S3 API directly. If you arrived at this page looking for this, please see [[s3compatibleapi|this Wiki page]]. 
  
 ## Provider Requirements ## Provider Requirements
Line 87: Line 95:
 ### Restrictions ### Restrictions
  
-The Open S3 provider doesn't impose limits such as bucket naming, number of buckets, object size, number of parts (for multi-part upload) and length of object keys except where the S3 API is also limited.+The Open S3 provider doesn't impose restrictions of limits on bucket naming, number of buckets, object size, number of parts (for multi-part upload) and length of object keys except where the S3 API is also restricted.
  
 If the provider restricts an operation, and an error is returned to the File Fabric, an error will be returned to the client application. If the provider restricts an operation, and an error is returned to the File Fabric, an error will be returned to the client application.
Line 102: Line 110:
  * HeadObject  * HeadObject
  * PutObject  * PutObject
 + * Presign
  * GetObject (including range reads)  * GetObject (including range reads)
  * CopyObject (including x-amz-copy-source)  * CopyObject (including x-amz-copy-source)
  * DeleteObject  * DeleteObject
- * CreateMultipartUpload + * CreateMultipartUpload * 
- * CompleteMultipartUpload + * CompleteMultipartUpload * 
- * AbortMultipartUpload + * AbortMultipartUpload * 
- * UploadPart + * UploadPart * 
- * UploadPartCopy+ * UploadPartCopy *
  
-If MPU is not supported by the provider the connector will failover to non-MPU APIs.+Note: * If MPU is not supported by the provider the connector will failover to non-MPU APIs.
  
 ### Signing API Requests ### Signing API Requests
Line 119: Line 128:
 ### Rate Limiting ### Rate Limiting
  
-Some S3 compatible storage providers may limit the rate at which it processes requests.  This page: [[throttledcloudproviders|File Fabric Handling of Rate-Limiting Storage Providers]] explains how the File Fabric responds to rate limiting.+Some S3 compatible storage providers may limit the rate at which it processes requests.  This page: [[:throttledcloudproviders|File Fabric Handling of Rate-Limiting Storage Providers]] explains how the File Fabric responds to rate limiting.
  
 For most recoverable errors the File Fabric will retry transparently three times before returning an error to the client. For most recoverable errors the File Fabric will retry transparently three times before returning an error to the client.
© Copyright 2024 Nasuni.