File Fabric Handling of Rate-Limiting Storage Providers

Last updated on April 24, 2019

Some cloud storage providers detect and limit high rates of usage by a user by slowing down the pace at which they respond to requests from that user. This can cause the connection between the File Fabric and the cloud storage to time-out, resulting in failed operations.

The File Fabric attempts to detect and work around this situation by waiting for some period of time and then retrying the operation. If the operation fails again, the File Fabric waits longer and then retries it again. This behaviour applies to the following operations:

  • import
  • export
  • copy
  • move
  • provider synchronization

These are the storage systems for which this behaviour has been implemented:

  • Amazon Cloud Drive
  • DropBox
  • Evernote
  • Huddle
  • Google Drive
  • Google Storage
  • Office 365
  • OneDrive
  • Open S3
  • OpenStack
  • Rackspace
  • S3
  • Salesforce
  • WebDAV
  • Microsoft Azure
  • Zimbra