Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
mstream [2018_02_19 20:47] – added ™ steven | mstream [2024_02_09 19:20] – [Notes] steven | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | # M-Stream™ File Transfer Acceleration | + | # M-Stream |
- | Transferring large volumes of data systems can be very difficult. Historically it would take users hours or even days to move very large files. The file would be first downloaded from the source system onto their local desktop (if there’s enough room). Only when that’s successful can an upload to the target server begin and fingers crossed an unreliable network doesn’t derail the transfer. | + | #### Last updated on Feb 9, 2024 |
- | M-Stream™ | + | Transferring large volumes of data can be very difficult. Historically it would take users hours or even days to move very large files. The file would be first downloaded from the source system onto their local desktop (if there’s enough room). Only when that’s successful can an upload to the target server begin and fingers crossed an unreliable network doesn’t derail the transfer. |
+ | |||
+ | M-Stream® | ||
{{ :: | {{ :: | ||
- | M-Stream File Transfer Acceleration is used when moving and copying files, folders and objects. It may also be used by applications | + | M-Stream File Transfer Acceleration is activated |
+ | |||
+ | ## When is M-Stream Used | ||
+ | |||
+ | M-Stream is used when moving data between any of the following storage providers provided they support range reads. | ||
+ | |||
+ | * Nasuni | ||
+ | * CIFS/SMB | ||
+ | * Swift API (SwiftStack, | ||
+ | * S3 API (certified on AWS S3, Cloudian, IBM COS) | ||
+ | * Azure Blob | ||
+ | * Filesystem (FS, Local block storage, StorNext, Ceph FS and many others) | ||
+ | |||
+ | M-Stream will also accelerate moves, copies and renames (because renames require copying the file that is being renamed) between buckets within an S3 or OpenS3 provider. | ||
+ | . | ||
+ | ### M-Stream for Download | ||
+ | |||
+ | M-Stream will accelerates downloads from supported storage providers to the Windows and Mac desktop clients. Downloads from the Web File Manager are not supported. | ||
+ | |||
+ | ### M-Stream for Upload | ||
+ | |||
+ | M-Stream provides accelerated uploads through the Web File Manager and desktop clients. | ||
+ | |||
+ | M-Stream streams parts in parallel directly to storage providers. M-Stream will not be used when an upload is performed outside Access Anywhere, when the file size is not known, | ||
+ | |||
+ | For example when: | ||
+ | |||
+ | * Direct upload is used (when both client and provider have ' | ||
+ | * Chunking is enabled (uncommon) | ||
+ | * File uploaded through FTP (as the file size is not provided) | ||
+ | * Encryption is enabled | ||
+ | * Antivirus scanning is enabled. | ||
+ | |||
+ | ## Enabling M-Stream | ||
+ | |||
+ | To enable M-Stream follow the steps below: | ||
+ | ### Appliance Administration | ||
+ | |||
+ | Go to Settings >> Site Functionality to review the M-Stream settings. | ||
+ | |||
+ | See [[cloudappliance/ | ||
+ | ### Organization Administration | ||
+ | |||
+ | Go to Policies >> Encryption: | ||
+ | |||
+ | * Disable Encryption. (Accelerated transfer will not be used for files encrypted with SME encryption. SSE encryption or other storage encryption allow accelerated transfer.) | ||
+ | |||
+ | Go to Policies >> Security: | ||
+ | |||
+ | * " | ||
+ | |||
+ | For each Object Storage provider from to Dashboard >> Provider Settings: | ||
- | ## Configuration | + | * Set Chunking " |
+ | * Turn MPU/DLO " | ||
- | The minimum file size and number of threads used for M-Stream are configurable. The number of segments may be determined based on the total size of the file and the specific target provider. | ||
- | To change the minimum file size and number of threads, log in as the Appliance Administrator (appladmin) and navigate to Settings > Site Functionality. | + | ### Enabling For Windows Tools |
- | {{ :mstream: | + | From Cloud Tools >> Control Panel >> Bandwidth: |
- | The setting _M-Stream | + | * Enable Allow multistream downloads |
+ | * Pick minimum file size (100 - 4096 MB) | ||
+ | * Pick up to 4 streams | ||
+ | * Determine if Cloud Drive should also use M-Stream | ||
- | The setting _M-Stream | + | Then number of cores used by the desktop |
- | ## Provider Support | ||
- | M-Stream File Transfer Acceleration is supported for storage providers that support multipart uploading and range reads (S3 and OpenStack Swift APIs) as well as file systems that support random I/O such as block-storage providers like CIFS and NFS. | + | ### Enabling For the Mac Drive |
- | Chunking must be disabled | + | The following options are available |
- | See [[multipartuploading]] for more information on configuring storage providers for M-Stream. | + | * Download & Upload Threads: # Cores (defaults to number of cores) |
+ | * Download Minimum Size: 150 Mbytes (default) | ||
+ | Then number of cores used by the desktop will be limited to the maximum number of threads set in the server. | ||