Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
m-stream/usage/notes [2018_08_08 12:09] – dan | m-stream:usage:notes [2023_06_22 05:41] – external edit 127.0.0.1 | ||
---|---|---|---|
Line 1: | Line 1: | ||
# M-Stream Usage Notes | # M-Stream Usage Notes | ||
+ | Last updated on April. 6, 2022 | ||
+ | |||
+ | M-Stream is a File Fabric feature that speeds up the uploading, downloading and copying of very big files. Large files are split into pieces, sent in parallel over multiple streams, and reassembled back into a contiguous file or object at the target. In this way M-Stream maximizes throughput over available network bandwidth, minimizes network latency, and increases resiliency, particularly for wide area networks. | ||
+ | |||
+ | M-Stream is required to be activated by license key for the enterprise on-premises File Fabric. It is not available for the Software-as-a-Service hosted solution. | ||
## When is M-Stream Used | ## When is M-Stream Used | ||
Line 7: | Line 12: | ||
* CIFS/SMB | * CIFS/SMB | ||
* Swift API (SwiftStack, | * Swift API (SwiftStack, | ||
- | * S3 API (Amazon, Scality, Cloudian, IBM COS, and many many others) | + | * S3 API (certified on AWS S3, Cloudian, IBM COS) |
- | * Filesystem (FS, Local block storage, StorNext, Ceph FS, and many others) | + | * Azure Blob |
+ | * Filesystem (FS, Local block storage, StorNext, Ceph FS and many others) | ||
+ | |||
+ | M-Stream will also accelerate moves, copies and renames (because renames require copying | ||
+ | |||
+ | M-Stream will also accelerate the downloads from one of the above storage providers to a Windows desktop running the SME Cloud Tools version 10.5.10 or later and to a Mac desktop with version 4.8 of the SME Mac Tools. M-Stream also provides accelerated uploads through the Web File Manager when storage for which M-Stream transfers are supported is used. | ||
+ | |||
+ | ## M-Stream for Upload | ||
+ | |||
+ | M-Stream streams parts in parallel directly to storage providers. M-Stream will not be used when an upload is performed outside the File Fabric, when the file size is not known, or when the file content will be encrypted. | ||
+ | |||
+ | For example when: | ||
+ | * Direct upload is used (when both client and provider have ' | ||
+ | * Chunking is enabled (uncommon) | ||
+ | * File uploaded through FTP (as the file size is not provided) | ||
+ | * Encryption is enabled | ||
+ | * Antivirus scanning is enabled. | ||
- | M-Stream will also accelerate the downloads to a Windows desktop running the SME Cloud tools version 10.5.10 or later, from one of the above providers. | ||
## Enabling M-Stream on Enterprise File Fabric | ## Enabling M-Stream on Enterprise File Fabric | ||
Line 18: | Line 38: | ||
### From Appladmin Account | ### From Appladmin Account | ||
+ | Go to Settings >> License Key, check that the following are Enabled in your EFF License: | ||
+ | |||
+ | * M-Stream > Upload | ||
+ | * M-Stream > Transfers | ||
+ | |||
Go to Settings >> Site Functionality, | Go to Settings >> Site Functionality, | ||
Line 29: | Line 54: | ||
* M-Stream number of threads | * M-Stream number of threads | ||
- | * Should be set to a max of 10 or ( vCPUs - 2) of web node, whichever is lower | + | * Should be set to 10 or (no. of web node vCPUs - 2), whichever is lower |
* Enable Direct Upload: Should be set to Off | * Enable Direct Upload: Should be set to Off | ||
+ | |||
### From Team Admin Account | ### From Team Admin Account | ||
Line 42: | Line 68: | ||
* Disable Encryption. (Accelerated transfer will not be used for files encrypted with SME encryption. SSE encryption or other storage encryption allow accelerated transfer.) | * Disable Encryption. (Accelerated transfer will not be used for files encrypted with SME encryption. SSE encryption or other storage encryption allow accelerated transfer.) | ||
+ | |||
+ | Go to Policies >> Security: | ||
+ | |||
+ | * " | ||
## Enabling For Windows Tools | ## Enabling For Windows Tools | ||
Line 54: | Line 84: | ||
## Notes | ## Notes | ||
- | * Provider support MPU/DLO and range read. | + | * Provider |
- | * File system support Random I/O. (Controlled by the read / write block size) | + | * File system |
* M-Stream requires no user interaction. It works automatically when conditions allow. | * M-Stream requires no user interaction. It works automatically when conditions allow. | ||
+ | * If a file is being uploaded using M-Stream then MD5 of the file will not be calculated, even if the feature " |