Breakthrough in Small File Transfer Speed - New ascp4
Aspera's ascp4 is a next-generation file transfer binary that ships in version FASP 3.6 alongside ascp to introduce a new architecture for ultra high-speed transfer of small files in addition to large data sets. The architecture transfers one million (1MM) files per minute for even the smallest file sizes (e.g. <10KB) and achieves > 5Gbps transfer rates for global RTT and packet loss conditions (200ms / 2%) (Performance Benchmarks)
- File metadata is sent over the FASP transport channel, alongside the data, eliminating the per-file overhead of sending this metadata on TCP.
- Additionally read/write I/O is highly parallelized and chunk sizes are configurable, allowing for maximum per file open rates for even the smallest files.
- Pipelined file I/O mechanism feeds incoming chunks through compression, encryption and transfer as they are coming in from disk.
- The number of parallel I/O threads is configurable.
ascp4 is available as a secondary binary in all products. Major new capabilities in ascp4 include the following:
- Integration in Console for transfer initiation, control and reporting..
- Preservation of file timestamps and file ownership (uid, gid).
- Full support for Aspera docroots.
- Support for the Aspera shell.
- Options to parallelize all file operations - directory traversal, file attribute checking, in addition to read write further increases performance
- Resumable transfers
- Configurable overwrite policies and skip of existing files
- Direct to cloud storage transfer support
- Extremely fast small file transfers to cloud storage 10-100X faster than S3 HTTP multipart over WAN (250-500 files transferred per second for throughputs greater than 500 Mbps for files of average size <=10 KB)
- Full compatibility with FASP manager APIs (transfer control and reporting)
- Sparse file and symlink support
- Support for sparse file transfer.