Jul 20, 2023

Parallel FTP-fetching program

Paraget implements getting a single file in parallel from different mirror sites.

Given that there are mirror-sites for the file one is downloading, one can in principle accomplish a much greater bandwidth by downloading from all the sites in parallel . This is accomplished by dividing the file being fetched into several pieces, and by getting each piece from a different server, and then re-assembling them.

If there are enough mirror sites, this partitioning makes it so that the bottleneck is now placed at the client end, maxing the client’s connection.

Paraget is designed to not only do basic n -equal-piece partitioning of a file and sending requests out to n servers for data, but to also be dynamic during the downloading process. For example if one server is too slow, and paraget was done with faster server downloading its piece

Checkout these related ports:
  • Yafc - Yet another FTP client, similar to ftp(1)
  • Wzdftpd - Modular FTP server configurable online using SITE commands
  • Wput - Upload files or directories to FTP server with resume support
  • Wmget - Dock app for Window Maker providing wget functionality
  • Wget - Retrieve files from the Net via HTTP(S) and FTP
  • Weex - Non-interactive FTP client
  • Waiho - Simple FTP client for GNUstep
  • Vsftpd - FTP daemon that aims to be "very secure"
  • Vsftpd-ext - FTP daemon that aims to be "very secure". Extended build
  • Uftp - Multicast capable FTP client and server
  • Twoftpd - Simple, secure, efficient FTP server
  • Tnftpd - Enhanced FTP server from NetBSD
  • Tnftp - Enhanced FTP client from NetBSD
  • Tftp-hpa - Advanced TFTP server
  • Termscp - TUI file transfer and explorer with support for SCP/SFTP/FTP/S3