Download Managers¶

curl & wget¶

To install on Ubuntu:
Bash
```
sudo apt-get install curl
```

Example usage to upload a file to FTP server:

Bash

curl -u anonymous --upload-file bigfile.tar.bz2 ftp://ftpserver.com/somedir/

To download a file using wget and curl, run one of the following commands (replace URL):

Bash

wget "https://www.example.com/example.tar.gz"
curl "https://www.example.com/example.tar.gz"

To pause a file being downloaded using wget and curl, press key. To resume download, run one of the following commands:
Bash
```
wget -c "https://www.example.com/example.tar.gz"
curl -c "https://www.example.com/example.tar.gz"  
```
Assuming that download links are stored in “links.txt” file, you can use one of the following commands to initiate batch downloads:
Bash
```
wget -i links.txt
xargs -n 1 curl -O < links.txt
```

axel¶

A console based Linux download manager. It downloads very fast when you use the multi-threaded feature. More than a download manager it’s rather a download accelerator. However, you can specify multiple URLs at once. It can resume broken downloads by default.

To install on Ubuntu:
Bash
```
sudo apt-get install axel
```

Normal usage:

Bash

axel "https://www.example.com/example.tar.gz"

axel -n 4 "https://www.example.com/example.tar.gz"

axel -a -n 5 <URL> # compact progress bar, 5 parallel threads

Axel does not support batch downloads. However, you can just loop through a links file using bash to download files one by one. Below is a small example:
Bash
```
while read link; do axel -n 4 $link; done < links.txt
```

uGet¶

Much more sophisticated than axel with many advanced features like multi-segment download. Supports downloading files through HTTP, HTTPS, FTP, BitTorrent & Metalink.

uGet

aria2¶

aria2 is a lightweight multi-protocol & multi-source command-line download utility. It supports HTTP/HTTPS, FTP, SFTP, BitTorrent and Metalink. aria2 can be manipulated via built-in JSON-RPC and XML-RPC interfaces.

To install aria2 in Ubuntu, run the following command:
Bash
```
sudo apt install aria2
```
To download a file using aria2, run the following command:
Bash
```
aria2c [-c] "https://www.example.com/example.tar.gz"
```
To create multiple connections when downloading a file, run a command in following format (replace “4” with your own choice):
Bash
```
aria2c -x 4 "https://www.example.com/example.tar.gz"
```
Assuming that download links are stored in “links.txt” file, you can use the following command to initiate batch downloads:
Bash
```
aria2c -i links.txt
```

YAAW¶

YAAW: Yet Another Aria2 Web Frontend in pure HTML/CSS/Javascirpt.

下载百度云文件¶

终端运行aria

Bash

aria2c \
--enable-rpc \
--rpc-listen-all \
--rpc-allow-origin-all \
--file-allocation=none \
--max-connection-per-server=10 \
--max-concurrent-downloads=5 \
--continue \
-d <download-dir>

安装 Chrome浏览器插件 BaiduExporter
- acgotaku/BaiduExporter: Export Baidu Cloud files address to aria2/aria2-rpc, support YAAW.
打开需要下载的百度云盘的分享链接，会发现网页上下载按钮旁边多出一个 「导出下载」 按钮，点击它弹出的「ARIA2 RPC」就自动添加到你的下载队列里了

BitTorrent & uTorrent¶

Download Google Drive Files using wget¶

ref: https://medium.com/@acpanjan/download-google-drive-files-using-wget-3c2c025a8b99

generate a direct download link to files: https://sites.google.com/site/gdocs2direct/
get FileID

download with the script

Bash

./08-network/download/dl_google_file_large.sh <FileID> <OutputName>

./08-network/download/dl_google_file_small.sh <FileID> <OutputName>