Linux: wget (Download Web Page)

By Xah Lee. Date: 2007-03-30. Last updated: 2024-03-07.

Here's how to download websites, 1 page or entire site.

Download One Web Page

# download a file
wget http://example.org/somedir/largeMovie.mov

# download website, 2 levels deep, wait 9 sec per page
wget --wait=9 --recursive --level=2 http://example.org/

Some sites check on user agent. (user agent basically means browser). so you might add this option “--user-agent=”.

wget http://example.org/ --user-agent='Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:103.0) Gecko/20100101 Firefox/103.0'