How to mirror only a section of a website?

wget mirror
sub picture sub · May 27, 2011 · Viewed 47.4k times · Source

I cannot get wget to mirror a section of a website (a folder path below root) - it only seems to work from the website homepage.

I've tried many options - here is one example

wget -rkp -l3 -np  http://somewebsite/subpath/down/here/

While I only want to mirror the content links below that URL - I also need to download all the page assets which are not in that path.

It seems to work fine for the homepage (/) but I can't get it going for any sub folders.

Answer

Attilio picture Attilio · Aug 4, 2011

Use the --mirror (-m) and --no-parent (-np) options, plus a few of cool ones, like in this example:

wget --mirror --page-requisites --adjust-extension --no-parent --convert-links
     --directory-prefix=sousers http://stackoverflow.com/users

Related questions

How do I mirror a directory with wget without creating parent directories?

I want to mirror a folder via FTP, like this: wget --mirror --user=x --password=x ftp://ftp.site.com/folder/subfolder/evendeeper But I do not want to create a directory structure like this: ftp.site.com -> …

Read More
Wget Mirror HTML only

I have a small website that I try to mirror to my local machine with only the html file, no images, image attach files... pdf, ..etc. I have never mirrored a website before and think it would be a good …

Read More
Using wget to recursively fetch a directory with arbitrary files in it

I have a web directory where I store some config files. I'd like to use wget to pull those files down and maintain their current structure. For instance, the remote directory looks like: http://mysite.com/configs/.vim/ .vim holds …

Read More