Top "Wget" questions

convert wget cron command to curl

I would like to change the following wget cron commands to curl format: wget https://www.yoursite.com/index.php?…

curl cron wget cron-task

Why does curl allow use of the file URL scheme, but not wget

This question refers to curl 7.21.4 and GNU Wget 1.13.4, I don't know if the answer is version specific. Using the file …

curl wget file-uri

cURL hanging for 15 seconds when sending HEAD requests

Background I've been timing some HTTP requests via the CLI using time and tools such as wget and curl as …

http curl http-headers wget head

PHP - shell_exec output in browser is empty

I'm running a simple wget command in shell_exec() wget_file.php <?php $command = "wget http://mydomain.co/media/…

php wget shell-exec

crawl links of sitemap.xml through wget command

I try to crawl all links of a sitemap.xml to re-cache a website. But the recursive option of wget …

wget web-crawler sitemap.xml

Download papers from IEEExplore with wget

I am now out of institute, but need to download paper from IEEExplore. I can ssh to the institute server. …

ssh download wget ieee

httrack wget curl scrape & fetch

There are a number of tools on the internet for downloading a static copy of a website, such as HTTrack. …

curl download web-scraping wget httrack

Cronjob with password protected site (.htaccess)

I want to create a cronjob that every X time goes to open a webpage. This webpage is password protected …

.htaccess cron wget password-protection cron-task

Download file to null (Windows CLI)

I would like to download a file to null in windows cli just for testing purposes. In linux i used …

windows wget download network-traffic dev-null