Top "Mechanize" questions

A library for automated web browsing originally developed for Perl, there are now also Python and Ruby implementations.

Mechanize and BeautifulSoup for PHP?

I was wondering if there was anything similar like Mechanize or BeautifulSoup for PHP?

php python beautifulsoup mechanize
mechanize how to get current url

I have this code require 'mechanize' @agent = Mechanize.new page = @agent.get('http://something.com/?page=1') next_page = page.…

ruby mechanize
python - mechanize (setting input into form)

I found out how to retreive the html page of a topic from google search using a tutorial.This was …

python forms mechanize mechanize-python
Is there a PHP equivalent of Perl's WWW::Mechanize?

I'm looking for a library that has functionality similar to Perl's WWW::Mechanize, but for PHP. Basically, it should allow …

php automation screen-scraping mechanize www-mechanize
trying to POST with ruby mechanize

I've captured the login HTTP headers using firefox plugin LiveHTTPheaders. I've found the following url and variables. POST /login email=…

ruby mechanize
Using WWW:Mechanize to download a file to disk without loading it all in memory first

I'm using Mechanize to facilitate the downloading of some files. At the moment my script uses the following line to …

ruby mechanize
Downloading file with Python mechanize

I am trying to download a file from a website using python and mechanize. My current code successfully logs on …

python web-scraping mechanize
HTTP Error 999: Request denied

I am trying to scrape some web pages from LinkedIn using BeautifulSoup and I keep getting error "HTTP Error 999: Request …

python web-scraping beautifulsoup linkedin mechanize
Ruby mechanize post with header

I have page with js that post data via XMLHttpRequest and server side script check for this header, how to …

ruby xmlhttprequest mechanize
Using Ruby with Mechanize to log into a website

I need to scrape data from a site, but it requires my login first. I've been using hpricot to successfully …

ruby login screen-scraping mechanize hpricot