Options for HTML scraping?

html web-scraping html-parsing html-content-extraction
Mark Harrison picture Mark Harrison · Aug 5, 2008 · Viewed 181k times · Source

I'm thinking of trying Beautiful Soup, a Python package for HTML scraping. Are there any other HTML scraping packages I should be looking at? Python is not a requirement, I'm actually interested in hearing about other languages as well.

The story so far:

Answer

Joey deVilla picture Joey deVilla · Aug 5, 2008

The Ruby world's equivalent to Beautiful Soup is why_the_lucky_stiff's Hpricot.

Related questions

Which HTML Parser is the best?

I code a lot of parsers. Up until now, I was using HtmlUnit headless browser for parsing and browser automation. Now, I want to separate both the tasks. As 80% of my work involves just parsing, I want to use a …

Read More
Web scraping in PHP

I'm looking for a way to make a small preview of another page from a URL given by the user in PHP. I'd like to retrieve only the title of the page, an image (like the logo of the website) …

Read More
Python BeautifulSoup scrape tables

I am trying to create a table scrape with BeautifulSoup. I wrote this Python code: import urllib2 from bs4 import BeautifulSoup url = "http://dofollow.netsons.org/table1.htm" # change to whatever your url is page = urllib2.urlopen(url).read() soup = …

Read More