Options for web scraping - C++ version only

c++ screen-scraping
Piotr Dobrogost picture Piotr Dobrogost · May 7, 2009 · Viewed 44.1k times · Source

I'm looking for a good C++ library for web scraping.
It has to be C/C++ and nothing else so please do not direct me to Options for HTML scraping or other SO questions/answers where C++ is not even mentioned.

Answer

Kyle Simek picture Kyle Simek · May 7, 2009
  • libcurl to download the html file
  • libtidy to convert to valid xml
  • libxml to parse/navigate the xml

Related questions

Easiest way to convert int to string in C++

What is the easiest way to convert from int to equivalent string in C++. I am aware of two methods. Is there any easier way? (1) int a = 10; char *intStr = itoa(a); string str = string(intStr); (2) int a = 10; stringstream ss; ss &…

Read More
The Definitive C++ Book Guide and List

This question attempts to collect the few pearls among the dozens of bad C++ books that are published every year. Unlike many other programming languages, which are often picked up on the go from tutorials found on the Internet, few …

Read More
How do I iterate over the words of a string?

I'm trying to iterate over the words of a string. The string can be assumed to be composed of words separated by whitespace. Note that I'm not interested in C string functions or that kind of character manipulation/access. Also, …

Read More