BeautifulSoup like scraper for nodejs

javascript node.js web-scraping beautifulsoup cheerio
Jesus_Maria picture Jesus_Maria · Sep 19, 2015 · Viewed 11.6k times · Source

I am former python developer and I have used BS4 for couple of years Now I am developing with node and yes cheerio package is very good, but I need smth like BS4 for scraping in node

Is there some alternatives for cheerio? Thanks!

Answer

Mark Gibaud picture Mark Gibaud · Dec 2, 2015

I suggest you check out the x-ray node package. It is essentially an abstraction layer above cheerio that makes the code you need to 'structure any website' even more terse.

It has a composable syntax in style and it supports pagination, limiting/throttling, delaying, scraping collections etc.

Related questions

Save and render a webpage with PhantomJS and node.js

I'm looking for an example of requesting a webpage, waiting for the JavaScript to render (JavaScript modifies the DOM), and then grabbing the HTML of the page. This should be a simple example with an obvious use-case for PhantomJS. I …

Read More
Scrape web pages in real time with Node.js

What's a good was to scrape website content using Node.js. I'd like to build something very, very fast that can execute searches in the style of kayak.com, where one query is dispatched to several different sites, the results …

Read More
Puppeteer Execution context was destroyed, most likely because of a navigation

I am facing this problem in puppeteer in a for loop when i go on another page to get data, then when i go back it comes me this error line: Error "We have an error Error: the execution context …

Read More