Top "Scrape" questions

How to scrape iframe content using cURL

Goal: I want to scrape the word "Paris" inside an iframe using cURL. Say you have a simple page containing …

php regex parsing curl scrape

CheerioJS, looping through <ul> with same class name

I'm trying to loop through each <ul> and get the value of each <li>. The thing …

node.js scrape cheerio

How to write a python script to search a website html for matching links

I am not too familiar with python and have to write a script to perform a host of functions. Basically …

python scrape

How to download images from BeautifulSoup?

Image http://i.imgur.com/OigSBjF.png import requests from bs4 import BeautifulSoup r = requests.get("xxxxxxxxx") soup = BeautifulSoup(r.…

python python-2.7 beautifulsoup scrape

Accessing Metacritic API and/or Scraping

Does anybody know where documentation for the Metacritic api is/if it still works. There used to be a Metacritic …

api scrape scraper

How to scrape JSON from puppeteer?

I login to a site and it gives a browser cookie. I go to a URL and it is a …

node.js scrape puppeteer

Create a JSON object from HTML using jQuery

Problem Overview Let's say I have a shipment of candy. The shipment has a number of boxes, and each box …

javascript jquery json html-parsing scrape

How to scrape html contents of one div by id using php

The page on another of my domains which I'd like to scrape one div from contains: <div id="thisone"&…

php html web-scraping scrape

Using SoupStrainer to parse selectively

Im trying to parse a list of video game titles from a shopping site. however as the item list is …

python beautifulsoup scrape

How to 'scrape' content from a page's source?

I have this code which gets the HTML source of a page: $page = file_get_contents('http://example.com/page.…

php scrape