Top "Screen-scraping" questions

Screen-scraping, also known as web-scraping or data-scraping, is a software technique used to collect and parse information from user interfaces.

Is there a simple way in R to extract only the text elements of an HTML page?

Is there a simple way in R to extract only the text elements of an HTML page? I think this …

html r screen-scraping
How to extract images from flash viewers?

This deals with the (diverse) flash viewers that let you zoom in on images on websites. I’m trying to …

flash image screen-scraping extract shockwave
Get data from a facebook page wall or group wall for use on personal website

I want to connect to public facebook page or group and list all entries from the wall on a personal …

php facebook screen-scraping
Scrapy, scraping data inside a Javascript

I am using scrapy to screen scrape data from a website. However, the data I wanted wasn't inside the html …

python screen-scraping scrapy
Scraping websites with Javascript enabled?

I'm trying to scrape and submit information to websites that heavily rely on Javascript to do most of its actions. …

javascript python screen-scraping
Screen Scraping from a web page with a lot of Javascript

I have been asked to write an app which screen scrapes info from an intranet web page and presents the …

javascript html dom screen-scraping
Attachmate data scraping macro that prints pages to file

I recorded the following macro using Attachmate Extra! X-treme at work. I believe I'm using version 9.0. I'm trying to "scrape" …

vba screen-scraping extra
Scraping Real Time Visitors from Google Analytics

I have a lot of sites and want to build a dashboard showing the number of real time visitors on …

ajax google-analytics screen-scraping web-scraping google-analytics-api
scrape ASIN from amazon URL using javascript

Assuming I have an Amazon product URL like so http://www.amazon.com/Kindle-Wireless-Reading-Display-Generation/dp/B0015T963C/ref=amb_…

javascript screen-scraping amazon-ec2
Can I scrape flash?

I'd like to scrape a website to programmatically collect any external links within any flash elements on the page. I'd …

flash screen-scraping