How to crawl through a website and take screenshots of each page?

javascript automation screenshot webtrends
tridium picture tridium · Jun 10, 2009 · Viewed 7.9k times · Source

My task is to take screenshots of a set of webpages for legal purposes. I'm currently accomplishing this by using Webshot and running through its batch operation using a list of URLs I compiled myself. I also have to take screenshots of a rotating Flash banner which is done by using IECapt and its delay function.

Each page has a series of ads that require a screenshot taken of the page they lead to. How can I automate this so that I'm not spending hours clicking on each link after link?

In case that was not clear, the homepage has 4 secondary ads linking to 4 different product pages. I need a screenshot of the homepage (done) and then four different screenshots of the pages that the ads link to.

Oh, and to make things interesting, the homepages use Javascript redirects a la:

javascript:dcsOnsiteAdLink('url', '/whyjoin', 'ad', 'S1', 'popup', 'toolbar=yes,location=yes,directories=yes,status=yes,menubar=yes,scrollbars=yes,resizable=yes,width=780,height=500');

Answer

Roel picture Roel · Jun 10, 2009

Pay someone 3 USD / hour to do it for you through Elance or Mechanical Turk. Even if you'd spend only 4 hours on hacking together a script, that'd cost more than paying someone a few bucks for it.

Related questions

Clicking submit button of an HTML form by a Javascript code

I don't know much about WEB probramming, so feel free to ask if I'm missing any details. There is a certain website which I'm visiting very frequently, and it requires users to log in every time they visit. For the …

Read More
How do you automate Javascript minification for your Java web applications?

I'm interested in hearing how you prefer to automate Javascript minification for your Java web apps. Here are a few aspects I'm particularly interested in: How does it integrate? Is it part of your build tool, a servlet filter, a …

Read More
What is Grunt for?

I'm trying to get into Grunt, which I am new to, but I do not understand its utility. I understand that it is a taskrunner. I understand that it can be used to do things like bundle, uglify, jshint, minify, …

Read More