Getting more search results per page via URL

user1319504 picture user1319504 · Jul 15, 2013 · Viewed 15.4k times · Source

I've been writing a program which extracts data from web searches. To get more data, I'd ideally like to extract more results per query through a script (let's say 100 or so).

My question is, is there a way to modify the URL for Google, Yahoo, or Bing (preference in that order) so that I can get more than 10 results per query?

For Google, appending &num=99 used to work at one point but no longer works :( I saw a similar append of &count=50 but that didn't work on any of the search engines either.

Answer

Steve picture Steve · Jun 17, 2015

The reason num=99 doesn't work for Google is because the num parameter's actual value isn't used, but is instead compared to a list of allowed values.

The allowed values are 10, 20, 30, 40, 50, and 100. Any other values for this field are ignored.

For Bing, the parameter is count=## where ## can be anything from 1-100.

For Yahoo, the parameter is n=## where ## can be anything from 1-100.

In most cases, the URL parameter will only work if the user hasn't specified the number of search results to show in the search engine's search settings. Otherwise, that cookie will take precedence.