I've been writing a program which extracts data from web searches. To get more data, I'd ideally like to extract more results per query through a script (let's say 100 or so).
My question is, is there a way to modify the URL for Google, Yahoo, or Bing (preference in that order) so that I can get more than 10 results per query?
For Google, appending &num=99
used to work at one point but no longer works :(
I saw a similar append of &count=50
but that didn't work on any of the search engines either.
The reason num=99
doesn't work for Google is because the num
parameter's actual value isn't used, but is instead compared to a list of allowed values.
The allowed values are 10, 20, 30, 40, 50, and 100. Any other values for this field are ignored.
For Bing, the parameter is count=##
where ## can be anything from 1-100.
For Yahoo, the parameter is n=##
where ## can be anything from 1-100.
In most cases, the URL parameter will only work if the user hasn't specified the number of search results to show in the search engine's search settings. Otherwise, that cookie will take precedence.