How do I change the referer if I'm using the requests library to make a GET request to a web page. I went through the entire manual but couldn't find it.
According to http://docs.python-requests.org/en/latest/user/advanced/#session-objects , you should be able to do:
s = requests.Session()
s.headers.update({'referer': my_referer})
s.get(url)
Or just:
requests.get(url, headers={'referer': my_referer})
Your headers
dict will be merged with the default/session headers. From the docs:
Any dictionaries that you pass to a request method will be merged with the session-level values that are set. The method-level parameters override session parameters.