How to successfully get all the tweets for one user with tweepy?

python tweepy
collarblind picture collarblind · May 20, 2015 · Viewed 8.1k times · Source

I am trying to pull all the tweets from USATODAY's twitter account. But, I keep hitting the rate limits when doing so. How do I start from where I left off of after I hit the rate limit?

For example, there are a total of 100k tweets. My code gets the first 3000 then hits the limit. How do I start at 3001 when my limit resets and so on until I can get all 100k?

auth = tweepy.OAuthHandler(consumer_key, consumer_secret)
auth.set_access_token(access_token_key, access_token_secret)

api = tweepy.API(auth)

for tweet in tweepy.Cursor(api.user_timeline,id='USATODAY').items():
    print tweet

Answer

manglano picture manglano · May 20, 2015

Outside of API limits, only the most recent 3000 tweets are available to anyone other than the account holder, even in the web interface. If you want the tweets before that, you'd need access to the archive.

Related questions

How to extract hours and minutes from a datetime.datetime object?

I am required to extract the time of the day from the datetime.datetime object returned by the created_at attribute. But I do not understand how to do that. This is my code for getting the datetime.datetime object. …

Read More
urllib.request in Python 2.7

I can use urllib.request module with Python 3.1. But when I execute the same program using Python 2.7, an error comes along the lines of; AttributeError: 'module' object has no attribute 'request'. I believe this error is because theres no request …

Read More
No module named pip.req

I am installing tweepy, but I am running into an error about pip.req. I have pip installed, but for some reason pip.req still can't be found. I did a bunch of research online and the most I could …

Read More