About mysql cursor and iterator

taijirobot2 picture taijirobot2 · Jun 1, 2011 · Viewed 19.8k times · Source

Imagine I have a mysql cursor and data read. The amount of data might be very big that I want to deal with one line each time.

An easy and straight forward way might be like this:

while True:
    row = cursor.fetchone()
    if not row: break
    .....

But this doesn't look good, so I wonder whether this way works as imagined:

for row in iter(cursor.fetchall())

The thing I want to know is: if I use the iter(cursor.fetchall()) way, does it fetch all the data first or it just fetch one row at a time?

Answer

samplebias picture samplebias · Jun 1, 2011

The MySQLdb cursor class implements the iterator protocol, so you can simply do this:

cursor.execute(sql)
for row in cursor:
    print row
    ...

Relevant code from MySQLdb.cursors.BaseCursor:

def __iter__(self):
    return iter(self.fetchone, None)