How to loop until EOF in Python?

python eof stringio
Ben Blank picture Ben Blank · Nov 17, 2009 · Viewed 64.2k times · Source

I need to loop until I hit the end of a file-like object, but I'm not finding an "obvious way to do it", which makes me suspect I'm overlooking something, well, obvious. :-)

I have a stream (in this case, it's a StringIO object, but I'm curious about the general case as well) which stores an unknown number of records in "<length><data>" format, e.g.:

data = StringIO("\x07\x00\x00\x00foobar\x00\x04\x00\x00\x00baz\x00")

Now, the only clear way I can imagine to read this is using (what I think of as) an initialized loop, which seems a little un-Pythonic:

len_name = data.read(4)

while len_name != "":
    len_name = struct.unpack("<I", len_name)[0]
    names.append(data.read(len_name))

    len_name = data.read(4)

In a C-like language, I'd just stick the read(4) in the while's test clause, but of course that won't work for Python. Any thoughts on a better way to accomplish this?

Answer

Roger Pate picture Roger Pate · Nov 17, 2009

You can combine iteration through iter() with a sentinel:

for block in iter(lambda: file_obj.read(4), ""):
  use(block)

Related questions

SyntaxError: unexpected EOF while parsing

I am getting error while running this part of the code. tried some of the existing solutions, none of them helped elec_and_weather = pd.read_csv(r'C:\HOUR.csv', parse_dates=True,index_col=0) # Add historic DEMAND to each …

Read More
Python unexpected EOF while parsing

Here's my python code. Could someone show me what's wrong with it. while 1: date=input("Example: March 21 | What is the date? ") if date=="June 21": sd="23.5° North Latitude" if date=="March 21" | date=="September 21": sd="0° Latitude" if date=="December 21": sd="23.5° South Latitude" …

Read More
How to find out whether a file is at its `eof`?

fp = open("a.txt") #do many things with fp c = fp.read() if c is None: print 'fp is at the eof' Besides the above method, any other way to find out whether is fp is already at the eof?

Read More