Non-blocking file access with Twisted

python twisted
rhettg picture rhettg · Nov 12, 2009 · Viewed 8k times · Source

I'm trying to figure out if there is a defacto pattern for file access using twisted. Lots of examples I've looked at (twisted.python.log, twisted.persisted.dirdbm, twisted.web.static) actually don't seem to worry about blocking for file access.

It seems like there should be some obvious interface, probably inheriting from abstract.FileDescriptor, that all file access should be going through it as a producer/consumer.

Have I missed something or is it just that the primary use for twisted in asynchronous programming is for networking and it hasn't really been worked out for other file descriptor operations, not worrying about the purity of non-blocking IO ?

Answer

Bertolt picture Bertolt · Mar 15, 2010

I think you are looking for the fdesc module. For more information on non-blocking I/O in Python, you can also watch this video.

Related questions

When to use Tornado, when to use Twisted / Cyclone / GEvent / other

Which of these frameworks / libraries would be the best choise for building modern multiuser web application? I would love to have an asynchronous webserver which will allow me to scale easly. What solution will give the best performance / scalability / most …

Read More
A clean, lightweight alternative to Python's twisted?

A (long) while ago I wrote a web-spider that I multithreaded to enable concurrent requests to occur at the same time. That was in my Python youth, in the days before I knew about the GIL and the associated woes …

Read More
Python twisted: where to start

I am trying to start learning twisted for socket servers creation. I want to add some useful features (like auth, and maybe some other). Maybe someone can point me to a good tutorial which will help me to start (+ maybe …

Read More