How to implement a practical fiber scheduler?

linux asynchronous scheduling language-implementation
Cheery picture Cheery · Apr 19, 2009 · Viewed 8.8k times · Source

I know the very basics about using coroutines as a base and implementing a toy scheduler. But I assume it's oversimplified view about asynchronous schedulers in whole. There are whole set of holes missing in my thoughts.

How to keep the cpu from running a scheduler that's running idle/waiting? Some fibers just sleep, others wait for input from operating system.

Answer

nos picture nos · Dec 28, 2009

You'd need to multiplex io operations into an event based interface(select/poll), so you can leverage the OS to do the waiting, while still being able to schedule other fibers. select/poll have a timeout argument - for fibers that want to sleep, you can create a priority queue that uses that option of select/poll to emulate a sleep call.

Trying to serve fibers that does blocking operations (call read/write/sleep etc). directly won't work unless you schedule each fiber in a native thread - which kind of beats the purpose.

See http://swtch.com/libtask/ for a working implementation.

Related questions

C non-blocking keyboard input

I'm trying to write a program in C (on Linux) that loops until the user presses a key, but shouldn't require a keypress to continue each loop. Is there a simple way to do this? I figure I could possibly …

Read More
Asynchronous shell commands

I'm trying to use a shell script to start a command. I don't care if/when/how/why it finishes. I want the process to start and run, but I want to be able to get back to my shell …

Read More
Linux, sockets, non-blocking connect

I want to create a non-blocking connect. Like this: socket.connect(); // returns immediately For this, I use another thread, an infinite loop and Linux epoll. Like this(pseudocode): // in another thread { create_non_block_socket(); connect(); epoll_create(); epoll_ctl(); // …

Read More