Permanent 'Temporary failure in name resolution' after running for a number of hours

python urllib2 httplib
2371 picture 2371 · Dec 2, 2011 · Viewed 15.6k times · Source

After running for a number of hours on Linux, my Python 2.6 program that uses urllib2, httplib and threads, starts raising this error for every request:

<class 'urllib2.URLError'> URLError(gaierror(-3, 'Temporary failure in name resolution'),)

If I restart the program it starts working again. My guess is some kind of resource exhaustion but I don't know how to check for it. How do I diagnose and fix the problem?

Answer

2371 picture 2371 · Dec 4, 2011

This was caused by a library's failure to close connections, leading to a large number of connections stuck in a CLOSE_WAIT state. Eventually this causes the 'Temporary failure in name resolution' error due to resource exhaustion.

Related questions

Python-Requests close http connection

I was wondering, how do you close a connection with Requests (python-requests.org)? With httplib it's HTTPConnection.close(), but how do I do the same with Requests? Code: r = requests.post("https://stream.twitter.com/1/statuses/filter.json", data={'track':…

Read More
Python urllib2 cannot open localhost on alternate port (not 80)? Error 10013

Here is my server.py: import BaseHTTPServer import SocketServer class TestRequestHandler(BaseHTTPServer.BaseHTTPRequestHandler): def do_GET(self): self.wfile.write("hello world at %s" % __file__) server = BaseHTTPServer.HTTPServer(('', 10000), TestRequestHandler) #server = SocketServer.ThreadingTCPServer(('', 8888), TestRequestHandler) server.serve_forever() Here is …

Read More
Are urllib2 and httplib thread safe?

I'm looking for information on thread safety of urllib2 and httplib. The official documentation (http://docs.python.org/library/urllib2.html and http://docs.python.org/library/httplib.html) lacks any information on this subject; the word thread is not …

Read More