psycopg2 could not translate host name

airflow gunicorn psycopg2
Brett picture Brett · Jul 30, 2018 · Viewed 6.9k times · Source

My airflow server periodically fails. When I check the gunicorn logs, the error before all works shutting down looks like this:

OperationalError: (psycopg2.OperationalError) could not translate host name "my-airflow-db.l9zijaslosu.us-east-1.rds.amazonaws.com" to address: Name or service not known (Background on this error at: http://sqlalche.me/e/e3q8)

I immediately verify that the host name is correct and the database is accepting requests from other tools.

If I restart the Ariflow webserver, the the server operates correctly for 4-5 days, and then the same error occurs.

This issue has been asked before but is typically resolve by telling other developers to not use localhost or postrgres host names. My host name is a fully qualified host name on AWS's domain. It seems exceedingly unlikely that this is a DNS error on Amazon's part.

Answer

Related questions

How do I restart airflow webserver?

I am using airflow for my data pipeline project. I have configured my project in airflow and start the airflow server as a backend process using following command airflow webserver -p 8080 -D True Server running successfully in backend. Now I …

Read More
execution_date in airflow: need to access as a variable

I am really a newbie in this forum. But I have been playing with airflow, for sometime, for our company. Sorry if this question sounds really dumb. I am writing a pipeline using bunch of BashOperators. Basically, for each Task, …

Read More
Airflow - How to pass xcom variable into Python function

I need to reference a variable that's returned by a BashOperator. In my task_archive_s3_file, I need to get the filename from get_s3_file. The task simply prints {{ ti.xcom_pull(task_ids=submit_file_to_spark) }} …

Read More