Ubuntu 16.04 systemd redis issues with ulimit

ubuntu redis systemd ubuntu-16.04 ulimit
Ollie picture Ollie · Sep 15, 2016 · Viewed 8.2k times · Source

I have been having issues with our new redis server after swapping from Ubuntu 14.04 to 16.04. The configuration of the open files limit using all the guides says to change the /etc/security/limits.conf with the following settings

*    soft nofile 65535
*    hard nofile 65535
root soft nofile 65535
root hard nofile 65535

And also to add to /etc/pam.d/common-session and /etc/pam.d/common-session-noninteractive

session required pam_limits.so

I have made all of these changes but redis is still starting up with a file limit of 4096 which under production load we quickly reach max connections.

Answer

Ollie picture Ollie · Sep 15, 2016

After much searching I finally found that systemd has a standard limit of 4096 and regardless of what you set at the system level the systemd level will always take precedence. The fix for this is to change the systemd open file limit by editing /etc/systemd/system.conf and adding the following setting

DefaultLimitNOFILE=65536

It seems that there are a lot of default settings in systemd which override the system settings so have to be set in systemd

So if its any use for people these are my final settings for a Ubuntu 16.04 server for running production redis.

Edit /etc/systemd/system.conf (sudo nano /etc/systemd/system.conf) and add

DefaultLimitNOFILE=65536

Edit /etc/security/limits.conf (sudo nano /etc/security/limits.conf) and add

*    soft nofile 64000
*    hard nofile 64000
root soft nofile 64000
root hard nofile 64000

Edit /etc/pam.d/common-session (sudo nano /etc/pam.d/common-session) and add

session required pam_limits.so

Edit /etc/pam.d/common-session-noninteractive (sudo nano /etc/pam.d/common-session-noninteractive) and add

session required pam_limits.so

Edit /etc/rc.local (sudo nano /etc/rc.local) and add

sysctl -w net.core.somaxconn=65535

Edit /etc/sysctl.conf (sudo nano /etc/sysctl.conf) and add

vm.overcommit_memory = 1

Edit /etc/rc.local (sudo nano /etc/rc.local) and add

echo never > /sys/kernel/mm/transparent_hugepage/enabled

Related questions

How can I stop redis-server?

I apparently have a redis-server instance running because when I try to start a new server by entering redis-server, I'm greeted with the following: Opening port: bind: Address already in use I can't figure out how to stop this server …

Read More
Redis - Connect to Remote Server

I've just install Redis succesfully using the instructions on the Quick Start guide on http://redis.io/topics/quickstart on my Ubuntu 10.10 server. I'm running the service as dameon (so it can be run by init.d) The server is …

Read More
Open Redis port for remote connections

I can ping pong Redis on the server: # redis-cli ping PONG But remotely, I got problems: $ src/redis-cli -h REMOTE.IP ping Could not connect to Redis at REMOTE.IP:6379: Connection refused In config, I got the standard port: # Accept …

Read More