Tomcat doing 15K req/second on a single server using Jersey Jax-RS

java tomcat scalability membase
codecompleting picture codecompleting · Nov 1, 2011 · Viewed 7k times · Source

I tried testing things on a VPS, and came close to 10K requests per second, and that was a simple 'hello world' servlet, let alone making a call to membase.

My VPS was a 2 x Intel Xeon X5570, quad-core “Nehalem” architecture.

Note: I'm not a java expert, nor a tomcat expert, this was on default settings.

Does anyone else deal with such high traffic that could shed some light?

I used apache bench, and I ran it maybe 4-5 times, doing about 100K requests to the server.

original: how to handle 2000+ requests/sec on tomcat?

Answer

BalusC picture BalusC · Nov 1, 2011

Turn on NIO (Non-Blocking IO). This is not by default turned on. Without NIO, every HTTP connection is handled by a single thread and the limit is dependent on the amount of threads available. With NIO, multiple HTTP connections can be handled by a single thread and the limit is dependent on amount of heap memory available. With about 2GB you can go up to 20K connections.

Turning on NIO is a matter of changing the protocol attribute of the <Connector> element in Tomcat's /conf/server.xml to "org.apache.coyote.http11.Http11NioProtocol".

<Connector
    protocol="org.apache.coyote.http11.Http11NioProtocol"
    port="80"
    redirectPort="8443"
    connectionTimeout="20000"
    compression="on" />

Related questions

How to deploy a war file in Tomcat 7

I have copied the sample.war file into the webapps directory of Tomcat, and I can access localhost:8080. Now how will Tomcat deploy it, I mean do I need to open it in browser? How can I access the application?

Read More
Several ports (8005, 8080, 8009) required by Tomcat Server at localhost are already in use

I'm getting the following error when I try to run a simple JSP program on Tomcat in Eclipse. Several ports (8005, 8080, 8009) required by Tomcat v6.0 Server at localhost are already in use. The server may already be running in another process, …

Read More
Tomcat 404 error: The origin server did not find a current representation for the target resource or is not willing to disclose that one exists

I was following the tutorial on o7planning and got stuck at step 6: http://o7planning.org/en/10169/java-servlet-tutorial It's just a simple project that show HelloWorld but for some reason I keep getting 404 error. Detail: However the Tomcat welcome …

Read More