I have an application that is latency sensitive. Although I care about throughput, extreme low latency is more important to me.
Please suggest how I can optimise my server to achieve the lowest possible latency - that is, the lowest possible response time from a request being received on a network interface (or inifiniband card) and the response being published.
Initial thoughts are
- Pin all operating system activity to a set of cores and dedicate others to my (don't know the best way to do this)
- Setting overcommit_memory to don't overcommit
The article Optimizing Servers and Processes for Speed seems to be a good start but other pointers are welcome.
Any other suggestions welcome