How Many TCP Connections Can a Single Server Really Handle?

Once we chased solutions to the C10K problem—handling ten thousand concurrent connections on a single machine—but modern hardware and operating systems have largely removed that challenge. For background, see the classic articles "The previous decade, the famous C10K problem" and "The C10K problem".

Assuming a single server can support up to ten thousand concurrent connections, this is sufficient for most applications, yet large internet companies may need millions of simultaneous connections. While clustering can distribute load across many machines, vertical scaling of a single server can still save hardware, datacenter, and operational costs.

So how many TCP connections can a single server actually support?

First, consider file‑descriptor limits. In Linux each TCP connection consumes a file descriptor; when the limit is reached the error "Socket/File: Can't open so many files" appears. The limit can be inspected and raised with ulimit -n and by editing /etc/security/limits.conf or /etc/sysctl.conf.

Second, consider port range limits. Ports below 1024 are reserved; ports 1024‑65535 are available to users. Since each TCP connection occupies a unique port, a single IP can have roughly sixty thousand concurrent connections.

How is a TCP connection identified? The OS uses a four‑tuple: local port, local IP, remote port, remote IP. The server typically listens on a fixed local port, so the variable components are the remote IP and remote port. Ignoring address reuse, the theoretical maximum number of connections equals the number of client IPs times the number of client ports, about 2^32 × 2^16 ≈ 2^48.

These figures are theoretical; real‑world limits are imposed by hardware resources (memory) and network bandwidth. Nonetheless, achieving hundreds of thousands of concurrent connections on a single machine is feasible.

References

Previous decade, famous C10K problem: http://www.52im.net/thread-566-1-1.html

The C10K problem: http://www.kegel.com/c10k.html