AI Engineering
Jan 24, 2026 · Databases
Can One PostgreSQL Instance Power 800 Million Users? OpenAI’s Trade‑offs Unpacked
OpenAI runs a single primary PostgreSQL with about 50 replicas to serve roughly 800 million ChatGPT users, employing PgBouncer connection pooling, cache‑lock mechanisms, query and schema optimizations, workload isolation, multi‑layer throttling, and cascade replication, while acknowledging the architecture’s limits and the complexity of full sharding.
Azure CosmosDBCascade ReplicationOpenAI
0 likes · 8 min read
