Random Bulletin

Aug 27, 2026 · Operations

Scaling Log Indexing: From Full‑Index to Selective Strategies for Million‑QPS Systems

Full‑text log indexing inflates storage, CPU and mapping costs for 99% of queries that never run, so the article breaks down the five cost walls of full indexing at TB‑scale and presents four selective indexing paths—ES field reduction, Loki tag indexing, ClickHouse column‑store with skip indexes, and hot‑warm‑cold tiering—to pay only for high‑frequency queries.