BestHub
Sign in
Tagged articles

log indexing

2 articles · Page 1 of 1
Random Bulletin
Random Bulletin
Aug 27, 2026 · Operations

Scaling Log Indexing: From Full‑Index to Selective Strategies for Million‑QPS Systems

Full‑text log indexing inflates storage, CPU and mapping costs for 99% of queries that never run, so the article breaks down the five cost walls of full indexing at TB‑scale and presents four selective indexing paths—ES field reduction, Loki tag indexing, ClickHouse column‑store with skip indexes, and hot‑warm‑cold tiering—to pay only for high‑frequency queries.

ClickHouseElasticsearchLoki
0 likes · 19 min read
Scaling Log Indexing: From Full‑Index to Selective Strategies for Million‑QPS Systems
Baidu Geek Talk
Baidu Geek Talk
Jul 5, 2021 · Operations

Automated and Intelligent Analysis of Baidu Search Stability Issues

The team automated Baidu Search fault diagnosis by building a side‑index for instant log lookup, streaming incremental analysis, exhaustive rule templates, feature‑engineering pipelines, query‑scene reconstruction, entropy‑based ranking, per‑second timeline views, and chaos‑engineered fault injection, achieving near‑99% accuracy and second‑level, module‑granular stability tracing.

Fault AnalysisSearch Stabilitychaos engineering
0 likes · 15 min read
Automated and Intelligent Analysis of Baidu Search Stability Issues