Elasticsearch Optimization

Tencent Cloud Developer

Nov 12, 2020 · Big Data

Tencent Tianji Ge Distributed Tracing System: Elasticsearch Optimization Practice

Tencent’s Tianji Ge distributed tracing platform, which combines tracing, metrics and logging for billions of daily records, overcame severe cluster jitter and storage latency by applying tiered Elasticsearch index templates, replica reduction, Transport‑API buffering, pre‑created indices and ILM, cutting write latency from 20 s to 0.32 s, shrinking shards by 70 % and saving 30 % of storage.