Tagged articles
Log Analytics
43 articles · Page 1 of 1

ITPUBAug 9, 2026 · Big Data
The article compares Elasticsearch and ClickHouse for log storage, analyzes cost and performance, and provides a step‑by‑step guide to deploying a Zookeeper‑Kafka‑Filebeat‑ClickHouse pipeline, including common pitfalls and their solutions, showing how the combo reduces server costs by up to half.
ClickHouseElasticsearchKafka
0 likes · 15 min read

A large multinational company migrated its multi‑cloud log pipeline from a fragmented AWS stack to Alibaba Cloud Log Service (SLS), achieving unified data processing, query, visualization and alerting while reducing total monthly cost by over 87% and gaining additional free storage and feature benefits.
AWS comparisonCost OptimizationLog Analytics
0 likes · 21 min read

When log volumes explode from gigabytes to petabytes, Alibaba Cloud Log Service’s traditional on‑the‑fly querying becomes slow, resource‑hungry, and inaccurate, but materialized views pre‑compute and store results, delivering seconds‑level responses with far lower resource consumption.
Log AnalyticsMaterialized Viewcloud-native
0 likes · 11 min read

Netflix processes over 5 PB of logs daily, handling millions of events per second, and by layering hot and cold storage, using a custom lexer for fingerprinting, native protocol serialization, and sharded tag maps, they reduced query latency from seconds to sub‑second levels with ClickHouse.
ClickHouseLog AnalyticsSystem Optimization
0 likes · 8 min read

This guide walks through practical ELK Stack performance tuning for TB-scale log analysis, covering architecture design, node role allocation, index and JVM settings, Logstash pipeline tweaks, Kibana query optimization, monitoring, alerting, and a real-world case study that demonstrates cost-effective, high-speed search and ingestion.
ElasticsearchKibanaLog Analytics
0 likes · 13 min read

This article details how Alibaba's A+ traffic analysis platform tackled trillion‑row log ingestion and high‑concurrency queries by redesigning storage with Paimon, leveraging Flink for real‑time ingestion, and using StarRocks for fast lake analytics, ultimately reducing query latency from minutes to seconds.
FlinkLog AnalyticsPaimon
0 likes · 15 min read

This article compares Alibaba Cloud Elasticsearch Serverless with self‑built Elasticsearch clusters for log processing, highlighting cost reductions over 70 %, improved performance stability, automatic scaling, and step‑by‑step guidance to activate and configure the serverless service for real‑world workloads.
Cost OptimizationElasticsearchLog Analytics
0 likes · 8 min read

This article explains how Alibaba Cloud's SLS StoreView feature enables cross‑project log aggregation, isolation, enrichment, and analysis by creating virtual logstores, demonstrating setup steps, SPL‑based data enrichment, meta‑column handling, and column compatibility through detailed examples and screenshots.
Cross-Project QueryData EnrichmentLog Analytics
0 likes · 10 min read

Alibaba Cloud’s SLS SQL engine has been completely rebuilt, leveraging C++ SIMD, compute‑storage fusion, fine‑grained parallel pipelines, and advanced caching, delivering up to three‑fold raw performance gains, halving latency, and dramatically accelerating high‑cardinality, incremental, and join queries across trillion‑row log datasets.
Log Analytics
0 likes · 12 min read

Alibaba Cloud’s Serverless Log Service (SLS) has overhauled its SQL engine with a C++‑based compute engine, SIMD acceleration, storage‑compute fusion, and optimized scheduling, delivering up to three‑fold speed gains, 50% latency reduction, and significant improvements across high‑cardinality, JSON, IP, and join queries.
Log AnalyticsSQLbig data
0 likes · 12 min read

Quickwit is a Rust‑based distributed search engine that enables sub‑second queries directly on cloud object storage, and its documentation details the architecture, core concepts, installation, data ingestion, log management, tracing, deployment options, configuration, and operational best practices.
Distributed SearchKubernetesLog Analytics
0 likes · 4 min read

This article traces the evolution of streaming processing languages, compares iLogtail's native and extended pipeline modes, and demonstrates how the new SPL syntax in iLogtail 2.0 delivers high‑performance, flexible log and time‑series data processing with unified, SQL‑like commands and interactive debugging tools.
Log AnalyticsSPLdata pipelines
0 likes · 13 min read

This article compares ClickHouse and Elasticsearch for log analytics, highlighting ClickHouse's superior write throughput, query speed, and lower server costs, then provides a detailed, cost‑effective deployment guide covering Zookeeper, Kafka, FileBeat, ClickHouse installation, and visualization with ClickVisual, plus optimization tips.
ClickHouseElasticsearchLog Analytics
0 likes · 15 min read

This article compares ClickHouse and Elasticsearch for log analytics, highlighting ClickHouse’s superior write throughput, query speed, and lower server costs, then details a cost‑effective deployment architecture—including Zookeeper, Kafka, FileBeat, and ClickHouse setup—and shares optimization tips and visualization using ClickVisual.
ClickHouseElasticsearchKafka
0 likes · 13 min read

This article details how SelectDB’s inverted‑index, Variant data type, and sampling capabilities were integrated into GuanceDB to replace Elasticsearch, achieving up to 70% storage cost reduction, 2‑4× query speed improvement, and a ten‑fold overall cost‑performance boost for log analytics and observability workloads.
Log AnalyticsSelectDBcloud-native
0 likes · 20 min read

This article describes how China Unicom’s Western Innovation Research Institute designed and deployed a centralized, real‑time log analytics platform using Apache Doris, detailing the migration from Hive and ClickHouse, performance optimizations, storage cost reductions, and the resulting improvements in data ingestion, query speed, and operational efficiency.
Apache DorisCold‑Hot Data ManagementData Compression
0 likes · 18 min read

This article compares Elasticsearch and ClickHouse by describing their architectures, presenting Docker‑based test stacks, showing code snippets for deployment, data ingestion, and queries, and reporting performance results that demonstrate ClickHouse generally outperforms Elasticsearch in log‑analytics scenarios.
ClickHouseDockerElasticsearch
0 likes · 12 min read


ITPUBMay 15, 2023 · Big Data
This article compares Elasticsearch and ClickHouse for log analytics by detailing their architectures, setting up Docker‑Compose stacks, ingesting synthetic syslog data with Vector, running equivalent queries, and measuring performance, revealing ClickHouse’s superior speed in most scenarios.
ClickHouseDockerElasticsearch
0 likes · 13 min read

This article explains how Apache Doris implements a high‑performance, column‑oriented inverted index to address the challenges of massive, real‑time log data storage and analysis, delivering dramatically higher write throughput, lower storage costs, and faster query performance than traditional Elasticsearch and Loki solutions.
Apache DorisLog AnalyticsSQL
0 likes · 19 min read

This article compares Elasticsearch and ClickHouse as log‑analytics solutions, detailing their architectures, node roles, data ingestion pipelines, query capabilities, and benchmark results, ultimately showing ClickHouse’s superior performance in most tested scenarios.
ClickHouseDockerElasticsearch
0 likes · 13 min read

This article explains the motivation, design, and implementation of Alibaba Cloud's SLS Schema‑on‑Read scanning mode, showing how it enables SQL analysis on raw log data without pre‑built indexes, improves flexibility for evolving schemas, and reduces storage and index costs in various log‑analysis scenarios.
Cost OptimizationLog AnalyticsSQL
0 likes · 27 min read

This article presents a comprehensive overview of Alibaba Cloud Elasticsearch for log analytics, detailing cluster characteristics, common pain points, five key optimization techniques—including cold/hot resource sharing and indexing service—followed by engine kernel improvements, performance benchmarks, and a step‑by‑step product demonstration.
ElasticsearchIndexing ServiceLog Analytics
0 likes · 11 min read

The Volcano Engine Developer Community Meetup on March 26 featured four senior engineers presenting lightweight multi‑tenant Kubernetes solutions, practical cloud‑native observability techniques, NVMe over Fabrics storage virtualization, and a comprehensive log collection and analysis platform for cloud‑native environments.
KubernetesLog AnalyticsStorage Virtualization
0 likes · 4 min read

This article compares Elasticsearch and ClickHouse in terms of architecture, query capabilities, and performance for log analytics, presenting test setups, Docker‑compose configurations, query examples, and benchmark results that show ClickHouse generally outperforms Elasticsearch in most basic query scenarios.
ClickHouseElasticsearchLog Analytics
0 likes · 12 min read

This article compares Elasticsearch and ClickHouse for log analytics, detailing their architectures, presenting a Docker‑Compose test setup that streams synthetic syslog data to both stacks, executing equivalent queries, measuring response times, and concluding that ClickHouse generally delivers faster performance, especially for aggregations.
ClickHouseElasticsearchLog Analytics
0 likes · 10 min read

This article compares Elasticsearch and ClickHouse for log analytics, detailing their architectures, node roles, query capabilities, and performance through Docker‑Compose stacks and synthetic syslog data, concluding that ClickHouse generally outperforms Elasticsearch in speed and aggregation efficiency.
ClickHouseColumnar DatabaseElasticsearch
0 likes · 11 min read

This article compares Elasticsearch and ClickHouse as log analytics solutions, detailing their architectures, deployment configurations, query capabilities, and performance benchmarks across various query types, and demonstrates that ClickHouse generally outperforms Elasticsearch in speed and aggregation efficiency.
ClickHouseDocker ComposeElasticsearch
0 likes · 13 min read

This article details 58.com’s journey with Elasticsearch, covering the challenges of disparate deployments, common problems like disk exhaustion and write slowdown, the governance and automation platform they built, development standards, service architecture, real‑world application cases, and future plans for version upgrades and intelligent diagnostics.
ElasticsearchIndex LifecycleLog Analytics
0 likes · 19 min read

WeChat Pay’s Hermes‑based log system ingests trillions of entries daily, storing petabytes across a 200‑node HDFS cluster with four‑nine availability, while LSM‑style writes, separate inverted indexes and hot‑cold tiering cut memory, disk and cost by up to 70 % and keep 95 % of queries under five seconds.
HDFSHermesIndexing
0 likes · 7 min read

Alibaba Cloud’s Log Service (SLS) has evolved into a unified observability middle‑platform that handles tens of petabytes daily, offering integrated storage, processing, and AI‑driven analysis for logs, metrics, and traces, while addressing challenges of data ingestion, performance, and scalability across diverse Ops scenarios.
AIOpsLog AnalyticsOperations
0 likes · 16 min read

Facing growing log volumes and high Elasticsearch costs, Ctrip migrated its 200 TB daily logs to ClickHouse, achieving up to 38× faster queries, 60 % lower server resources, and simplified operations through columnar storage, sharding, and custom dashboards, while detailing deployment, tuning, and common pitfalls.
ClickHouseDatabase MigrationElasticsearch
0 likes · 14 min read

This article describes Suning's AI‑driven end‑to‑end solution for massive time‑series monitoring, anomaly detection, forecasting with DeepAR, MQ‑RNN, MQ‑CNN, ensemble methods, root‑cause localization using Hotspot and Monte‑Carlo Tree Search, and the evolution of its large‑scale log analytics platform.
Log AnalyticsRoot Cause Analysisanomaly detection
0 likes · 17 min read

This article details 58.com’s extensive use of Elasticsearch for search, analytics, and log processing, covering cluster optimization challenges, typical issues like disk exhaustion and write slowdown, practical solutions, development standards, ELKB architecture, real‑time log and MySQL slow‑log applications, platform‑as‑a‑service construction, and future roadmap plans.
ElasticsearchLog Analyticscluster management
0 likes · 17 min read

This article surveys how major Chinese internet companies such as JD.com, Ctrip, Qunar, 58.com and Didi have adopted Elasticsearch and the Elastic Stack for high‑volume order queries, log analysis, real‑time monitoring, security analytics, and large‑scale distributed search, describing their architecture evolution, shard strategies, and operational practices.
Log AnalyticsSearch Architecturebig data
0 likes · 16 min read

This article describes how iQIYI built a real‑time, multi‑dimensional log monitoring platform using Spark Streaming, Flink, Kafka and Druid to handle billions of logs, improve alerting accuracy, reduce incident response time, and outline future intelligent monitoring enhancements.
DruidFlinkLog Analytics
0 likes · 10 min read

To support over 100 million iQIYI members, the team rebuilt a real‑time log monitoring platform that gathers access, exception, Nginx and front‑end logs via a Venus‑Agent, streams them through Kafka to Spark Streaming and Flink, stores metrics in Druid, and provides minute‑level host and business alerts, achieving 80 % faster incident investigation, detecting 90 % of member complaints early, and generating more than 4,800 actionable alerts.
FlinkLog AnalyticsSpark Streaming
0 likes · 11 min read

Tencent leverages Elasticsearch at massive scale across log analytics, search services, and time‑series monitoring, addressing challenges of high availability, low cost, and high performance through kernel optimizations, resource‑aware throttling, cold‑data merging, rollup, caching, and open‑source contributions.
Cost OptimizationElasticsearchHigh Availability
0 likes · 20 min read

This article introduces Elasticsearch as a distributed search and analytics engine, outlines its common application scenarios, provides step‑by‑step installation commands, explains core concepts such as documents and indices, and demonstrates basic indexing, retrieval, bulk processing, and aggregation operations.
ElasticsearchLog Analyticsbulk API
0 likes · 4 min read

This article examines the unique characteristics of log data, outlines the challenges of using Elasticsearch at scale, and presents practical optimization techniques—including ingestion, mapping, time‑range search, metadata loading, and a custom C++ engine—to dramatically improve performance, stability, and cost efficiency.
BackendElasticsearchLog Analytics
0 likes · 11 min read

On April 27, Youzan Technology and the Elastic Chinese community hosted a “starry sky” technical salon where experts from Getui, Ant Financial, Haipai Ke and Youzan presented four talks on large‑cluster proxy management, multi‑tenant ES optimization, search‑platform engineering, and the evolution of Youzan’s log platform, followed by lively Q&A and resource sharing.
ElasticsearchLog AnalyticsSearch Platform
0 likes · 6 min read

This article describes how Ctrip's flight ticket team built a massive log‑tracking platform using Elasticsearch, Kafka, and Spark, evaluated storage options such as Cassandra and HBase, introduced secondary indexing and hot‑cold data separation, and continuously evolved the architecture to balance resource usage and query performance.
KafkaLog Analyticsarchitecture
0 likes · 7 min read

This article recounts how Ctrip’s operations team replaced costly commercial tools with an open‑source ELK stack, detailing requirements, architecture, optimizations, and the impressive scale achieved for real‑time log analysis across thousands of servers.
ElasticsearchLog Analyticselk
0 likes · 10 min read

This article explains IT Operation Analytics (ITOA), its data sources, use cases, evolution of log management, and how a real‑time log search platform can improve monitoring, security, and business analysis for large‑scale IT environments.
Log AnalyticsSecuritymonitoring
0 likes · 13 min read
