Tagged articles

41 articles

Page 1 of 1

Mar 30, 2026 · Cloud Native

How a Global Enterprise Cut Log Analytics Costs by 87% with Alibaba Cloud SLS

A large multinational company migrated its multi‑cloud log pipeline from a fragmented AWS stack to Alibaba Cloud Log Service (SLS), achieving unified data processing, query, visualization and alerting while reducing total monthly cost by over 87% and gaining additional free storage and feature benefits.

AWS comparisonCost OptimizationLog Analytics

0 likes · 21 min read

How a Global Enterprise Cut Log Analytics Costs by 87% with Alibaba Cloud SLS

Alibaba Cloud Native

Nov 15, 2025 · Cloud Native

How Materialized Views Supercharge Alibaba Cloud Log Service Queries

When log volumes explode from gigabytes to petabytes, Alibaba Cloud Log Service’s traditional on‑the‑fly querying becomes slow, resource‑hungry, and inaccurate, but materialized views pre‑compute and store results, delivering seconds‑level responses with far lower resource consumption.

Cloud NativeLog Analyticsmaterialized view

0 likes · 11 min read

How Materialized Views Supercharge Alibaba Cloud Log Service Queries

Radish, Keep Going!

Oct 28, 2025 · Big Data

How Netflix Achieved Petabyte-Scale, Sub-Second Log Queries with ClickHouse

Netflix processes over 5 PB of logs daily, handling millions of events per second, and by layering hot and cold storage, using a custom lexer for fingerprinting, native protocol serialization, and sharded tag maps, they reduced query latency from seconds to sub‑second levels with ClickHouse.

Big DataClickHouseDistributed Systems

0 likes · 8 min read

How Netflix Achieved Petabyte-Scale, Sub-Second Log Queries with ClickHouse

Ops Community

Aug 22, 2025 · Big Data

Master ELK Stack Performance: Proven Strategies for TB-Scale Log Analytics

This guide walks through practical ELK Stack performance tuning for TB-scale log analysis, covering architecture design, node role allocation, index and JVM settings, Logstash pipeline tweaks, Kibana query optimization, monitoring, alerting, and a real-world case study that demonstrates cost-effective, high-speed search and ingestion.

ELKElasticsearchKibana

0 likes · 13 min read

Master ELK Stack Performance: Proven Strategies for TB-Scale Log Analytics

Alibaba Cloud Big Data AI Platform

May 21, 2025 · Big Data

How Alibaba’s A+ Traffic Analysis Achieved Sub‑Second Log Queries with StarRocks & Paimon

This article details how Alibaba's A+ traffic analysis platform tackled trillion‑row log ingestion and high‑concurrency queries by redesigning storage with Paimon, leveraging Flink for real‑time ingestion, and using StarRocks for fast lake analytics, ultimately reducing query latency from minutes to seconds.

FlinkLog AnalyticsPaimon

0 likes · 15 min read

How Alibaba’s A+ Traffic Analysis Achieved Sub‑Second Log Queries with StarRocks & Paimon

Alibaba Cloud Big Data AI Platform

Feb 19, 2025 · Databases

How Alibaba Cloud Elasticsearch Serverless Cuts Log Costs by Over 70%

This article compares Alibaba Cloud Elasticsearch Serverless with self‑built Elasticsearch clusters for log processing, highlighting cost reductions over 70 %, improved performance stability, automatic scaling, and step‑by‑step guidance to activate and configure the serverless service for real‑world workloads.

Cost OptimizationElasticsearchLog Analytics

0 likes · 8 min read

How Alibaba Cloud Elasticsearch Serverless Cuts Log Costs by Over 70%

Alibaba Cloud Native

Dec 26, 2024 · Cloud Native

How to Perform Cross‑Project Log Queries with Alibaba Cloud SLS StoreView

This article explains how Alibaba Cloud's SLS StoreView feature enables cross‑project log aggregation, isolation, enrichment, and analysis by creating virtual logstores, demonstrating setup steps, SPL‑based data enrichment, meta‑column handling, and column compatibility through detailed examples and screenshots.

Cross-Project QueryData EnrichmentLog Analytics

0 likes · 10 min read

How to Perform Cross‑Project Log Queries with Alibaba Cloud SLS StoreView

Alibaba Cloud Observability

Dec 24, 2024 · Cloud Native

How the New SLS SQL Engine Boosts Big Data Queries by Up to 10×

Alibaba Cloud’s SLS SQL engine has been completely rebuilt, leveraging C++ SIMD, compute‑storage fusion, fine‑grained parallel pipelines, and advanced caching, delivering up to three‑fold raw performance gains, halving latency, and dramatically accelerating high‑cardinality, incremental, and join queries across trillion‑row log datasets.

Log Analytics

0 likes · 12 min read

How the New SLS SQL Engine Boosts Big Data Queries by Up to 10×

Alibaba Cloud Native

Dec 19, 2024 · Big Data

Boosting SLS SQL: 3× Faster Queries on Trillion‑Row Logs

Alibaba Cloud’s Serverless Log Service (SLS) has overhauled its SQL engine with a C++‑based compute engine, SIMD acceleration, storage‑compute fusion, and optimized scheduling, delivering up to three‑fold speed gains, 50% latency reduction, and significant improvements across high‑cardinality, JSON, IP, and join queries.

Big DataLog AnalyticsSQL

0 likes · 12 min read

Boosting SLS SQL: 3× Faster Queries on Trillion‑Row Logs

Alibaba Cloud Observability

May 29, 2024 · Big Data

How SPL Boosts iLogtail 2.0: Combining Performance and Flexibility in Log Processing

This article traces the evolution of streaming processing languages, compares iLogtail's native and extended pipeline modes, and demonstrates how the new SPL syntax in iLogtail 2.0 delivers high‑performance, flexible log and time‑series data processing with unified, SQL‑like commands and interactive debugging tools.

Log AnalyticsSPLdata pipelines

0 likes · 13 min read

How SPL Boosts iLogtail 2.0: Combining Performance and Flexibility in Log Processing

MaGe Linux Operations

Jan 3, 2024 · Big Data

ClickHouse vs Elasticsearch: Faster, Cheaper Log Analytics Explained

This article compares ClickHouse and Elasticsearch for log analytics, highlighting ClickHouse's superior write throughput, query speed, and lower server costs, then provides a detailed, cost‑effective deployment guide covering Zookeeper, Kafka, FileBeat, ClickHouse installation, and visualization with ClickVisual, plus optimization tips.

Big DataClickHouseDeployment

0 likes · 15 min read

ClickHouse vs Elasticsearch: Faster, Cheaper Log Analytics Explained

Efficient Ops

Dec 27, 2023 · Big Data

Why ClickHouse Beats Elasticsearch for Log Analytics – Performance, Cost & Deployment

This article compares ClickHouse and Elasticsearch for log analytics, highlighting ClickHouse’s superior write throughput, query speed, and lower server costs, then details a cost‑effective deployment architecture—including Zookeeper, Kafka, FileBeat, and ClickHouse setup—and shares optimization tips and visualization using ClickVisual.

Big DataClickHouseElasticsearch

0 likes · 13 min read

Why ClickHouse Beats Elasticsearch for Log Analytics – Performance, Cost & Deployment

DataFunTalk

Dec 13, 2023 · Databases

SelectDB Boosts GuanceDB Observability: Architecture Upgrade, Cost Reduction, and Performance Gains

This article details how SelectDB’s inverted‑index, Variant data type, and sampling capabilities were integrated into GuanceDB to replace Elasticsearch, achieving up to 70% storage cost reduction, 2‑4× query speed improvement, and a ten‑fold overall cost‑performance boost for log analytics and observability workloads.

Cloud NativeLog AnalyticsObservability

0 likes · 20 min read

SelectDB Boosts GuanceDB Observability: Architecture Upgrade, Cost Reduction, and Performance Gains

DataFunTalk

Aug 21, 2023 · Databases

Case Study: Building a Real‑Time Log Data Analysis Platform with Apache Doris at China Unicom

This article describes how China Unicom’s Western Innovation Research Institute designed and deployed a centralized, real‑time log analytics platform using Apache Doris, detailing the migration from Hive and ClickHouse, performance optimizations, storage cost reductions, and the resulting improvements in data ingestion, query speed, and operational efficiency.

Apache DorisBig DataCold‑Hot Data Management

0 likes · 18 min read

Case Study: Building a Real‑Time Log Data Analysis Platform with Apache Doris at China Unicom

Architect

Jul 17, 2023 · Databases

Performance Comparison of Elasticsearch and ClickHouse for Log Search and Analytics

This article compares Elasticsearch and ClickHouse by describing their architectures, presenting Docker‑based test stacks, showing code snippets for deployment, data ingestion, and queries, and reporting performance results that demonstrate ClickHouse generally outperforms Elasticsearch in log‑analytics scenarios.

ClickHouseDockerElasticsearch

0 likes · 12 min read

Performance Comparison of Elasticsearch and ClickHouse for Log Search and Analytics

ITPUB

May 15, 2023 · Big Data

Why ClickHouse Outperforms Elasticsearch in Log Analytics: A Practical Comparison

This article compares Elasticsearch and ClickHouse for log analytics by detailing their architectures, setting up Docker‑Compose stacks, ingesting synthetic syslog data with Vector, running equivalent queries, and measuring performance, revealing ClickHouse’s superior speed in most scenarios.

ClickHouseDockerElasticsearch

0 likes · 13 min read

Why ClickHouse Outperforms Elasticsearch in Log Analytics: A Practical Comparison

DataFunTalk

May 9, 2023 · Databases

High‑Performance Inverted Index in Apache Doris for Log Data Storage and Analysis

This article explains how Apache Doris implements a high‑performance, column‑oriented inverted index to address the challenges of massive, real‑time log data storage and analysis, delivering dramatically higher write throughput, lower storage costs, and faster query performance than traditional Elasticsearch and Loki solutions.

Apache DorisBig DataLog Analytics

0 likes · 19 min read

High‑Performance Inverted Index in Apache Doris for Log Data Storage and Analysis

Efficient Ops

May 7, 2023 · Databases

Elasticsearch vs ClickHouse: Performance Comparison for Log Analytics

This article compares Elasticsearch and ClickHouse as log‑analytics solutions, detailing their architectures, node roles, data ingestion pipelines, query capabilities, and benchmark results, ultimately showing ClickHouse’s superior performance in most tested scenarios.

ClickHouseDockerElasticsearch

0 likes · 13 min read

Elasticsearch vs ClickHouse: Performance Comparison for Log Analytics

Alibaba Cloud Developer

Mar 16, 2023 · Big Data

How SLS’s Schema‑on‑Read Scanning Boosts Log Analytics Flexibility and Cuts Costs

This article explains the motivation, design, and implementation of Alibaba Cloud's SLS Schema‑on‑Read scanning mode, showing how it enables SQL analysis on raw log data without pre‑built indexes, improves flexibility for evolving schemas, and reduces storage and index costs in various log‑analysis scenarios.

Big DataColumnar StorageCost Optimization

0 likes · 27 min read

How SLS’s Schema‑on‑Read Scanning Boosts Log Analytics Flexibility and Cuts Costs

DataFunTalk

Jul 15, 2022 · Cloud Computing

Alibaba Cloud Elasticsearch Log Scenario Best Practices, Engine Optimizations, and Performance Evaluation

This article presents a comprehensive overview of Alibaba Cloud Elasticsearch for log analytics, detailing cluster characteristics, common pain points, five key optimization techniques—including cold/hot resource sharing and indexing service—followed by engine kernel improvements, performance benchmarks, and a step‑by‑step product demonstration.

ElasticsearchIndexing ServiceLog Analytics

0 likes · 11 min read

Alibaba Cloud Elasticsearch Log Scenario Best Practices, Engine Optimizations, and Performance Evaluation

Volcano Engine Developer Services

Mar 26, 2022 · Cloud Native

Cloud‑Native Innovations: Multi‑Tenant Kubernetes, Observability, and High‑Performance Storage

The Volcano Engine Developer Community Meetup on March 26 featured four senior engineers presenting lightweight multi‑tenant Kubernetes solutions, practical cloud‑native observability techniques, NVMe over Fabrics storage virtualization, and a comprehensive log collection and analysis platform for cloud‑native environments.

KubernetesLog AnalyticsStorage Virtualization

0 likes · 4 min read

Cloud‑Native Innovations: Multi‑Tenant Kubernetes, Observability, and High‑Performance Storage

Selected Java Interview Questions

Sep 15, 2021 · Big Data

Performance and Feature Comparison between Elasticsearch and ClickHouse for Log Analytics

This article compares Elasticsearch and ClickHouse in terms of architecture, query capabilities, and performance for log analytics, presenting test setups, Docker‑compose configurations, query examples, and benchmark results that show ClickHouse generally outperforms Elasticsearch in most basic query scenarios.

ClickHouseElasticsearchLog Analytics

0 likes · 12 min read

Performance and Feature Comparison between Elasticsearch and ClickHouse for Log Analytics

Java Interview Crash Guide

Jul 21, 2021 · Big Data

Why ClickHouse Outperforms Elasticsearch in Log Search: A Practical Benchmark

This article compares Elasticsearch and ClickHouse for log analytics, detailing their architectures, presenting a Docker‑Compose test setup that streams synthetic syslog data to both stacks, executing equivalent queries, measuring response times, and concluding that ClickHouse generally delivers faster performance, especially for aggregations.

ClickHouseElasticsearchLog Analytics

0 likes · 10 min read

Why ClickHouse Outperforms Elasticsearch in Log Search: A Practical Benchmark

Java High-Performance Architecture

Jul 13, 2021 · Databases

Elasticsearch vs ClickHouse: Which Delivers Faster Log Search?

This article compares Elasticsearch and ClickHouse for log analytics, detailing their architectures, node roles, query capabilities, and performance through Docker‑Compose stacks and synthetic syslog data, concluding that ClickHouse generally outperforms Elasticsearch in speed and aggregation efficiency.

ClickHouseColumnar DatabaseElasticsearch

0 likes · 11 min read

Elasticsearch vs ClickHouse: Which Delivers Faster Log Search?

Architecture Digest

Jul 11, 2021 · Big Data

Performance Comparison of Elasticsearch and ClickHouse for Log Analytics

This article compares Elasticsearch and ClickHouse as log analytics solutions, detailing their architectures, deployment configurations, query capabilities, and performance benchmarks across various query types, and demonstrates that ClickHouse generally outperforms Elasticsearch in speed and aggregation efficiency.

ClickHouseDocker ComposeElasticsearch

0 likes · 13 min read

Performance Comparison of Elasticsearch and ClickHouse for Log Analytics

dbaplus Community

Apr 29, 2021 · Operations

How 58.com Scaled Elasticsearch: Cluster Optimization, Automation, and Real‑World Practices

This article details 58.com’s journey with Elasticsearch, covering the challenges of disparate deployments, common problems like disk exhaustion and write slowdown, the governance and automation platform they built, development standards, service architecture, real‑world application cases, and future plans for version upgrades and intelligent diagnostics.

Cluster ManagementElasticsearchIndex Lifecycle

0 likes · 19 min read

How 58.com Scaled Elasticsearch: Cluster Optimization, Automation, and Real‑World Practices

Tencent Cloud Developer

Dec 2, 2020 · Big Data

WeChat Pay Log System at Scale: Practices with Hermes

WeChat Pay’s Hermes‑based log system ingests trillions of entries daily, storing petabytes across a 200‑node HDFS cluster with four‑nine availability, while LSM‑style writes, separate inverted indexes and hot‑cold tiering cut memory, disk and cost by up to 70 % and keep 95 % of queries under five seconds.

HDFSHermesLog Analytics

0 likes · 7 min read

WeChat Pay Log System at Scale: Practices with Hermes

Alibaba Cloud Developer

Oct 11, 2020 · Operations

How Alibaba’s SLS Powers a Unified Observability Platform for Massive Data

Alibaba Cloud’s Log Service (SLS) has evolved into a unified observability middle‑platform that handles tens of petabytes daily, offering integrated storage, processing, and AI‑driven analysis for logs, metrics, and traces, while addressing challenges of data ingestion, performance, and scalability across diverse Ops scenarios.

Big DataLog AnalyticsObservability

0 likes · 16 min read

How Alibaba’s SLS Powers a Unified Observability Platform for Massive Data

dbaplus Community

Sep 28, 2020 · Databases

How ClickHouse Outperformed Elasticsearch for Ctrip’s Log Analytics: Speed, Cost & Ops

Facing growing log volumes and high Elasticsearch costs, Ctrip migrated its 200 TB daily logs to ClickHouse, achieving up to 38× faster queries, 60 % lower server resources, and simplified operations through columnar storage, sharding, and custom dashboards, while detailing deployment, tuning, and common pitfalls.

ClickHouseElasticsearchLog Analytics

0 likes · 14 min read

How ClickHouse Outperformed Elasticsearch for Ctrip’s Log Analytics: Speed, Cost & Ops

Suning Technology

Aug 29, 2020 · Artificial Intelligence

How AI Powers Large‑Scale Time Series Forecasting and Root‑Cause Analysis

This article describes Suning's AI‑driven end‑to‑end solution for massive time‑series monitoring, anomaly detection, forecasting with DeepAR, MQ‑RNN, MQ‑CNN, ensemble methods, root‑cause localization using Hotspot and Monte‑Carlo Tree Search, and the evolution of its large‑scale log analytics platform.

Deep LearningKnowledge GraphLog Analytics

0 likes · 17 min read

How AI Powers Large‑Scale Time Series Forecasting and Root‑Cause Analysis

DataFunTalk

Jul 16, 2020 · Big Data

Elasticsearch Practices and Platform Construction at 58.com

This article details 58.com’s extensive use of Elasticsearch for search, analytics, and log processing, covering cluster optimization challenges, typical issues like disk exhaustion and write slowdown, practical solutions, development standards, ELKB architecture, real‑time log and MySQL slow‑log applications, platform‑as‑a‑service construction, and future roadmap plans.

Cluster ManagementElasticsearchLog Analytics

0 likes · 17 min read

Elasticsearch Practices and Platform Construction at 58.com

Architecture Digest

May 8, 2020 · Big Data

Elasticsearch Adoption Cases in Chinese Companies: JD.com, Ctrip, Qunar, 58.com, Didi and More

This article surveys how major Chinese internet companies such as JD.com, Ctrip, Qunar, 58.com and Didi have adopted Elasticsearch and the Elastic Stack for high‑volume order queries, log analysis, real‑time monitoring, security analytics, and large‑scale distributed search, describing their architecture evolution, shard strategies, and operational practices.

Big DataLog AnalyticsSearch Architecture

0 likes · 16 min read

Elasticsearch Adoption Cases in Chinese Companies: JD.com, Ctrip, Qunar, 58.com, Didi and More

DataFunTalk

Mar 8, 2020 · Big Data

Real-Time Log Monitoring and Alerting System for iQIYI Membership Services

This article describes how iQIYI built a real‑time, multi‑dimensional log monitoring platform using Spark Streaming, Flink, Kafka and Druid to handle billions of logs, improve alerting accuracy, reduce incident response time, and outline future intelligent monitoring enhancements.

DruidFlinkLog Analytics

0 likes · 10 min read

Real-Time Log Monitoring and Alerting System for iQIYI Membership Services

iQIYI Technical Product Team

Mar 6, 2020 · Big Data

Real-Time Log Monitoring and Alerting for iQIYI Membership Services

To support over 100 million iQIYI members, the team rebuilt a real‑time log monitoring platform that gathers access, exception, Nginx and front‑end logs via a Venus‑Agent, streams them through Kafka to Spark Streaming and Flink, stores metrics in Druid, and provides minute‑level host and business alerts, achieving 80 % faster incident investigation, detecting 90 % of member complaints early, and generating more than 4,800 actionable alerts.

Big DataFlinkLog Analytics

0 likes · 11 min read

Real-Time Log Monitoring and Alerting for iQIYI Membership Services

Efficient Ops

Feb 10, 2020 · Big Data

How Tencent Scales Elasticsearch for Massive Log, Search, and Time‑Series Workloads

Tencent leverages Elasticsearch at massive scale across log analytics, search services, and time‑series monitoring, addressing challenges of high availability, low cost, and high performance through kernel optimizations, resource‑aware throttling, cold‑data merging, rollup, caching, and open‑source contributions.

Cost OptimizationElasticsearchLog Analytics

0 likes · 20 min read

How Tencent Scales Elasticsearch for Massive Log, Search, and Time‑Series Workloads

DevOps Cloud Academy

Jan 2, 2020 · Big Data

Introduction, Use Cases, Installation, and Basic Operations of Elasticsearch

This article introduces Elasticsearch as a distributed search and analytics engine, outlines its common application scenarios, provides step‑by‑step installation commands, explains core concepts such as documents and indices, and demonstrates basic indexing, retrieval, bulk processing, and aggregation operations.

DistributedElasticsearchLog Analytics

0 likes · 4 min read

Introduction, Use Cases, Installation, and Basic Operations of Elasticsearch

Efficient Ops

May 30, 2019 · Operations

How to Supercharge Elasticsearch for Massive Log Analytics: Real-World Optimizations

This article examines the unique characteristics of log data, outlines the challenges of using Elasticsearch at scale, and presents practical optimization techniques—including ingestion, mapping, time‑range search, metadata loading, and a custom C++ engine—to dramatically improve performance, stability, and cost efficiency.

BackendElasticsearchLog Analytics

0 likes · 11 min read

How to Supercharge Elasticsearch for Massive Log Analytics: Real-World Optimizations

Youzan Coder

Apr 27, 2019 · Big Data

Recap of Elastic Community Technical Salon: Cluster Management, Multi‑Tenant Practices, and Search Platform Engineering

On April 27, Youzan Technology and the Elastic Chinese community hosted a “starry sky” technical salon where experts from Getui, Ant Financial, Haipai Ke and Youzan presented four talks on large‑cluster proxy management, multi‑tenant ES optimization, search‑platform engineering, and the evolution of Youzan’s log platform, followed by lively Q&A and resource sharing.

Cluster ManagementElasticsearchLog Analytics

0 likes · 6 min read

Recap of Elastic Community Technical Salon: Cluster Management, Multi‑Tenant Practices, and Search Platform Engineering

Ctrip Technology

Oct 17, 2018 · Big Data

Design and Evolution of Ctrip Flight Ticket Log Tracking System

This article describes how Ctrip's flight ticket team built a massive log‑tracking platform using Elasticsearch, Kafka, and Spark, evaluated storage options such as Cassandra and HBase, introduced secondary indexing and hot‑cold data separation, and continuously evolved the architecture to balance resource usage and query performance.

KafkaLog Analyticsarchitecture

0 likes · 7 min read

Design and Evolution of Ctrip Flight Ticket Log Tracking System

ITFLY8 Architecture Home

Feb 19, 2017 · Operations

Building a Scalable ELK Log Analytics Platform at Ctrip: Lessons Learned

This article recounts how Ctrip’s operations team replaced costly commercial tools with an open‑source ELK stack, detailing requirements, architecture, optimizations, and the impressive scale achieved for real‑time log analysis across thousands of servers.

ELKElasticsearchLog Analytics

0 likes · 10 min read

Building a Scalable ELK Log Analytics Platform at Ctrip: Lessons Learned

Efficient Ops

Jan 26, 2016 · Operations

How Real-Time Log Analytics Transforms IT Operations

This article explains IT Operation Analytics (ITOA), its data sources, use cases, evolution of log management, and how a real‑time log search platform can improve monitoring, security, and business analysis for large‑scale IT environments.

Log AnalyticsSecuritymonitoring

0 likes · 13 min read

How Real-Time Log Analytics Transforms IT Operations