Log Analytics | BestHub

Efficient Ops

Dec 27, 2023 · Big Data

Why ClickHouse Beats Elasticsearch for Log Analytics – Performance, Cost & Deployment

This article compares ClickHouse and Elasticsearch for log analytics, highlighting ClickHouse’s superior write throughput, query speed, and lower server costs, then details a cost‑effective deployment architecture—including Zookeeper, Kafka, FileBeat, and ClickHouse setup—and shares optimization tips and visualization using ClickVisual.

Big DataClickHouseCost Optimization

0 likes · 13 min read

Why ClickHouse Beats Elasticsearch for Log Analytics – Performance, Cost & Deployment

DataFunTalk

Dec 13, 2023 · Databases

SelectDB Boosts GuanceDB Observability: Architecture Upgrade, Cost Reduction, and Performance Gains

This article details how SelectDB’s inverted‑index, Variant data type, and sampling capabilities were integrated into GuanceDB to replace Elasticsearch, achieving up to 70% storage cost reduction, 2‑4× query speed improvement, and a ten‑fold overall cost‑performance boost for log analytics and observability workloads.

Cloud NativeDatabaseLog Analytics

0 likes · 20 min read

SelectDB Boosts GuanceDB Observability: Architecture Upgrade, Cost Reduction, and Performance Gains

DataFunTalk

Aug 21, 2023 · Databases

Case Study: Building a Real‑Time Log Data Analysis Platform with Apache Doris at China Unicom

This article describes how China Unicom’s Western Innovation Research Institute designed and deployed a centralized, real‑time log analytics platform using Apache Doris, detailing the migration from Hive and ClickHouse, performance optimizations, storage cost reductions, and the resulting improvements in data ingestion, query speed, and operational efficiency.

Apache DorisBig DataCold‑Hot Data Management

0 likes · 18 min read

Case Study: Building a Real‑Time Log Data Analysis Platform with Apache Doris at China Unicom

Architect

Jul 17, 2023 · Databases

Performance Comparison of Elasticsearch and ClickHouse for Log Search and Analytics

This article compares Elasticsearch and ClickHouse by describing their architectures, presenting Docker‑based test stacks, showing code snippets for deployment, data ingestion, and queries, and reporting performance results that demonstrate ClickHouse generally outperforms Elasticsearch in log‑analytics scenarios.

ClickHouseElasticsearchLog Analytics

0 likes · 12 min read

Performance Comparison of Elasticsearch and ClickHouse for Log Search and Analytics

DataFunTalk

May 9, 2023 · Databases

High‑Performance Inverted Index in Apache Doris for Log Data Storage and Analysis

This article explains how Apache Doris implements a high‑performance, column‑oriented inverted index to address the challenges of massive, real‑time log data storage and analysis, delivering dramatically higher write throughput, lower storage costs, and faster query performance than traditional Elasticsearch and Loki solutions.

Apache DorisBig DataInverted Index

0 likes · 19 min read

High‑Performance Inverted Index in Apache Doris for Log Data Storage and Analysis

Efficient Ops

May 7, 2023 · Databases

Elasticsearch vs ClickHouse: Performance Comparison for Log Analytics

This article compares Elasticsearch and ClickHouse as log‑analytics solutions, detailing their architectures, node roles, data ingestion pipelines, query capabilities, and benchmark results, ultimately showing ClickHouse’s superior performance in most tested scenarios.

ClickHouseElasticsearchLog Analytics

0 likes · 13 min read

Elasticsearch vs ClickHouse: Performance Comparison for Log Analytics

Architect

Apr 23, 2023 · Big Data

Performance Comparison of Elasticsearch and ClickHouse for Log Analytics

This article compares Elasticsearch and ClickHouse by describing their architectures, demonstrating a Docker‑compose test environment, executing equivalent queries via both systems, and presenting performance results that show ClickHouse generally outperforms Elasticsearch in basic search and aggregation scenarios for log data.

ClickHouseElasticsearchLog Analytics

0 likes · 12 min read

Performance Comparison of Elasticsearch and ClickHouse for Log Analytics

DataFunTalk

Jul 15, 2022 · Cloud Computing

Alibaba Cloud Elasticsearch Log Scenario Best Practices, Engine Optimizations, and Performance Evaluation

This article presents a comprehensive overview of Alibaba Cloud Elasticsearch for log analytics, detailing cluster characteristics, common pain points, five key optimization techniques—including cold/hot resource sharing and indexing service—followed by engine kernel improvements, performance benchmarks, and a step‑by‑step product demonstration.

ElasticsearchIndexing ServiceLog Analytics

0 likes · 11 min read

Alibaba Cloud Elasticsearch Log Scenario Best Practices, Engine Optimizations, and Performance Evaluation

Selected Java Interview Questions

Sep 15, 2021 · Big Data

Performance and Feature Comparison between Elasticsearch and ClickHouse for Log Analytics

This article compares Elasticsearch and ClickHouse in terms of architecture, query capabilities, and performance for log analytics, presenting test setups, Docker‑compose configurations, query examples, and benchmark results that show ClickHouse generally outperforms Elasticsearch in most basic query scenarios.

ClickHouseElasticsearchLog Analytics

0 likes · 12 min read

Performance and Feature Comparison between Elasticsearch and ClickHouse for Log Analytics

Architecture Digest

Jul 11, 2021 · Big Data

Performance Comparison of Elasticsearch and ClickHouse for Log Analytics

This article compares Elasticsearch and ClickHouse as log analytics solutions, detailing their architectures, deployment configurations, query capabilities, and performance benchmarks across various query types, and demonstrates that ClickHouse generally outperforms Elasticsearch in speed and aggregation efficiency.

ClickHouseDocker ComposeElasticsearch

0 likes · 13 min read

Tencent Cloud Developer

Dec 2, 2020 · Big Data

WeChat Pay Log System at Scale: Practices with Hermes

WeChat Pay’s Hermes‑based log system ingests trillions of entries daily, storing petabytes across a 200‑node HDFS cluster with four‑nine availability, while LSM‑style writes, separate inverted indexes and hot‑cold tiering cut memory, disk and cost by up to 70 % and keep 95 % of queries under five seconds.

Big DataHDFSHermes

0 likes · 7 min read

WeChat Pay Log System at Scale: Practices with Hermes

DataFunTalk

Jul 16, 2020 · Big Data

Elasticsearch Practices and Platform Construction at 58.com

This article details 58.com’s extensive use of Elasticsearch for search, analytics, and log processing, covering cluster optimization challenges, typical issues like disk exhaustion and write slowdown, practical solutions, development standards, ELKB architecture, real‑time log and MySQL slow‑log applications, platform‑as‑a‑service construction, and future roadmap plans.

Big DataCluster ManagementElasticsearch

0 likes · 17 min read

Elasticsearch Practices and Platform Construction at 58.com

Architecture Digest

May 8, 2020 · Big Data

Elasticsearch Adoption Cases in Chinese Companies: JD.com, Ctrip, Qunar, 58.com, Didi and More

This article surveys how major Chinese internet companies such as JD.com, Ctrip, Qunar, 58.com and Didi have adopted Elasticsearch and the Elastic Stack for high‑volume order queries, log analysis, real‑time monitoring, security analytics, and large‑scale distributed search, describing their architecture evolution, shard strategies, and operational practices.

Big DataElasticsearchLog Analytics

0 likes · 16 min read

Elasticsearch Adoption Cases in Chinese Companies: JD.com, Ctrip, Qunar, 58.com, Didi and More

DataFunTalk

Mar 8, 2020 · Big Data

Real-Time Log Monitoring and Alerting System for iQIYI Membership Services

This article describes how iQIYI built a real‑time, multi‑dimensional log monitoring platform using Spark Streaming, Flink, Kafka and Druid to handle billions of logs, improve alerting accuracy, reduce incident response time, and outline future intelligent monitoring enhancements.

Big DataDruidFlink

0 likes · 10 min read

Real-Time Log Monitoring and Alerting System for iQIYI Membership Services

iQIYI Technical Product Team

Mar 6, 2020 · Big Data

Real-Time Log Monitoring and Alerting for iQIYI Membership Services

To support over 100 million iQIYI members, the team rebuilt a real‑time log monitoring platform that gathers access, exception, Nginx and front‑end logs via a Venus‑Agent, streams them through Kafka to Spark Streaming and Flink, stores metrics in Druid, and provides minute‑level host and business alerts, achieving 80 % faster incident investigation, detecting 90 % of member complaints early, and generating more than 4,800 actionable alerts.

Big DataDruidFlink

0 likes · 11 min read

Real-Time Log Monitoring and Alerting for iQIYI Membership Services

Efficient Ops

Feb 10, 2020 · Big Data

How Tencent Scales Elasticsearch for Massive Log, Search, and Time‑Series Workloads

Tencent leverages Elasticsearch at massive scale across log analytics, search services, and time‑series monitoring, addressing challenges of high availability, low cost, and high performance through kernel optimizations, resource‑aware throttling, cold‑data merging, rollup, caching, and open‑source contributions.

Cost OptimizationElasticsearchHigh Availability

0 likes · 20 min read

How Tencent Scales Elasticsearch for Massive Log, Search, and Time‑Series Workloads

DevOps Cloud Academy

Jan 2, 2020 · Big Data

Introduction, Use Cases, Installation, and Basic Operations of Elasticsearch

This article introduces Elasticsearch as a distributed search and analytics engine, outlines its common application scenarios, provides step‑by‑step installation commands, explains core concepts such as documents and indices, and demonstrates basic indexing, retrieval, bulk processing, and aggregation operations.

Bulk APIDistributedElasticsearch

0 likes · 4 min read

Introduction, Use Cases, Installation, and Basic Operations of Elasticsearch

Efficient Ops

May 30, 2019 · Operations

How to Supercharge Elasticsearch for Massive Log Analytics: Real-World Optimizations

This article examines the unique characteristics of log data, outlines the challenges of using Elasticsearch at scale, and presents practical optimization techniques—including ingestion, mapping, time‑range search, metadata loading, and a custom C++ engine—to dramatically improve performance, stability, and cost efficiency.

ElasticsearchLog AnalyticsSearch Engine

0 likes · 11 min read

How to Supercharge Elasticsearch for Massive Log Analytics: Real-World Optimizations

Youzan Coder

Apr 27, 2019 · Big Data

Recap of Elastic Community Technical Salon: Cluster Management, Multi‑Tenant Practices, and Search Platform Engineering

On April 27, Youzan Technology and the Elastic Chinese community hosted a “starry sky” technical salon where experts from Getui, Ant Financial, Haipai Ke and Youzan presented four talks on large‑cluster proxy management, multi‑tenant ES optimization, search‑platform engineering, and the evolution of Youzan’s log platform, followed by lively Q&A and resource sharing.

Cluster ManagementElasticsearchLog Analytics

0 likes · 6 min read

Recap of Elastic Community Technical Salon: Cluster Management, Multi‑Tenant Practices, and Search Platform Engineering

Ctrip Technology

Oct 17, 2018 · Big Data

Design and Evolution of Ctrip Flight Ticket Log Tracking System

This article describes how Ctrip's flight ticket team built a massive log‑tracking platform using Elasticsearch, Kafka, and Spark, evaluated storage options such as Cassandra and HBase, introduced secondary indexing and hot‑cold data separation, and continuously evolved the architecture to balance resource usage and query performance.

ArchitectureBig DataETL

0 likes · 7 min read

Design and Evolution of Ctrip Flight Ticket Log Tracking System