BestHub
Sign in
Tagged articles

Elasticsearch

1257 articles · Page 12 of 13
Fangduoduo Tech
Fangduoduo Tech
May 25, 2019 · Backend Development

How Fangdd Scales Real‑Estate Search with Elasticsearch: Architecture & Lessons

This article explains how Fangdd leverages Elasticsearch to boost search performance across consumer, broker, and internal products, detailing a platformized architecture that separates indexing and querying, addresses operational challenges, and outlines design patterns for index management and incremental updates.

ElasticsearchIndexingPlatform design
0 likes · 12 min read
How Fangdd Scales Real‑Estate Search with Elasticsearch: Architecture & Lessons
Tencent Cloud Developer
Tencent Cloud Developer
May 24, 2019 · Cloud Computing

How Tencent Cloud Elasticsearch Enables Multi‑AZ Disaster Recovery

Tencent Cloud Elasticsearch now supports cross‑availability‑zone deployment, requiring even‑numbered data nodes, dedicated master nodes, and replica settings to ensure continuous service when a zone fails, with detailed steps for quick setup and region limitations explained.

Cloud ComputingElasticsearchMulti‑AZ
0 likes · 6 min read
How Tencent Cloud Elasticsearch Enables Multi‑AZ Disaster Recovery
dbaplus Community
dbaplus Community
May 21, 2019 · Big Data

How to Supercharge Elasticsearch Queries on Billions of Records

This article explains why Elasticsearch can be slow on massive datasets, then details practical techniques—leveraging filesystem cache, pre‑heating hot data, separating hot and cold indices, designing lean document models, and avoiding deep pagination—to achieve sub‑second query performance at billions‑scale.

Big DataElasticsearchPagination
0 likes · 11 min read
How to Supercharge Elasticsearch Queries on Billions of Records
macrozheng
macrozheng
May 20, 2019 · Backend Development

Integrating Elasticsearch with Spring Boot for Full-Text Product Search

This guide walks through installing Elasticsearch and Kibana, configuring a Chinese analyzer, defining Spring Data Elasticsearch annotations, creating repository and service layers, building a REST controller, and testing product search functionality within a Spring Boot mall application.

ElasticsearchFull-text SearchJava
0 likes · 14 min read
Integrating Elasticsearch with Spring Boot for Full-Text Product Search
dbaplus Community
dbaplus Community
May 9, 2019 · Databases

Exporting Redis Slowlog to Elasticsearch with a Customized rsbeat

This guide explains how to overcome Redis slowlog retention limits by modifying rsbeat to collect and ship slowlog entries—including sentinel and cluster support—to Elasticsearch, where Kibana can be used for detailed analysis and visualization.

BeatsDatabase MonitoringElasticsearch
0 likes · 7 min read
Exporting Redis Slowlog to Elasticsearch with a Customized rsbeat
Efficient Ops
Efficient Ops
May 9, 2019 · Operations

Master ELK Log Processing: Encoding, Multiline, Grok, and Performance Tuning

This article compiles practical ELK knowledge, covering character‑set conversion, removing unwanted log lines, Grok pattern handling for multi‑line logs, multiline plugin usage in Filebeat and Logstash, date filtering, log type classification, performance optimization, Redis buffering, and Elasticsearch node tuning.

ELKElasticsearchFilebeat
0 likes · 16 min read
Master ELK Log Processing: Encoding, Multiline, Grok, and Performance Tuning
Tencent Cloud Developer
Tencent Cloud Developer
May 7, 2019 · Databases

A New Era of Cluster Coordination in Elasticsearch 7.0

Elasticsearch 7.0 replaces Zen Discovery with an automatic, quorum‑based cluster‑coordination subsystem that elects master‑eligible nodes, simplifies bootstrapping via cluster.initial_master_nodes, supports safe rolling upgrades, and provides robust fault tolerance through a consensus protocol similar to Paxos or Raft.

7.0Cluster CoordinationElasticsearch
0 likes · 18 min read
A New Era of Cluster Coordination in Elasticsearch 7.0
macrozheng
macrozheng
May 5, 2019 · Backend Development

Essential Resources to Master the Technologies Behind a Mall Project

This guide compiles must‑read books and tutorials on Spring, Spring Boot, MyBatis, MySQL, Linux, Elasticsearch, MongoDB, Docker and related tools, helping developers quickly acquire the knowledge needed to build and deploy a complex e‑commerce mall application.

DockerElasticsearchLearning Resources
0 likes · 5 min read
Essential Resources to Master the Technologies Behind a Mall Project
macrozheng
macrozheng
May 4, 2019 · Backend Development

Explore the Full‑Featured Mall E‑Commerce System Built with Spring Boot & MyBatis

The Mall project is a comprehensive e‑commerce solution featuring a front‑end storefront and back‑office management, implemented with Spring Boot, MyBatis, and a suite of modern technologies such as Redis, Elasticsearch, RabbitMQ, Docker, and more, offering modules for products, orders, marketing, and analytics.

DockerElasticsearchE‑commerce
0 likes · 4 min read
Explore the Full‑Featured Mall E‑Commerce System Built with Spring Boot & MyBatis
Tencent Cloud Developer
Tencent Cloud Developer
Apr 29, 2019 · Operations

Introduction to Elastic Stack and Building an Automated Log Monitoring System

This guide explains how to combine Tencent Cloud Elasticsearch with the Elastic Stack—Filebeat, Logstash, and Kibana—to automatically collect JSON‑formatted logs from development workflows, route them to dynamically created indices, and visualize status dashboards, while highlighting best‑practice tips for schema design, deduplication, and future scaling.

BeatsElastic StackElasticsearch
0 likes · 6 min read
Introduction to Elastic Stack and Building an Automated Log Monitoring System
Youzan Coder
Youzan Coder
Apr 27, 2019 · Big Data

Recap of Elastic Community Technical Salon: Cluster Management, Multi‑Tenant Practices, and Search Platform Engineering

On April 27, Youzan Technology and the Elastic Chinese community hosted a “starry sky” technical salon where experts from Getui, Ant Financial, Haipai Ke and Youzan presented four talks on large‑cluster proxy management, multi‑tenant ES optimization, search‑platform engineering, and the evolution of Youzan’s log platform, followed by lively Q&A and resource sharing.

Cluster ManagementElasticsearchLog Analytics
0 likes · 6 min read
Recap of Elastic Community Technical Salon: Cluster Management, Multi‑Tenant Practices, and Search Platform Engineering
Efficient Ops
Efficient Ops
Apr 21, 2019 · Backend Development

Mastering Elasticsearch: From Inverted Index to Distributed Search

This article walks through the fundamentals of search engines, explaining inverted indexes, the explosion of index size, core Elasticsearch concepts, its distributed architecture, and how it powers the ELK stack for log analysis, all illustrated with clear diagrams and examples.

ELKElasticsearchbackend
0 likes · 6 min read
Mastering Elasticsearch: From Inverted Index to Distributed Search
JD Retail Technology
JD Retail Technology
Apr 18, 2019 · Big Data

Data Heterogeneity with BinLake, Binlog, and Flink: Approaches for Order, Subscription, and Product Data

The article explains how data heterogeneity is achieved using JD's BinLake to capture MySQL binlogs, with Flink handling sequential and parallel consumption for order, subscription, and product data, discussing challenges such as ordering guarantees, idempotency, IO overhead, and the shift toward stream‑processing architectures.

ElasticsearchFlinkStream Processing
0 likes · 5 min read
Data Heterogeneity with BinLake, Binlog, and Flink: Approaches for Order, Subscription, and Product Data
Youzan Coder
Youzan Coder
Apr 17, 2019 · Big Data

Order Data Synchronization Architecture at YouZan: From MySQL to ES and HBase

YouZan’s order data synchronization moves changes from MySQL through Canal‑parsed binlogs into a message queue, then uses sequential SeqNo‑based optimistic locking and HBase’s column‑version timestamps to guarantee ordering for both single‑ and multi‑table updates, while a Logstash‑style configurable pipeline feeds ES for search and HBase for detail queries, eliminating ordered‑queue bottlenecks and ensuring high‑throughput consistency.

CanalData synchronizationElasticsearch
0 likes · 12 min read
Order Data Synchronization Architecture at YouZan: From MySQL to ES and HBase
dbaplus Community
dbaplus Community
Apr 16, 2019 · Big Data

Scaling Elasticsearch for Billions of Daily Events: Cluster Planning, Routing & Hot‑Warm Tips

This article explains how to handle a real‑time OLAP monitoring platform processing 10‑12 billion daily events and 400 billion yearly records by optimizing Elasticsearch 5.3.3 through cluster planning, storage strategies, index sharding, compression, hot‑warm architecture, routing, index templates, rollover, and cross‑cluster search, providing concrete configurations and code examples.

Big DataCluster PlanningElasticsearch
0 likes · 23 min read
Scaling Elasticsearch for Billions of Daily Events: Cluster Planning, Routing & Hot‑Warm Tips
Programmer DD
Programmer DD
Apr 16, 2019 · Big Data

Solr vs Elasticsearch: Which Full‑Text Search Engine Wins in 2024?

This article explains the fundamentals of full‑text search, compares Solr, Elasticsearch and their underlying Lucene library, discusses when to choose each engine, and provides practical guidance for developers facing unstable search services or needing scalable, distributed indexing solutions.

ElasticsearchFull-text SearchSolr
0 likes · 18 min read
Solr vs Elasticsearch: Which Full‑Text Search Engine Wins in 2024?
Youzan Coder
Youzan Coder
Apr 12, 2019 · Industry Insights

How Youzan Scaled Its Log Platform to Handle Billions of Daily Logs

This article details Youzan's evolution from a simple Flume‑based log collector to a multi‑tenant, Kafka‑buffered, Spark‑processed, HBase‑backed logging architecture that now handles hundreds of billions of log entries per day, highlighting challenges, design decisions, and future improvements.

ElasticsearchHBaseKafka
0 likes · 10 min read
How Youzan Scaled Its Log Platform to Handle Billions of Daily Logs
Youzan Coder
Youzan Coder
Apr 7, 2019 · Industry Insights

How Youzan Scaled Order Search: Hot‑State Indexing and AKF Expansion

This article reviews the evolution of Youzan's order search architecture over two years, detailing challenges from data growth, the creation of a hot‑state index covering half of search traffic, time‑sharded indexes, and the AKF expansion cube that guides multi‑axis scalability.

Big DataElasticsearchSearch Architecture
0 likes · 10 min read
How Youzan Scaled Order Search: Hot‑State Indexing and AKF Expansion
Architecture Talk
Architecture Talk
Jan 8, 2019 · Big Data

Boost Elasticsearch Performance: Bulk API, Gateway & Caching Secrets

This article explains how to dramatically improve Elasticsearch throughput by using the bulk API, tuning bulk request sizes, configuring gateway settings, optimizing cluster state updates, managing caches, leveraging fielddata and doc values, and employing tools like Curator and the Profiler for efficient cluster operations.

Cluster ManagementCuratorElasticsearch
0 likes · 27 min read
Boost Elasticsearch Performance: Bulk API, Gateway & Caching Secrets
Didi Tech
Didi Tech
Jan 7, 2019 · Big Data

Didi's Multi-Cluster Elasticsearch Architecture: Challenges and Practices

Didi transformed its massive single‑cluster Elasticsearch deployment into a transparent multi‑cluster architecture using TribeNode and cross‑cluster search, isolating workloads, reducing fault impact, and achieving five‑fold scale while preserving a single‑cluster appearance for services, despite added configuration complexity and stability challenges.

DidiElasticsearchMulti-Cluster
0 likes · 17 min read
Didi's Multi-Cluster Elasticsearch Architecture: Challenges and Practices
dbaplus Community
dbaplus Community
Jan 3, 2019 · Backend Development

Supercharging Elasticsearch for Billion-Row Queries: Practical Tips

This guide details how to optimize Elasticsearch for handling billions of daily records, covering core Lucene concepts, index and shard configuration, performance‑tuning parameters, and practical testing methods to achieve sub‑second query responses and long‑term data retention.

Big DataElasticsearchIndexing
0 likes · 13 min read
Supercharging Elasticsearch for Billion-Row Queries: Practical Tips
MaGe Linux Operations
MaGe Linux Operations
Dec 30, 2018 · Operations

Step‑by‑Step Guide to Building an ELK Stack on CentOS 6.7

This tutorial walks you through setting up Java, ElasticSearch 2.1.0, Logstash 2.1.1, Kibana 4.3.1, and NGINX on a CentOS 6.7 server, configuring each component, linking them together, and troubleshooting common time‑zone issues so you can visualize logs with Kibana.

CentOSELKElasticsearch
0 likes · 8 min read
Step‑by‑Step Guide to Building an ELK Stack on CentOS 6.7
vivo Internet Technology
vivo Internet Technology
Dec 28, 2018 · Big Data

Running a 400+ Node Elasticsearch Cluster: Architecture, Scaling, and Performance Tuning

Meltwater’s media‑monitoring platform runs a custom Elasticsearch 1.7.6 cluster of over 400 nodes on AWS, handling 200 TB of primary data and 3 million daily documents while serving thousands of complex queries per minute, achieved through careful shard design, master‑node configuration, extensive performance tuning, and automated provisioning.

AWSCluster ManagementElasticsearch
0 likes · 13 min read
Running a 400+ Node Elasticsearch Cluster: Architecture, Scaling, and Performance Tuning
vivo Internet Technology
vivo Internet Technology
Dec 28, 2018 · Cloud Native

Curated Technical Resources for Vivo Mobile Internet (Elasticsearch, Jenkins, Kubernetes, Service Mesh, Big Data, Java, Spring Cloud)

This page curates a collection of high‑quality technical articles and tutorials for developers working within the Vivo Mobile Internet ecosystem, covering Elasticsearch performance and search tuning, Jenkins CI/CD pipelines, Kubernetes scheduling and TensorFlow, service‑mesh resources, SparkSQL big‑data optimizations, Java concurrency, Quick‑App development, and Spring Cloud microservice frameworks.

ElasticsearchJenkinsKubernetes
0 likes · 6 min read
Curated Technical Resources for Vivo Mobile Internet (Elasticsearch, Jenkins, Kubernetes, Service Mesh, Big Data, Java, Spring Cloud)
dbaplus Community
dbaplus Community
Dec 27, 2018 · Operations

How JD Daojia Scaled Its Order Search with a Real‑Time Dual Elasticsearch Cluster

This article details how JD Daojia’s order center migrated from MySQL‑only reads to a multi‑stage Elasticsearch architecture, describing each evolution step, data‑sync strategies, performance pitfalls, and the final real‑time active‑passive cluster that ensures high availability for billions of daily queries.

Cluster ArchitectureElasticsearchdata-sync
0 likes · 14 min read
How JD Daojia Scaled Its Order Search with a Real‑Time Dual Elasticsearch Cluster
Didi Tech
Didi Tech
Dec 26, 2018 · Cloud Native

Top Developer Tools of 2018: A Comprehensive Overview

The 2018 developer‑tool roundup highlights Elasticsearch for log processing, gRPC for high‑performance RPC, the CNCF ecosystem (Kubernetes, Prometheus, etc.), Python’s AI dominance, cross‑platform Mini‑Programs, VSCode’s plugin‑rich IDE, Vue.js front‑end simplicity, GraphQL’s flexible APIs, and notes a shift toward mobile, cloud‑native infrastructure and commercial open‑source licensing.

CNCFElasticsearchPython
0 likes · 9 min read
Top Developer Tools of 2018: A Comprehensive Overview
Ops Development Stories
Ops Development Stories
Dec 21, 2018 · Operations

How to Install Zabbix Server, MySQL, Nginx, PHP, and Elasticsearch on CentOS

This comprehensive tutorial walks you through adding the Zabbix repository, installing Zabbix server and web interface, setting up MySQL 5.7, configuring Nginx and PHP from source, deploying the Zabbix agent, installing Elasticsearch with the head plugin, and finally storing Zabbix history data in Elasticsearch on a CentOS system.

CentOSElasticsearchMonitoring
0 likes · 20 min read
How to Install Zabbix Server, MySQL, Nginx, PHP, and Elasticsearch on CentOS
Qunar Tech Salon
Qunar Tech Salon
Dec 18, 2018 · Big Data

Practical Insights on Deploying and Operating Elasticsearch at Scale

This article shares extensive practical experience from Qunar's large‑scale Elasticsearch deployment, covering suitable use cases, index‑type design, document ID strategies, scaling considerations for index and data volume, hardware sizing, and storage architecture recommendations to help newcomers avoid common pitfalls.

Big DataElasticsearchIndexing
0 likes · 10 min read
Practical Insights on Deploying and Operating Elasticsearch at Scale
Youzan Coder
Youzan Coder
Dec 10, 2018 · Backend Development

How Youzan Scaled Order Export to Millions with ES, HBase, and Config‑Driven Design

This article examines the challenges of Youzan's order export system, describes the migration from PHP‑based scripts to an Elasticsearch and HBase stack, and details the step‑by‑step configuration‑driven refactor—including enum field definitions, Groovy scripts, strategy patterns, plugin architecture, and quality‑assurance practices—that enabled million‑order exports with high performance and stability.

ConfigurationElasticsearchGroovy
0 likes · 13 min read
How Youzan Scaled Order Export to Millions with ES, HBase, and Config‑Driven Design
Sohu Tech Products
Sohu Tech Products
Dec 5, 2018 · Backend Development

Overview of Web Crawler Types and the Architecture of the Mole Crawler System

This article explains the evolution and classification of web crawlers, describes the design and components of the Mole distributed crawler—including scheduler, fetcher, processor, rate‑limiting, URL deduplication, and Elasticsearch storage optimization—and outlines common anti‑anti‑crawling strategies.

ElasticsearchURL deduplicationWeb Crawler
0 likes · 12 min read
Overview of Web Crawler Types and the Architecture of the Mole Crawler System
21CTO
21CTO
Dec 3, 2018 · Operations

How JD Daojia Scaled Its Elasticsearch Cluster to Billions of Docs: Lessons and Pitfalls

This article details JD Daojia's order center Elasticsearch architecture evolution—from a chaotic initial deployment to a real‑time dual‑cluster backup—covering scaling strategies, data synchronization methods, and the practical pitfalls encountered along the way.

Cluster ArchitectureData synchronizationElasticsearch
0 likes · 14 min read
How JD Daojia Scaled Its Elasticsearch Cluster to Billions of Docs: Lessons and Pitfalls
JD Tech
JD Tech
Dec 3, 2018 · Backend Development

Evolution of JD.com Order Center Elasticsearch Cluster Architecture

This article details how JD.com’s order center migrated its Elasticsearch cluster through multiple stages—from an initial unoptimized deployment to a real‑time dual‑cluster backup solution—addressing scalability, reliability, shard tuning, version upgrades, and data synchronization strategies to support billions of documents and hundreds of millions of daily queries.

Cluster ArchitectureData synchronizationElasticsearch
0 likes · 13 min read
Evolution of JD.com Order Center Elasticsearch Cluster Architecture
Dada Group Technology
Dada Group Technology
Nov 30, 2018 · Big Data

Evolution of JD Daojia Order Center Elasticsearch Cluster: Architecture, Scaling, and Lessons Learned

This article details how JD Daojia's order center migrated from MySQL to a multi‑stage Elasticsearch cluster—covering initial deployment, isolation, replica tuning, primary‑secondary setup, real‑time dual‑cluster upgrades, data synchronization methods, and key pitfalls—to achieve massive scalability, high availability, and performance for billions of orders.

Cluster ArchitectureData synchronizationElasticsearch
0 likes · 13 min read
Evolution of JD Daojia Order Center Elasticsearch Cluster: Architecture, Scaling, and Lessons Learned
Beike Product & Technology
Beike Product & Technology
Nov 23, 2018 · Backend Development

Elasticsearch Internals: Distributed Document Storage, Real‑time Search, and Translog Mechanics

This article explains the core Elasticsearch architecture—including shard routing, primary‑replica interaction, document CRUD workflows, multi‑document APIs, segment merging, translog durability, and storage file formats—providing a comprehensive view of how near‑real‑time search is achieved on large‑scale data.

ElasticsearchLuceneSegment Merging
0 likes · 20 min read
Elasticsearch Internals: Distributed Document Storage, Real‑time Search, and Translog Mechanics
vivo Internet Technology
vivo Internet Technology
Nov 16, 2018 · Artificial Intelligence

Efficient Vector Search with Deep Learning Embeddings in Elasticsearch

The article explains how to replace keyword matching with deep‑learning document embeddings in Elasticsearch by applying PCA dimensionality reduction, indexing vectors using Lucene’s KD‑tree structures via a custom plugin, and leveraging FAISS‑style nearest‑neighbour techniques to achieve fast, semantically aware similarity search.

Deep LearningElasticsearchFAISS
0 likes · 7 min read
Efficient Vector Search with Deep Learning Embeddings in Elasticsearch
DataFunTalk
DataFunTalk
Nov 9, 2018 · Backend Development

From Zero to One: Building and Optimizing Search Engines with Elasticsearch – Insights and Case Studies

This article presents a comprehensive overview of constructing a search engine using Elasticsearch, covering architecture components, data read/write mechanisms, shard management, caching strategies, and real‑world case studies that illustrate performance tuning, isolation, and deployment best practices.

ElasticsearchIndexingbackend development
0 likes · 14 min read
From Zero to One: Building and Optimizing Search Engines with Elasticsearch – Insights and Case Studies
JD Tech
JD Tech
Nov 5, 2018 · Operations

Practical Guide to Elasticsearch Monitoring and Operations

This article provides a comprehensive, operations‑focused overview of Elasticsearch monitoring, covering tool selection, key metrics for black‑box and white‑box monitoring, common issues discovered through alerts, and practical optimization recommendations to ensure high availability of ES clusters.

ElasticsearchSREtools
0 likes · 8 min read
Practical Guide to Elasticsearch Monitoring and Operations
360 Quality & Efficiency
360 Quality & Efficiency
Oct 12, 2018 · Backend Development

Automated Testing and Monitoring Solution for DSP Advertising Business

The article outlines a comprehensive automated testing framework for a DSP advertising platform, covering income, interface, and log layers, and detailing the use of protobuf, Pytest, Logstash, ElasticSearch, Jenkins, and Allure to achieve efficient, real‑time quality assurance and continuous integration.

DSPElasticsearchJenkins
0 likes · 8 min read
Automated Testing and Monitoring Solution for DSP Advertising Business
21CTO
21CTO
Oct 12, 2018 · Backend Development

How Elastic’s IPO Mirrors the Rise of Open‑Source Search Engines

The article chronicles Elastic’s journey from a small open‑source search tool to a NYSE‑listed company, explaining Elasticsearch’s technical foundations, its real‑world applications, and what the IPO means for developers and the broader search‑technology ecosystem.

ElasticsearchIPObackend development
0 likes · 10 min read
How Elastic’s IPO Mirrors the Rise of Open‑Source Search Engines
ITPUB
ITPUB
Oct 8, 2018 · Big Data

From Open‑Source Search to a Billion‑Dollar IPO: The Elastic Story

Elastic's NYSE debut, its rapid stock surge, the origins and technical strengths of Elasticsearch, and what the company's public listing means for developers and tech entrepreneurs are explored in detail, highlighting the journey from a personal recipe‑search tool to a global data‑search platform.

ElasticsearchIPOelastic
0 likes · 9 min read
From Open‑Source Search to a Billion‑Dollar IPO: The Elastic Story
Programmer DD
Programmer DD
Oct 6, 2018 · Big Data

Elastic Search IPO: What It Means for Search and Big Data

Elastic announced its IPO on the NYSE under ticker ESTC, highlighting its origins, rapid growth to over 5000 customers worldwide, a $160 million FY2018 revenue, and its Elastic Stack suite that powers search and analytics across industries, while investors celebrated the stock surge.

Big DataElasticsearchIPO
0 likes · 6 min read
Elastic Search IPO: What It Means for Search and Big Data
Ops Development Stories
Ops Development Stories
Oct 3, 2018 · Operations

Master Logstash: Essential Commands and Top Log Collection Plugins

This guide walks through Logstash fundamentals, from creating basic pipelines with input, filter, and output sections to using common plugins such as grok, mutate, date, geoip, multiline, and integrations with NGINX, rsyslog, Redis, and Docker‑based Logspout, providing practical configuration examples and command‑line tips.

DockerElasticsearchGrok
0 likes · 27 min read
Master Logstash: Essential Commands and Top Log Collection Plugins
HomeTech
HomeTech
Sep 25, 2018 · Operations

Design and Implementation of an Integrated Log Collection, Analysis, and Monitoring System

This article describes how a rapidly growing technical team built a unified log system that consolidates program, web access, and slow logs, introduces host‑agent and process‑agent collection, leverages Kafka, Elasticsearch, and Storm for high‑throughput processing, and provides monitoring, alerting, and reporting features to improve reliability and operational efficiency.

Big DataElasticsearchLog Management
0 likes · 20 min read
Design and Implementation of an Integrated Log Collection, Analysis, and Monitoring System
Youzan Coder
Youzan Coder
Sep 14, 2018 · Big Data

Elasticsearch Optimization and Index Splitting Strategies in the Youzan Search System

The Youzan search system uses middleware‑driven Elasticsearch optimizations—segment merging, larger buffers, routing, and rollover—to cut index files and document scans, splits large indices into business‑specific or hot‑cold sub‑indices, and adds asynchronous cross‑datacenter replication with soft‑delete versioning for high‑availability and scalable performance.

ElasticsearchHot/Cold IsolationMiddleware
0 likes · 10 min read
Elasticsearch Optimization and Index Splitting Strategies in the Youzan Search System
System Architect Go
System Architect Go
Sep 3, 2018 · Fundamentals

Understanding Elasticsearch Analyzer, Tokenizer, and Token Filters

This article explains the core components of Elasticsearch's full‑text search analysis—Analyzers, Tokenizers, and Token Filters—detailing their roles, building blocks, built‑in types, and how they combine to customize text processing for effective indexing and querying.

ElasticsearchFull-text SearchToken Filter
0 likes · 5 min read
Understanding Elasticsearch Analyzer, Tokenizer, and Token Filters
Youzan Coder
Youzan Coder
Aug 31, 2018 · Big Data

Evolution of Youzan Search Platform Architecture: From 1.0 to 4.0

The Youzan Search Platform evolved from a simple Elasticsearch cluster in 2015 to a modular, message‑driven architecture with proxy validation, caching, and management tools, and now plans a cloud‑native, Kubernetes‑based 4.0 version that automates data sync, isolates workloads, and scales elastically to support billions of records.

Data IntegrationElasticsearchSearch Architecture
0 likes · 14 min read
Evolution of Youzan Search Platform Architecture: From 1.0 to 4.0
360 Tech Engineering
360 Tech Engineering
Aug 29, 2018 · Operations

Monitoring Elasticsearch Performance: Host‑Level System and Network Metrics, Cluster Health, and Resource Saturation

This article continues the Elasticsearch performance monitoring series by detailing host‑level system and network metrics, cluster health and node availability, resource saturation, and related errors, providing practical guidance on disk space, I/O, CPU, network throughput, file descriptors, HTTP connections, thread pools, caches, pending tasks, and failed GET requests.

ElasticsearchPerformance Monitoringcluster-health
0 likes · 14 min read
Monitoring Elasticsearch Performance: Host‑Level System and Network Metrics, Cluster Health, and Resource Saturation
System Architect Go
System Architect Go
Aug 4, 2018 · Databases

Synchronizing MySQL Data to Elasticsearch: Methods and Practices

This article reviews various approaches for keeping MySQL data in sync with Elasticsearch, including direct business‑layer hooks, independent synchronization via plugins or custom scripts, and real‑time binlog subscription using tools like zongji, while discussing their advantages, drawbacks, and implementation details.

Data synchronizationElasticsearchMySQL
0 likes · 4 min read
Synchronizing MySQL Data to Elasticsearch: Methods and Practices
Youzan Coder
Youzan Coder
Aug 4, 2018 · Databases

Key Takeaways from the 2018 Youzan PaaS Tech Meetup: TiDB, Zankv & Search

The 2018 Youzan PaaS meetup in Hangzhou featured deep dives into TiDB's distributed SQL architecture and performance gains in version 2.1, introduced the open‑source Zankv KV store built on Raft, and shared practical Elasticsearch search‑engine optimizations used at Youzan.

ElasticsearchKV storeTech Meetup
0 likes · 4 min read
Key Takeaways from the 2018 Youzan PaaS Tech Meetup: TiDB, Zankv & Search
iQIYI Technical Product Team
iQIYI Technical Product Team
Aug 3, 2018 · Backend Development

Integrating Spring Data with Elasticsearch: Features, Use Cases, and Repository Loading Mechanism

The article explains how Spring Data provides a unified, Spring‑compatible data‑access layer for relational and NoSQL stores, illustrates its features and typical use cases, and walks through a practical Spring Data Elasticsearch integration—including configuration, entity and repository definitions—and details the dynamic proxy loading mechanism behind Spring Data repositories.

ElasticsearchJavaNoSQL
0 likes · 14 min read
Integrating Spring Data with Elasticsearch: Features, Use Cases, and Repository Loading Mechanism
System Architect Go
System Architect Go
Jul 29, 2018 · Databases

What Is Elasticsearch? Core Concepts and Fundamentals

Elasticsearch is an open‑source, scalable, high‑availability distributed full‑text search engine that operates in near real‑time, using clusters of nodes, indexes, documents, shards and replicas to efficiently store and retrieve large volumes of data.

ClusterElasticsearchFull-text Search
0 likes · 4 min read
What Is Elasticsearch? Core Concepts and Fundamentals
Efficient Ops
Efficient Ops
Jul 22, 2018 · Operations

Essential ELK Stack Tools to Boost Your DevOps Efficiency

This guide presents a comprehensive overview of essential ELK Stack utilities—including head plugins, Kibana, ElasticHD, Cerebro, security extensions, visualization platforms, automation frameworks, and alerting solutions—complete with brief feature descriptions and direct links, helping developers and operations teams select the right tools to enhance development, monitoring, and maintenance efficiency.

ELKElasticsearchKibana
0 likes · 8 min read
Essential ELK Stack Tools to Boost Your DevOps Efficiency
MaGe Linux Operations
MaGe Linux Operations
Jul 19, 2018 · Databases

Master Elasticsearch with Python: From Installation to Advanced Queries

This tutorial walks you through installing Elasticsearch, creating indices, inserting and updating documents, performing searches via REST API, and integrating Elasticsearch into Python applications using both raw HTTP requests and the official Python client, illustrated with practical examples and screenshots.

ElasticsearchNoSQLREST API
0 likes · 11 min read
Master Elasticsearch with Python: From Installation to Advanced Queries
Ctrip Technology
Ctrip Technology
Jul 10, 2018 · Databases

Designing Real‑Time Sharding Index and Replication with Elasticsearch for High‑Performance Order Queries

This article describes how Ctrip's hotel R&D team tackled growing order‑volume challenges by sharding the database, building a real‑time Elasticsearch index, implementing a custom replication pipeline, and applying various write‑ and read‑optimizations to achieve low latency and stable performance.

ElasticsearchReplicationSQL Server
0 likes · 10 min read
Designing Real‑Time Sharding Index and Replication with Elasticsearch for High‑Performance Order Queries
Architecture Digest
Architecture Digest
Jul 9, 2018 · Databases

Elasticsearch Index Design and Sharding Principles

This article outlines practical guidelines for designing Elasticsearch indices, comparing single versus time‑based indexes, detailing mapping settings, shard allocation strategies, and deduplication methods, while providing concrete examples and code snippets for effective search infrastructure management.

Elasticsearchdata modelingindex design
0 likes · 5 min read
Elasticsearch Index Design and Sharding Principles
Beike Product & Technology
Beike Product & Technology
Jun 22, 2018 · Big Data

Beike Zhaofang's 秒X Real‑Time Analytics Platform: Architecture, Implementation, and Use Cases

The article details the design and deployment of the 秒X real‑time analytics platform at Beike Zhaofang, covering its background, Spark Streaming‑based architecture, fast configuration, data processing pipeline, monitoring, visualization, practical applications, and future development plans.

DruidElasticsearchReal-Time Analytics
0 likes · 7 min read
Beike Zhaofang's 秒X Real‑Time Analytics Platform: Architecture, Implementation, and Use Cases
Architecture Digest
Architecture Digest
Jun 15, 2018 · R&D Management

Elasticsearch Team Development Constitution: Principles and Guidelines for Sustainable Software Development

The Elasticsearch Team Development Constitution outlines a comprehensive set of principles and guidelines—covering design philosophy, code quality, interaction etiquette, and organizational responsibilities—to help the rapidly growing project evolve into a reliable, secure, scalable, and user‑friendly distributed search engine.

Elasticsearchcode qualityopen source
0 likes · 19 min read
Elasticsearch Team Development Constitution: Principles and Guidelines for Sustainable Software Development
21CTO
21CTO
May 27, 2018 · Big Data

How to Install Elasticsearch 5.6.9 and Perform Advanced Data Aggregations with Java

This guide walks you through downloading and configuring Elasticsearch 5.6.9, setting system limits, creating indices, inserting and deleting documents, executing complex aggregation queries via HTTP, and integrating Elasticsearch with Java using the Transport client for powerful data analysis.

ElasticsearchInstallationJava
0 likes · 13 min read
How to Install Elasticsearch 5.6.9 and Perform Advanced Data Aggregations with Java
Architecture Digest
Architecture Digest
May 27, 2018 · Big Data

Installing Elasticsearch and Performing Data Aggregation Queries

This article walks through installing Elasticsearch 5.6.9, configuring system limits, creating indices, inserting and deleting documents, executing complex aggregation queries, and integrating Elasticsearch with Java using the TransportClient, providing a practical guide for building analytics on large‑scale data.

AnalyticsBig DataElasticsearch
0 likes · 12 min read
Installing Elasticsearch and Performing Data Aggregation Queries
UCloud Tech
UCloud Tech
Apr 18, 2018 · Big Data

How Elasticsearch Powers Billion‑Record Log Analysis and Full‑Text Search

This article explains how Elasticsearch and the ELK stack address challenges of storing, securing, retrieving, and analyzing massive data volumes by providing distributed real‑time search, log collection, visualization, and even serving as a NoSQL alternative for large‑scale applications.

Big DataELKElasticsearch
0 likes · 7 min read
How Elasticsearch Powers Billion‑Record Log Analysis and Full‑Text Search
MaGe Linux Operations
MaGe Linux Operations
Apr 11, 2018 · Big Data

Master ELK Stack: Install & Configure Elasticsearch, Logstash, Kibana

This step‑by‑step guide walks you through setting up the ELK stack on CentOS 6, covering Elasticsearch repository configuration, Java installation, Elasticsearch tuning, Logstash pipelines, Kibana deployment, Redis integration, and practical log collection for system, Apache, Nginx, and MySQL logs.

ELKElasticsearchInstallation
0 likes · 22 min read
Master ELK Stack: Install & Configure Elasticsearch, Logstash, Kibana
Efficient Ops
Efficient Ops
Apr 8, 2018 · Operations

Why ELK Is the Ultimate Solution for Log Management and Monitoring

This article introduces the ELK stack—Elasticsearch, Logstash, and Kibana—explaining its core components, architecture, comparison with databases and grep, typical use cases across security, networking, and application monitoring, deployment considerations, challenges, SaaS prospects, and recommended learning resources.

ELKElasticsearchLog Management
0 likes · 10 min read
Why ELK Is the Ultimate Solution for Log Management and Monitoring
Ctrip Technology
Ctrip Technology
Mar 8, 2018 · Big Data

Ctrip Wireless APM Platform: Architecture, Metrics, and Technical Details

The article describes the evolution of Ctrip's wireless APM platform from the early UBT-based monitoring to a globally‑oriented, metric‑rich system that processes over 100 billion data points daily using Storm and Elasticsearch, detailing its design, key performance dimensions, data‑volume trade‑offs, and implementation choices.

APMBig DataCtrip
0 likes · 12 min read
Ctrip Wireless APM Platform: Architecture, Metrics, and Technical Details
ThinkingAgent
ThinkingAgent
Jan 31, 2018 · Operations

Step-by-Step ELK Stack Installation and Configuration Guide

This article provides a detailed, command‑line walkthrough for installing Java, Elasticsearch, Logstash, and Kibana on Ubuntu, configuring each component with example configuration files, and verifying the ELK stack works by sending test data and querying the REST API.

ELKElasticsearchInstallation
0 likes · 5 min read
Step-by-Step ELK Stack Installation and Configuration Guide
Hujiang Technology
Hujiang Technology
Jan 29, 2018 · Operations

Design and Implementation of a Low‑Impact Distributed Tracing System for Service Calls

This article describes the background, design goals, architecture, implementation details, and lessons learned from building a low‑overhead, low‑intrusion distributed tracing system using Kafka, Elasticsearch, and OpenTracing to monitor microservice interactions and support performance analysis and DevOps decision‑making.

ElasticsearchKafkaObservability
0 likes · 9 min read
Design and Implementation of a Low‑Impact Distributed Tracing System for Service Calls
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Jan 25, 2018 · Operations

Master Elasticsearch Monitoring: Key System, Cluster, and Resource Metrics Explained

This article expands on Elasticsearch performance monitoring by detailing host‑level system and network metrics, cluster health and node availability, resource saturation, thread‑pool behavior, cache usage, and common error indicators, offering practical guidance for maintaining a stable and efficient search cluster.

ElasticsearchPerformance Monitoringcluster-health
0 likes · 15 min read
Master Elasticsearch Monitoring: Key System, Cluster, and Resource Metrics Explained
Meituan Technology Team
Meituan Technology Team
Jan 12, 2018 · Backend Development

Design and Implementation of Meituan Hotel Full-Chain Log and Trace System

To cope with Meituan Hotel’s exploding micro‑service complexity, the infrastructure team built the Satellite System—combining MTrace and a selective, zero‑intrusion Log4j2‑based logging pipeline that streams enriched logs through Kafka, Storm, Redis and Elasticsearch, delivering second‑level trace‑log queries and six‑month retention, dramatically speeding up debugging.

ElasticsearchKafkaStorm
0 likes · 11 min read
Design and Implementation of Meituan Hotel Full-Chain Log and Trace System
21CTO
21CTO
Jan 6, 2018 · Big Data

Build Your Own Full‑Text Search Engine with Elasticsearch: A Step‑by‑Step Guide

This tutorial walks you through installing Elasticsearch, understanding its core concepts such as nodes, clusters, indexes, documents and types, configuring Chinese analyzers, performing CRUD operations, and executing various search queries with practical command‑line examples.

Chinese AnalyzerElasticsearchFull-text Search
0 likes · 14 min read
Build Your Own Full‑Text Search Engine with Elasticsearch: A Step‑by‑Step Guide
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Dec 26, 2017 · Big Data

Demystifying Elasticsearch: How Clusters Start, Join, and Process Reads/Writes

This article explains Elasticsearch’s core mechanisms, covering the cluster startup sequence, node discovery and election, handling of failed nodes, cluster management APIs, and the detailed read/write processes including coordinating nodes, shard allocation, memory buffering, transaction logs, and query‑then‑fetch execution.

ElasticsearchNode DiscoveryRead/Write
0 likes · 8 min read
Demystifying Elasticsearch: How Clusters Start, Join, and Process Reads/Writes
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Dec 7, 2017 · Operations

How 360’s Private Cloud Powers Elasticsearch: Architecture, Security, and Scaling

This article explains how 360’s Hulk private cloud platform deploys Elasticsearch with a dedicated master architecture, load‑balancing, per‑business isolated clusters, SearchGuard security, dynamic tokenization, self‑service user features, and advanced monitoring to achieve high‑performance, scalable search services.

ElasticsearchMonitoringprivate cloud
0 likes · 6 min read
How 360’s Private Cloud Powers Elasticsearch: Architecture, Security, and Scaling
21CTO
21CTO
Dec 3, 2017 · Operations

Mastering ELK: Choose the Right Log Architecture and Solve Common Issues

This article explains the core components of the ELK stack, compares three typical deployment architectures, and provides practical solutions for multiline log merging, timestamp correction, and module‑based log filtering using Filebeat, Logstash, Kafka, and Kibana.

ELKElasticsearchFilebeat
0 likes · 10 min read
Mastering ELK: Choose the Right Log Architecture and Solve Common Issues
vivo Internet Technology
vivo Internet Technology
Dec 1, 2017 · Databases

Authoritative Guide to Elasticsearch Search Tuning – Rounded Date Queries, Global Ordinals Warmup, and File System Cache Preloading

This third‑part guide for Elasticsearch 5+ shows how rounding date ranges, eagerly loading global ordinals for keyword fields, and pre‑loading index files into the OS cache—each illustrated with curl commands—can improve search latency while requiring careful trade‑offs between cache friendliness, query complexity, and resource usage.

ElasticsearchFile System CacheGlobal Ordinals
0 likes · 8 min read
Authoritative Guide to Elasticsearch Search Tuning – Rounded Date Queries, Global Ordinals Warmup, and File System Cache Preloading
Tencent Database Technology
Tencent Database Technology
Nov 21, 2017 · Operations

Introduction to ELKB: Architecture, Components, and Typical Use Cases of Elasticsearch, Logstash, Kibana, and Beats

The article introduces the ELKB stack—a combination of Elasticsearch, Logstash, Kibana, and Beats—explaining its background, user needs, architecture, component functions, typical scenarios, and the team’s practical implementations for real‑time log and time‑series data processing.

BeatsELKElasticsearch
0 likes · 10 min read
Introduction to ELKB: Architecture, Components, and Typical Use Cases of Elasticsearch, Logstash, Kibana, and Beats
vivo Internet Technology
vivo Internet Technology
Nov 17, 2017 · Big Data

Elasticsearch Search Tuning Guide: Part 2 - Index Optimization, Mapping, Scripts, and Segment Merging

The second part of the Elasticsearch search‑tuning series explains how to pre‑index data, choose appropriate keyword or text mappings, minimize script use by preferring Painless or Lucene expressions, and efficiently force‑merge read‑only indices into single segments for better performance.

Data MappingElasticsearchForce Merge
0 likes · 8 min read
Elasticsearch Search Tuning Guide: Part 2 - Index Optimization, Mapping, Scripts, and Segment Merging
21CTO
21CTO
Nov 11, 2017 · Big Data

How We Built a Scalable Seller Log System with Kafka, Storm, ES & HBase

This article explains the design and implementation of a unified seller‑operation logging platform that uses Kafka for ingestion, Storm for real‑time processing, Elasticsearch for hot‑data search, and HBase for cold‑data storage, detailing the challenges faced and the optimizations applied.

Big DataElasticsearchHBase
0 likes · 12 min read
How We Built a Scalable Seller Log System with Kafka, Storm, ES & HBase
Qunar Tech Salon
Qunar Tech Salon
Nov 10, 2017 · Operations

Building a Private Cloud Elasticsearch Platform with Mesos and Docker

This article describes how the OPS team designed and implemented a private‑cloud Elasticsearch service using Mesos for resource management, Docker containers orchestrated by Marathon, and a suite of monitoring, self‑service configuration, and continuous deployment tools to improve resource utilization and operational efficiency.

DockerElasticsearchMarathon
0 likes · 9 min read
Building a Private Cloud Elasticsearch Platform with Mesos and Docker
vivo Internet Technology
vivo Internet Technology
Nov 3, 2017 · Databases

Elasticsearch Indexing Performance Optimization - Part 3

Part 3 of the Elasticsearch indexing optimization guide advises balancing shard and replica counts, using index aliases, leveraging the Bulk API with appropriately sized batches, dedicating data nodes, and upgrading storage (SSD/RAID 0) while monitoring resources to achieve higher throughput and scalable, reliable clusters.

ElasticsearchIndexingOptimization
0 likes · 21 min read
Elasticsearch Indexing Performance Optimization - Part 3
Efficient Ops
Efficient Ops
Nov 2, 2017 · Operations

Managing Massive Elasticsearch Clusters: Lessons from a 120‑Node Deployment

This article shares practical insights on operating large‑scale Elasticsearch clusters for log analysis, covering use cases, essential tools, hardware choices, node role separation, shard management, hot‑cold data strategies, version upgrades, and key monitoring metrics to ensure stability and performance.

Cluster ManagementElasticsearchHardware Scaling
0 likes · 12 min read
Managing Massive Elasticsearch Clusters: Lessons from a 120‑Node Deployment
dbaplus Community
dbaplus Community
Oct 22, 2017 · Operations

Mastering Elasticsearch Cluster Planning, Configuration, and Monitoring

This article, based on Xu Peng’s Gdevops 2017 talk, details the rationale for choosing Elasticsearch, outlines the overall architecture, provides step‑by‑step OS, JVM, and index parameter settings, and explains comprehensive monitoring strategies to ensure high‑availability and performance of large‑scale ES clusters.

Cluster ConfigurationElasticsearch
0 likes · 14 min read
Mastering Elasticsearch Cluster Planning, Configuration, and Monitoring