BestHub
Sign in
Tagged articles

Elasticsearch

1286 articles · Page 4 of 13
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Jan 14, 2025 · Databases

How to Build a Custom Elasticsearch Query that Sorts by Time Buckets and Relevance

This article walks through creating a custom Elasticsearch 8.x query that first groups documents into time buckets (e.g., within 3 days, 4‑7 days, older) using a pre‑computed time_bucket field, then sorts each bucket by the _score relevance of the content field, covering pipeline definition, mapping, sample data, DSL query, and practical considerations.

Custom SortingDSL queryElasticsearch
0 likes · 11 min read
How to Build a Custom Elasticsearch Query that Sorts by Time Buckets and Relevance
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Jan 13, 2025 · Operations

Top Logstash Interview Questions 11‑20: Answers and Practical Configurations

This article provides concise answers and example configurations for eleven common Logstash interview questions, covering HTTP input/poller plugins, the Split filter, pipeline debugging, performance monitoring with Metricbeat, Grok failure handling, secure communication, multi‑source collection, multiple outputs, differences from Elasticsearch ingest pipelines, and Kibana pipeline management.

ElasticsearchGrokLogstash
0 likes · 7 min read
Top Logstash Interview Questions 11‑20: Answers and Practical Configurations
Programmer1970
Programmer1970
Jan 9, 2025 · Operations

Understanding Elasticsearch Disk Watermarks in 3 Minutes

The article explains Elasticsearch's disk watermark mechanism—low, high, and flood stage thresholds—detailing why they are crucial for preventing data loss and maintaining cluster stability, how they work, how to configure them in elasticsearch.yml, and best‑practice recommendations for monitoring and storage planning.

ConfigurationElasticsearchStorage
0 likes · 5 min read
Understanding Elasticsearch Disk Watermarks in 3 Minutes
macrozheng
macrozheng
Jan 6, 2025 · Backend Development

Discover Elasticvue: A Lightweight Open‑Source GUI for Managing Elasticsearch

This article introduces Elasticvue, a free open‑source Elasticsearch GUI that supports ES 7.x/8.x, explains how to install it via Docker, demonstrates its features such as cluster monitoring, index and shard management, document search, and REST queries using a real e‑commerce project example.

BackendDockerElasticsearch
0 likes · 7 min read
Discover Elasticvue: A Lightweight Open‑Source GUI for Managing Elasticsearch
Architect
Architect
Jan 2, 2025 · Databases

Data Synchronization Strategies Between MySQL and Elasticsearch

This article explains why MySQL alone struggles with large‑scale queries, introduces Elasticsearch as a complementary search engine, and compares several synchronization approaches—including synchronous and asynchronous dual‑write, Logstash, Binlog, Canal, and Alibaba Cloud DTS—detailing their implementations, advantages, disadvantages, and suitable use cases.

BinlogCanalDTS
0 likes · 16 min read
Data Synchronization Strategies Between MySQL and Elasticsearch
JD Tech
JD Tech
Dec 26, 2024 · Databases

Optimizing Query Performance for JD's BIP Procurement System with JED, JimKV, and Elasticsearch

This article details how JD's BIP procurement system tackled massive query‑performance challenges by segmenting order data, leveraging the JED distributed MySQL solution, introducing JimKV for hot‑data caching, and offloading complex searches to Elasticsearch, resulting in dramatically reduced load and faster user experiences.

ElasticsearchJD.combig data
0 likes · 11 min read
Optimizing Query Performance for JD's BIP Procurement System with JED, JimKV, and Elasticsearch
Sohu Tech Products
Sohu Tech Products
Dec 25, 2024 · Operations

Mastering Elasticsearch Query Limits: Tips to Boost Performance

This article explains the five major Elasticsearch query limits—including result size, max clause count, field data, join operations, and query throughput—provides concrete code examples, and offers practical optimization strategies to improve performance and ensure cluster stability.

BackendElasticsearchPerformance Optimization
0 likes · 11 min read
Mastering Elasticsearch Query Limits: Tips to Boost Performance
Su San Talks Tech
Su San Talks Tech
Dec 25, 2024 · Databases

Discover Elasticvue: A Lightweight Yet Powerful Elasticsearch GUI

This guide introduces Elasticvue, a lightweight and powerful Elasticsearch GUI, walks through downloading and installing the tool, configuring clusters, creating and managing indices via both GUI and REST, and demonstrates adding and viewing data with practical code examples.

ElasticsearchGUIelasticvue
0 likes · 5 min read
Discover Elasticvue: A Lightweight Yet Powerful Elasticsearch GUI
Top Architect
Top Architect
Dec 20, 2024 · Databases

Database Optimization, Sharding, and Pagination Issues: Lessons from a Large‑Scale MySQL Deployment

The article shares a senior architect’s experience with large‑scale MySQL tables, discussing why sharding and Elasticsearch were introduced, the pagination bug caused by Sharding‑JDBC, and a comprehensive set of hardware, software, and SQL tuning recommendations, including a full MySQL configuration example.

ElasticsearchMySQLOptimization
0 likes · 14 min read
Database Optimization, Sharding, and Pagination Issues: Lessons from a Large‑Scale MySQL Deployment
Top Architect
Top Architect
Dec 19, 2024 · Databases

MySQL to Elasticsearch Data Synchronization Strategies and Tools

This article examines various methods for synchronizing MySQL data with Elasticsearch, including synchronous and asynchronous dual writes, Logstash pipelines, binlog streaming, and Alibaba Cloud DTS, outlining implementation approaches, advantages, disadvantages, and suitable application scenarios for each solution.

BinlogCanalDTS
0 likes · 15 min read
MySQL to Elasticsearch Data Synchronization Strategies and Tools
MaGe Linux Operations
MaGe Linux Operations
Dec 18, 2024 · Big Data

Mastering ELK Stack: Step-by-Step Installation, Configuration, and Usage

Learn how to install, configure, and operate the ELK stack—Elasticsearch, Logstash, and Kibana—by following detailed steps for preparing servers, setting up each component, tuning performance, deploying plugins, and testing log collection and visualization, enabling efficient log management and analysis.

ELKElasticsearchKibana
0 likes · 18 min read
Mastering ELK Stack: Step-by-Step Installation, Configuration, and Usage
JD Retail Technology
JD Retail Technology
Dec 12, 2024 · Databases

Optimizing Query Performance for JD's BIP Procurement System with JED, JimKV, and Elasticsearch

This article presents a comprehensive case study of how JD's procurement system (BIP) tackled massive data volume and complex query challenges by redesigning data models, introducing heterogeneous storage for inbound orders, leveraging JED and JimKV, and offloading complex searches to Elasticsearch, resulting in dramatically reduced database load and improved user experience.

ElasticsearchJD supply chainJED
0 likes · 11 min read
Optimizing Query Performance for JD's BIP Procurement System with JED, JimKV, and Elasticsearch
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Dec 10, 2024 · Databases

Exploring Domestic Alternatives to Elasticsearch When ES Is Restricted

This article analyzes why organizations are seeking domestic replacements for Elasticsearch due to policy, licensing, and cost constraints, and evaluates several options—including OpenSearch, XunSearch, Lucene/Solr, native database extensions, Milvus, and EasySearch—highlighting their strengths, weaknesses, and suitable scenarios.

EasysearchElasticsearchMilvus
0 likes · 13 min read
Exploring Domestic Alternatives to Elasticsearch When ES Is Restricted
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Dec 5, 2024 · Databases

Key Elasticsearch Performance Tweaks: Cutting Query Latency from 50 ms to Under 1 ms

In a micro‑service that uses Elasticsearch to fetch product listings, a series of targeted optimizations—including shard reduction, segment merging, keyword mapping, request‑cache activation, and PIT‑based sorting—slashed query latency from 50‑60 ms to under 1 ms and boosted throughput to about 50 k queries per second.

ElasticsearchKeyword MappingPIT
0 likes · 11 min read
Key Elasticsearch Performance Tweaks: Cutting Query Latency from 50 ms to Under 1 ms
Programmer1970
Programmer1970
Dec 2, 2024 · Backend Development

Unlock Efficient Search and Storage with Elasticsearch Index Mapping

This article explains Elasticsearch index mapping fundamentals, covering field types such as text, keyword, numeric and date, key index options like analyzer, doc_values, null_value, and multi‑field strategies, and provides concrete code examples and optimization tips for efficient search and storage.

AnalyzersElasticsearchField Types
0 likes · 19 min read
Unlock Efficient Search and Storage with Elasticsearch Index Mapping
Top Architect
Top Architect
Nov 29, 2024 · Databases

Data Synchronization Strategies between MySQL and Elasticsearch

The article explains why MySQL alone struggles with large‑scale, complex queries, introduces Elasticsearch as a complementary search engine, and details multiple synchronization approaches—including synchronous and asynchronous double‑write, Logstash, Binlog, Canal, and Alibaba DTS—along with their advantages, disadvantages, and typical use cases.

CanalDTSElasticsearch
0 likes · 16 min read
Data Synchronization Strategies between MySQL and Elasticsearch
Programmer1970
Programmer1970
Nov 27, 2024 · Operations

Understanding Elasticsearch Thread Pools: Types, Usage, and Tuning

The article explains Elasticsearch's thread‑pool architecture, detailing the Search, Write, Generic, and other specialized pools, their purposes, fixed or cached configurations, optimization guidelines, and how to monitor and adjust them via REST APIs and built‑in tools.

ElasticsearchJava ExecutorThread Pool
0 likes · 7 min read
Understanding Elasticsearch Thread Pools: Types, Usage, and Tuning
Programmer1970
Programmer1970
Nov 25, 2024 · Backend Development

Deep Dive into Elasticsearch Memory Architecture and Optimization

The article explains Elasticsearch's on‑heap and off‑heap memory design, details each memory pool and its management via LRU, describes Lucene's role in off‑heap storage, and provides practical tips for configuring JVM heap size, cache strategies, and monitoring to achieve stable, high‑performance search.

CachingElasticsearchJVM
0 likes · 8 min read
Deep Dive into Elasticsearch Memory Architecture and Optimization
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Nov 25, 2024 · Backend Development

What Elasticsearch Query Limits Should You Know?

This article explains the five major Elasticsearch query limits—including result size, max clause count, field data, join operations, and query throughput—detailing their default values, why they exist, and practical solutions such as using search_after, scroll API, and resource monitoring to keep clusters stable and performant.

Elasticsearchfielddatamax clause count
0 likes · 11 min read
What Elasticsearch Query Limits Should You Know?
21CTO
21CTO
Nov 19, 2024 · Databases

Why Vector Databases Like Milvus Outperform Elasticsearch in Hybrid Search

This article explains how combining dense vector‑based semantic search with traditional keyword matching using a unified vector database such as Milvus delivers superior performance, scalability, and simplicity compared to maintaining separate Elasticsearch and vector‑search stacks.

ElasticsearchMilvusSparse-BM25
0 likes · 9 min read
Why Vector Databases Like Milvus Outperform Elasticsearch in Hybrid Search
Programmer1970
Programmer1970
Nov 17, 2024 · Backend Development

Elasticsearch Scripting Explained: Compute Fields, Custom Scoring, Best Practices

This article provides a comprehensive overview of Elasticsearch scripting, covering its role in dynamic query and indexing calculations, detailed Painless script examples for custom scoring, field generation, and updates, the script execution lifecycle, common use cases, and practical best‑practice recommendations for performance and security.

Custom ScoringElasticsearchPainless
0 likes · 11 min read
Elasticsearch Scripting Explained: Compute Fields, Custom Scoring, Best Practices
Top Architect
Top Architect
Nov 17, 2024 · Databases

Data Synchronization Strategies Between MySQL and Elasticsearch

This article explains why MySQL alone may struggle with large‑scale, complex queries, introduces Elasticsearch as a high‑performance search engine, and compares several synchronization approaches—including synchronous and asynchronous dual‑write, Logstash, Binlog, Canal, and Alibaba Cloud DTS—detailing their advantages, disadvantages, and suitable scenarios.

BinlogCanalDTS
0 likes · 14 min read
Data Synchronization Strategies Between MySQL and Elasticsearch
Su San Talks Tech
Su San Talks Tech
Nov 16, 2024 · Databases

Why MySQL Pagination Slows Down on Large Tables and How to Fix It

This article examines how pagination queries on massive MySQL tables become dramatically slower as the offset grows, defines what constitutes a slow SQL, and presents three practical optimization techniques—including returning only primary keys, range filtering, and using Elasticsearch—to dramatically improve query performance.

ElasticsearchMySQLPerformance
0 likes · 10 min read
Why MySQL Pagination Slows Down on Large Tables and How to Fix It
dbaplus Community
dbaplus Community
Nov 12, 2024 · Databases

How to Query Elasticsearch with SQL: A Step‑by‑Step Guide

This tutorial shows how to use Elasticsearch's built‑in SQL support to run familiar MySQL‑style queries—creating an index, inserting documents, and performing SELECT, WHERE, ORDER BY, GROUP BY, LIMIT, aggregation, date and string functions—making ES data retrieval as easy as relational databases.

Data RetrievalElasticsearchSQL
0 likes · 7 min read
How to Query Elasticsearch with SQL: A Step‑by‑Step Guide
Sohu Tech Products
Sohu Tech Products
Nov 6, 2024 · Operations

Design and Implementation of a Business Operation Log Management System Using Canal and Elasticsearch

The article presents a decoupled business operation log management architecture that uses Alibaba’s Canal to capture MySQL binlog changes, streams them through Kafka, and stores structured before‑and‑after records in Elasticsearch with nested mappings, enabling multi‑table correlation via transaction IDs, visual querying, and reliable rollback without modifying application code.

BackendCanalData Pipeline
0 likes · 12 min read
Design and Implementation of a Business Operation Log Management System Using Canal and Elasticsearch
Programmer1970
Programmer1970
Nov 5, 2024 · Backend Development

RedisSearch vs Elasticsearch: Which Full‑Text Search Engine Fits Your Needs?

The article compares RedisSearch and Elasticsearch across definition, storage model, performance, query capabilities, scalability, ease of integration, and operational considerations, helping readers decide which solution best matches requirements such as real‑time response, data volume, query complexity, and existing tech stacks.

ElasticsearchPerformanceRedisSearch
0 likes · 7 min read
RedisSearch vs Elasticsearch: Which Full‑Text Search Engine Fits Your Needs?
ITPUB
ITPUB
Nov 5, 2024 · Operations

Master EFLK: Deep‑Inspection Guide for Elasticsearch, Filebeat, Logstash & Kibana

This guide presents a comprehensive, step‑by‑step deep‑inspection plan for the EFLK stack, covering Elasticsearch health checks, node performance metrics, shard and index monitoring, Logstash and Kibana validation, DSL query examples, and automated Python‑based metric collection with cron scheduling.

ElasticsearchKibanaLogstash
0 likes · 13 min read
Master EFLK: Deep‑Inspection Guide for Elasticsearch, Filebeat, Logstash & Kibana
Efficient Ops
Efficient Ops
Nov 4, 2024 · Cloud Native

Build an ELK Log Center for Docker Containers in Minutes

This guide walks you through setting up an ELK stack to collect, centralize, and visualize logs from Dockerized applications, covering rsyslog configuration, container deployment for Elasticsearch, Logstash, Kibana, and Nginx, and demonstrates verification via Kibana queries.

DockerELKElasticsearch
0 likes · 5 min read
Build an ELK Log Center for Docker Containers in Minutes
Top Architect
Top Architect
Nov 4, 2024 · Operations

Centralized Log Collection and Monitoring with Filebeat and Graylog

This article explains how to use Filebeat as a lightweight log shipper together with Graylog for centralized log aggregation, storage, and analysis, covering installation, configuration files, Docker deployment, Spring Boot integration, and query techniques for efficient operations monitoring.

DockerElasticsearchFilebeat
0 likes · 18 min read
Centralized Log Collection and Monitoring with Filebeat and Graylog
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Nov 3, 2024 · Big Data

How to Build a Scalable Business Operation Log System with Canal and Elasticsearch

This article walks through the design and implementation of a decoupled, high‑performance business operation log solution that captures MySQL binlog changes via Canal, streams them through Kafka, and stores and queries them in Elasticsearch, addressing challenges such as batch operations, multi‑table transactions, and non‑business data filtering.

BinlogCanalData Pipeline
0 likes · 13 min read
How to Build a Scalable Business Operation Log System with Canal and Elasticsearch
Sohu Tech Products
Sohu Tech Products
Oct 30, 2024 · Operations

Comprehensive EFLK (Elasticsearch, Filebeat, Logstash, Kibana) Deep Inspection and Monitoring Guide

This comprehensive guide details a step‑by‑step deep‑inspection and monitoring strategy for an Elasticsearch‑Filebeat‑Logstash‑Kibana (EFLK) stack, covering cluster health, node and shard metrics, index status, query profiling, Filebeat, Logstash and Kibana validation, DSL query examples, and a Python script for automated metric collection.

EFLKElasticsearchFilebeat
0 likes · 12 min read
Comprehensive EFLK (Elasticsearch, Filebeat, Logstash, Kibana) Deep Inspection and Monitoring Guide
Architect
Architect
Oct 29, 2024 · Databases

Four Pagination Strategies: MySQL LIMIT OFFSET, Primary‑Key Filtering, HasMore Scrolling, and Elasticsearch

This article compares four pagination techniques—MySQL LIMIT OFFSET, LIMIT with primary‑key filtering, HasMore scrolling, and Elasticsearch pagination—explaining their implementations, advantages, drawbacks such as deep‑page performance issues, and recommending appropriate scenarios for each method.

ElasticsearchMySQLPerformance
0 likes · 6 min read
Four Pagination Strategies: MySQL LIMIT OFFSET, Primary‑Key Filtering, HasMore Scrolling, and Elasticsearch
Top Architect
Top Architect
Oct 26, 2024 · Operations

Centralized Log Collection with Filebeat and Graylog

This article explains how to use Filebeat as a lightweight log shipper together with Graylog, Elasticsearch, and MongoDB to collect, process, and visualize logs from multiple environments, including detailed configuration examples, deployment scripts, and integration with Docker and Spring Boot.

DockerElasticsearchFilebeat
0 likes · 19 min read
Centralized Log Collection with Filebeat and Graylog
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Oct 24, 2024 · Backend Development

Full Elasticsearch 8.x Java API Client Code Ready for Immediate Project Use

This article walks through the new features of the Elasticsearch 8.x Java API client, shows how to set up the development environment, initialize the client with HTTPS or API‑key authentication, and provides complete, ready‑to‑run code examples for index creation, document indexing, searching, aggregations, and scripted sorting.

BackendElasticsearchElasticsearch 8.x
0 likes · 15 min read
Full Elasticsearch 8.x Java API Client Code Ready for Immediate Project Use
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Oct 23, 2024 · Cloud Computing

How Elasticsearch Serverless Cuts Log Analysis Costs by 50%

At the 2024 Cloud Xi Conference, Alibaba Cloud expert Jia Xinyu detailed how Elasticsearch Serverless addresses core log‑analysis pain points with out‑of‑the‑box, high‑performance, pay‑as‑you‑go capabilities, delivering significant cost savings and eliminating operational overhead.

Cloud ComputingElasticsearchPerformance
0 likes · 14 min read
How Elasticsearch Serverless Cuts Log Analysis Costs by 50%
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Oct 18, 2024 · Artificial Intelligence

Integrate Alibaba Cloud AI Search with Elasticsearch: A Step‑by‑Step Guide

This tutorial walks you through configuring Elasticsearch’s Open Inference API to connect with Alibaba Cloud AI Search, covering setup of text generation, rerank, sparse and dense vector services, and demonstrates end‑to‑end requests with code examples for building RAG and semantic search applications.

Alibaba Cloud AI SearchElasticsearchInference API
0 likes · 11 min read
Integrate Alibaba Cloud AI Search with Elasticsearch: A Step‑by‑Step Guide
Java Architecture Stack
Java Architecture Stack
Oct 15, 2024 · Backend Development

How to Build Powerful Search, Log, and Recommendation Solutions with Elasticsearch

This guide walks through five real‑world Elasticsearch use cases—including full‑text product search with highlighting, centralized log collection and analysis, personalized video recommendation, price‑range aggregation for e‑commerce, and geo‑location restaurant search—detailing index design, query syntax, Docker setup, and front‑end integration.

Backend DevelopmentElasticsearchPrice Aggregation
0 likes · 35 min read
How to Build Powerful Search, Log, and Recommendation Solutions with Elasticsearch
Senior Tony
Senior Tony
Oct 12, 2024 · Backend Development

When Monolith Meets Microservices: API Composition vs CQRS for Complex Queries

This article compares API composition and CQRS patterns for handling distributed queries in evolving monolithic systems, illustrating their workflows with e‑commerce and online‑education examples, discussing performance trade‑offs, implementation details using Canal and ElasticSearch, and offering practical guidance on when to adopt each approach.

API compositionCQRSCanal
0 likes · 8 min read
When Monolith Meets Microservices: API Composition vs CQRS for Complex Queries
Programmer1970
Programmer1970
Oct 10, 2024 · Databases

Mastering Elasticsearch Aggregations: Metric, Bucket, and Pipeline Queries in Practice

This article explains Elasticsearch aggregation queries, covering metric, bucket, and pipeline aggregations, the role of doc_values and fielddata, multi‑field mapping, practical query examples such as terms, date_histogram, range, nested and pipeline aggregations, as well as sorting techniques and performance optimization tips.

Bucket AggregationElasticsearchMetric Aggregation
0 likes · 15 min read
Mastering Elasticsearch Aggregations: Metric, Bucket, and Pipeline Queries in Practice
macrozheng
macrozheng
Oct 8, 2024 · Databases

Why RediSearch Beats Elasticsearch on Low‑End Servers: A Hands‑On Comparison

This article introduces RediSearch, compares its memory usage and query performance with Elasticsearch on modest hardware, shows installation steps, demonstrates core index commands and Java integration, and concludes with practical advice on using RediSearch as a lightweight full‑text search engine.

ElasticsearchJavaJedis
0 likes · 11 min read
Why RediSearch Beats Elasticsearch on Low‑End Servers: A Hands‑On Comparison
dbaplus Community
dbaplus Community
Sep 24, 2024 · Backend Development

How Ctrip Scaled Its Vacation Product Log System to Billions of Records

This article recounts the evolution of Ctrip's vacation product log platform—from a single‑table DB solution to a platformized ES + HBase architecture—detailing the challenges of massive data volume, the design of RowKey, write and query flows, and the subsequent business and supplier empowerment.

ArchitectureBackendElasticsearch
0 likes · 14 min read
How Ctrip Scaled Its Vacation Product Log System to Billions of Records
Wukong Talks Architecture
Wukong Talks Architecture
Sep 23, 2024 · Backend Development

Evolution of the Ctrip Travel Product Log System: Architecture, Challenges, and Solutions

This article describes the development trajectory of Ctrip's travel product log system, detailing its three major phases—from a single‑table DB approach to a platform‑based solution and finally an empowered version—while discussing technical challenges, design decisions, and the implementation of HBase, Elasticsearch, and related components to handle billions of log entries efficiently.

ArchitectureBackendElasticsearch
0 likes · 15 min read
Evolution of the Ctrip Travel Product Log System: Architecture, Challenges, and Solutions
HelloTech
HelloTech
Sep 20, 2024 · Big Data

Optimizing Elasticsearch Mapping to Reduce High CPU Usage: Challenges, Solutions, and Results

By refactoring the station‑profile index to eliminate over‑indexed and mis‑typed fields—cutting complex types from 282 to 74 and keywords from 67 to 59—the team lowered CPU peaks from 60 % to 50 %, reduced average CPU to 20 %, cut query latency to 150 ms, accelerated Flink sync to 10 minutes, and decommissioned two nodes, achieving substantial performance gains and cost savings.

CPU performanceElasticsearchMapping Optimization
0 likes · 10 min read
Optimizing Elasticsearch Mapping to Reduce High CPU Usage: Challenges, Solutions, and Results
Code Farming
Code Farming
Sep 16, 2024 · Backend Development

Understanding Elasticsearch’s Document Retrieval Process

The article walks through Elasticsearch’s document retrieval workflow, covering single‑document GET, multi‑document mget, the two‑stage query_then_fetch mechanism, shard routing, load balancing, query and fetch phases, collectors, rescore, and pagination optimizations.

ElasticsearchQuery_then_fetchSearch Architecture
0 likes · 19 min read
Understanding Elasticsearch’s Document Retrieval Process
Code Farming
Code Farming
Sep 15, 2024 · Backend Development

How Elasticsearch Indexes Documents: Step‑by‑Step Process

This article walks through Elasticsearch’s document indexing pipeline—from single‑document and bulk request routing, through the write‑refresh‑flush‑merge cycle, to the roles of Lucene, the translog, primary and replica shards, and how reliability, consistency, atomicity, isolation, real‑time visibility and performance are achieved.

Elasticsearchdocument indexingflush
0 likes · 22 min read
How Elasticsearch Indexes Documents: Step‑by‑Step Process
Code Farming
Code Farming
Sep 15, 2024 · Backend Development

Understanding Elasticsearch: Core Principles and Architecture

This article explains Elasticsearch’s overall structure, the underlying Lucene index layout, the indexing and search processing flow, and how built‑in analyzers work, illustrating each concept with diagrams, token examples, and query scenarios.

AnalyzersElasticsearchLucene
0 likes · 10 min read
Understanding Elasticsearch: Core Principles and Architecture
Past Memory Big Data
Past Memory Big Data
Sep 13, 2024 · Backend Development

How Didi Scales Online Search with Elasticsearch: Architecture, Performance, and Stability

The article details Didi's comprehensive use of Elasticsearch across all online retrieval scenarios, covering its physical‑machine architecture, gateway and control layers, data synchronization methods, cross‑datacenter replication, JDK17 + ZGC performance upgrades, cost‑saving ZSTD compression, multi‑tenant isolation, custom security, and ongoing stability practices leading to a planned upgrade to Elasticsearch 8.13.

DidiElasticsearchMulti-tenant Isolation
0 likes · 16 min read
How Didi Scales Online Search with Elasticsearch: Architecture, Performance, and Stability
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Sep 10, 2024 · Artificial Intelligence

Unlocking AI Search with Alibaba Cloud Elasticsearch: Vectors, HNSW & RAG

This article details Alibaba Cloud Elasticsearch's AI search advancements, covering embedding vectors, HNSW-based approximate nearest neighbor search, hardware-accelerated vector engines, sparse vectors, hybrid retrieval, the Inference API, and RAG implementations that together boost performance, efficiency, and relevance for modern AI-driven search applications.

ElasticsearchHNSWRAG
0 likes · 11 min read
Unlocking AI Search with Alibaba Cloud Elasticsearch: Vectors, HNSW & RAG
DataFunSummit
DataFunSummit
Sep 4, 2024 · Artificial Intelligence

How Elasticsearch Powers Retrieval‑Augmented Generation (RAG) Applications

This article explains how Elasticsearch’s advanced search capabilities—including vector and semantic search, hardware acceleration, hybrid retrieval, model re‑ranking, multi‑vector support, and integrated security—enable robust RAG implementations and outlines future directions such as a new compute engine, stronger vector engines, and cloud‑native serverless deployment.

AIElasticsearchModel Re‑ranking
0 likes · 9 min read
How Elasticsearch Powers Retrieval‑Augmented Generation (RAG) Applications
Efficient Ops
Efficient Ops
Sep 1, 2024 · Backend Development

Master Elasticsearch: From Basics to Advanced Performance Tuning

This article walks through Elasticsearch’s licensing history, version selection, installation, cluster health monitoring, shard routing, storage mechanisms, refresh and translog processes, segment merging, and practical performance optimizations such as disk choices, index settings, and JVM tuning.

ClusterElasticsearchPerformance
0 likes · 21 min read
Master Elasticsearch: From Basics to Advanced Performance Tuning
Top Architect
Top Architect
Aug 30, 2024 · Databases

MySQL to Elasticsearch Data Synchronization Strategies and Tools

This article examines various methods for synchronizing MySQL data with Elasticsearch, including synchronous and asynchronous dual‑write, Logstash pipelines, binlog real‑time replication, Canal, and Alibaba Cloud DTS, comparing their architectures, advantages, disadvantages, and suitable application scenarios.

Elasticsearchdata synchronizationdatabases
0 likes · 17 min read
MySQL to Elasticsearch Data Synchronization Strategies and Tools
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Aug 23, 2024 · Artificial Intelligence

How Elasticsearch Evolved into a Hybrid AI-Powered Search Engine

This article traces Elasticsearch's transformation from a pure text search engine to a versatile hybrid platform that integrates structured, geospatial, aggregation, and vector search capabilities, highlighting its AI-driven innovations, performance optimizations, and growing adoption across enterprises and academia.

AI SearchElasticsearchPerformance
0 likes · 13 min read
How Elasticsearch Evolved into a Hybrid AI-Powered Search Engine
Ctrip Technology
Ctrip Technology
Aug 22, 2024 · Backend Development

Evolution of Ctrip Vacation Product Log System: From Single‑Table DB to ES + HBase Platform

This article details the three‑stage evolution of Ctrip's vacation product log system—from a simple single‑table DB approach, through a platform‑based ES + HBase solution, to a scalable V3.0 architecture that improves storage, search, and business empowerment while handling billions of log entries.

BackendData PipelineElasticsearch
0 likes · 16 min read
Evolution of Ctrip Vacation Product Log System: From Single‑Table DB to ES + HBase Platform
High Availability Architecture
High Availability Architecture
Aug 16, 2024 · Big Data

Introduction to Elasticsearch: Core Concepts, Query Types, Pagination, and Data Synchronization

This article provides a comprehensive overview of Elasticsearch, covering its distributed storage architecture, core data model concepts, analysis and query capabilities, practical next‑token pagination techniques, join strategies, and various data synchronization methods for integrating Elasticsearch with other systems.

Elasticsearchbig datadata synchronization
0 likes · 13 min read
Introduction to Elasticsearch: Core Concepts, Query Types, Pagination, and Data Synchronization
Efficient Ops
Efficient Ops
Aug 14, 2024 · Operations

Building a Real-Time Log Monitoring System with ELK, Kafka, and Python

This article details how to construct a log‑monitoring platform using the ELK stack, Kafka buffering, and a Python scheduler to collect, process, and alert on error logs, offering practical configuration tips and performance optimizations for production environments.

ELKElasticsearchKafka
0 likes · 10 min read
Building a Real-Time Log Monitoring System with ELK, Kafka, and Python
MaGe Linux Operations
MaGe Linux Operations
Aug 9, 2024 · Operations

Mastering Elasticsearch Data Sync and Cluster Architecture: Strategies & Best Practices

This article explains how to keep MySQL and Elasticsearch data in sync using synchronous calls, asynchronous notifications, or binlog listeners, and dives deep into Elasticsearch cluster design, node roles, distributed storage, query phases, split‑brain handling, and fault‑tolerance mechanisms.

Distributed QueryElasticsearchcluster architecture
0 likes · 8 min read
Mastering Elasticsearch Data Sync and Cluster Architecture: Strategies & Best Practices
Top Architect
Top Architect
Aug 6, 2024 · Databases

MySQL to Elasticsearch Data Synchronization Strategies and Tools

This article explains various methods for synchronizing MySQL data to Elasticsearch, including synchronous and asynchronous double‑write, Logstash pipelines, binlog‑based real‑time sync, Canal, and Alibaba Cloud DTS, comparing their advantages, disadvantages, and suitable scenarios.

BinlogCanalDTS
0 likes · 16 min read
MySQL to Elasticsearch Data Synchronization Strategies and Tools
Open Source Tech Hub
Open Source Tech Hub
Aug 4, 2024 · Databases

Sync RDS MySQL Data to Alibaba Cloud Elasticsearch with DTS

This guide walks you through using Alibaba Cloud Data Transmission Service (DTS) to continuously synchronize production data from an RDS MySQL instance to an Elasticsearch cluster, covering prerequisites, task creation, verification, Kibana queries, and incremental sync testing.

Alibaba CloudDTSElasticsearch
0 likes · 7 min read
Sync RDS MySQL Data to Alibaba Cloud Elasticsearch with DTS
Open Source Tech Hub
Open Source Tech Hub
Aug 1, 2024 · Databases

How to Sync MySQL Data to Elasticsearch: Strategies, Pros, and Pitfalls

This article explains why MySQL‑Elasticsearch synchronization is needed, compares six practical approaches—including sync write, async write, Logstash, binlog, Canal, and Alibaba Cloud DTS—detailing their implementation methods, advantages, disadvantages, and suitable use cases for large‑scale data environments.

BinlogCanalDTS
0 likes · 13 min read
How to Sync MySQL Data to Elasticsearch: Strategies, Pros, and Pitfalls
Sohu Tech Products
Sohu Tech Products
Jul 31, 2024 · Databases

Elasticsearch ILM Migration Performance Optimization Strategies

To prevent IO saturation during Elasticsearch ILM hot‑to‑cold migrations, the article recommends batching migrations, fine‑tuning max_bytes_per_sec, upgrading cold‑node storage and adding hot nodes, and automating monitoring with scripts that pause or resume ILM based on real‑time utilization thresholds.

Backend DevelopmentElasticsearchILM
0 likes · 7 min read
Elasticsearch ILM Migration Performance Optimization Strategies
Open Source Tech Hub
Open Source Tech Hub
Jul 27, 2024 · Backend Development

Master Elasticsearch with PHP: From Basics to Real‑World Search Implementation

This guide explains why e‑commerce platforms need a high‑performance search engine, introduces Elasticsearch fundamentals, compares it with traditional engines, and provides step‑by‑step PHP code for installing, configuring, indexing, and querying data, complete with practical examples and best‑practice tips.

Backend DevelopmentElasticsearchPHP
0 likes · 9 min read
Master Elasticsearch with PHP: From Basics to Real‑World Search Implementation
Su San Talks Tech
Su San Talks Tech
Jul 26, 2024 · Databases

Mastering MySQL‑to‑Elasticsearch Sync: 4 Strategies & Top Migration Tools

This guide compares four MySQL‑to‑Elasticsearch synchronization methods—synchronous dual‑write, asynchronous MQ‑based dual‑write, timer‑driven SQL extraction, and real‑time Binlog replication—and reviews popular CDC tools such as Canal, Alibaba Cloud DTS, Databus, and others to help you choose the right solution.

BinlogCDCCanal
0 likes · 13 min read
Mastering MySQL‑to‑Elasticsearch Sync: 4 Strategies & Top Migration Tools
Sohu Tech Products
Sohu Tech Products
Jul 17, 2024 · Backend Development

Mastering Elasticsearch: Painless Scripts for Advanced Array Operations

This article provides a step‑by‑step guide on using Elasticsearch’s Painless scripting language to create, index, and manipulate array‑type fields, covering basic operations like length and element access, as well as advanced aggregations, filtering, and weighted calculations, while highlighting performance considerations.

BackendData ProcessingElasticsearch
0 likes · 9 min read
Mastering Elasticsearch: Painless Scripts for Advanced Array Operations
JD Cloud Developers
JD Cloud Developers
Jul 17, 2024 · Databases

Choosing the Right Database: MySQL, Redis, HBase, ClickHouse, MongoDB, Elasticsearch, Neo4j, Prometheus & Milvus Explained

Explore nine major database technologies—from traditional relational MySQL to NoSQL Redis, columnar HBase and ClickHouse, document-oriented MongoDB, search engine Elasticsearch, graph Neo4j, time‑series Prometheus, and vector Milvus—plus practical best‑practice guides, real‑world polyglot persistence scenarios, and recommended resources for mastering modern data storage.

ClickHouseElasticsearchHBase
0 likes · 50 min read
Choosing the Right Database: MySQL, Redis, HBase, ClickHouse, MongoDB, Elasticsearch, Neo4j, Prometheus & Milvus Explained
JD Tech Talk
JD Tech Talk
Jul 17, 2024 · Databases

A Comprehensive Guide to 9 Database Types and Polyglot Persistence

This article provides an in‑depth overview of nine major database categories—including relational, key‑value, columnar, document, graph, time‑series, and vector databases—detailing their strengths, weaknesses, best practices, and typical application scenarios, and explains how polyglot persistence combines multiple databases for optimal performance and scalability.

ClickHouseElasticsearchHBase
0 likes · 41 min read
A Comprehensive Guide to 9 Database Types and Polyglot Persistence
Volcano Engine Developer Services
Volcano Engine Developer Services
Jul 3, 2024 · Backend Development

How We Scaled a Billion‑Item Search Engine with Elasticsearch: From Zero to One

This article details the practical journey of building and scaling an Elasticsearch‑based search system that supports tens of millions to billions of items, covering architecture design, capacity planning, multi‑data‑center deployment, data synchronization via RocketMQ and Flink, and multi‑layer reconciliation to ensure consistency and high QPS.

ElasticsearchFlinkRocketMQ
0 likes · 15 min read
How We Scaled a Billion‑Item Search Engine with Elasticsearch: From Zero to One
JD Tech
JD Tech
Jul 2, 2024 · Big Data

Real‑Time Monitoring Dashboard for Logistics Supply Chain: Architecture, Data Modeling, and Stability Design

This article presents the design and implementation of a high‑availability, real‑time logistics supply‑chain monitoring dashboard, covering its data processing pipeline with Flink, storage choices between Elasticsearch and ClickHouse, multi‑layer architecture, metric consistency, stability mechanisms, extensibility configurations, and monitoring practices.

ClickHouseData PipelineElasticsearch
0 likes · 11 min read
Real‑Time Monitoring Dashboard for Logistics Supply Chain: Architecture, Data Modeling, and Stability Design
Open Source Linux
Open Source Linux
Jul 1, 2024 · Operations

Deploy a Full ELK Stack on a Single Ubuntu Server

This guide walks you through installing Java, Elasticsearch, Kibana, Logstash, and Filebeat on Ubuntu 18.04, configuring a dedicated data disk, adjusting service settings, and testing log collection with a complete script for a compact ELK demo environment.

ELKElasticsearchFilebeat
0 likes · 11 min read
Deploy a Full ELK Stack on a Single Ubuntu Server
Dangbei Technology Team
Dangbei Technology Team
Jun 28, 2024 · Backend Development

Boost Elasticsearch Prefix Search with Edge N‑Gram: A Practical Guide

This article explains how to overcome performance bottlenecks in high‑concurrency Elasticsearch prefix searches by applying an edge‑ngram tokenizer, detailing the problem, configuration steps, analysis results, and query recommendations for faster, more accurate search experiences.

Elasticsearchedge n-gramprefix search
0 likes · 10 min read
Boost Elasticsearch Prefix Search with Edge N‑Gram: A Practical Guide
dbaplus Community
dbaplus Community
Jun 25, 2024 · Databases

How Didi Scales Elasticsearch: Architecture, Performance Tuning, and Cost Optimization

This article details Didi’s use of Elasticsearch 7.6, covering its architecture on physical machines, gateway and control layers, user console features, deployment models, data synchronization strategies, engine iterations such as fine‑grained tiered protection, multi‑active replication, JDK 17/ZGC performance upgrades, cost reductions, multi‑tenant isolation, security enhancements, and future migration to ES 8.13.

DataSyncElasticsearchPerformance
0 likes · 17 min read
How Didi Scales Elasticsearch: Architecture, Performance Tuning, and Cost Optimization
IT Services Circle
IT Services Circle
Jun 24, 2024 · Databases

Understanding Elasticsearch Architecture: Inverted Index, Term Dictionary, Segments, and Distributed Search

This article explains how Elasticsearch transforms simple keyword matching into a high‑performance, scalable search engine by using inverted indexes, term dictionaries, posting lists, term indexes, stored fields, doc values, segments, and distributed node architectures to achieve fast, reliable full‑text search on massive data sets.

ElasticsearchLuceneinverted index
0 likes · 16 min read
Understanding Elasticsearch Architecture: Inverted Index, Term Dictionary, Segments, and Distributed Search
Top Architect
Top Architect
Jun 17, 2024 · Backend Development

High‑Availability Architecture and Performance Optimization for a Large‑Scale Membership System

This article describes how a unified membership system serving billions of users across multiple platforms achieves high performance and high availability through dual‑center Elasticsearch clusters, traffic isolation, deep ES optimizations, Redis caching, dual‑center MySQL partitioning, seamless migration, and fine‑grained flow‑control and degradation strategies.

ElasticsearchPerformance OptimizationRedis
0 likes · 22 min read
High‑Availability Architecture and Performance Optimization for a Large‑Scale Membership System
Zhuanzhuan Tech
Zhuanzhuan Tech
Jun 12, 2024 · Databases

Designing a Scalable Persistence Layer: Sharding, Query Optimization, and Read/Write Splitting

This article shares a practical case study on how a coupon‑distribution system evolved from a single‑table design to a sharded, multi‑database architecture with query optimization, ElasticSearch integration, and read/write splitting to handle growing data volume, complex queries, and increasing request traffic.

ElasticsearchRead-Write Splittingdatabases
0 likes · 12 min read
Designing a Scalable Persistence Layer: Sharding, Query Optimization, and Read/Write Splitting
IT Services Circle
IT Services Circle
Jun 12, 2024 · Databases

MySQL to Elasticsearch Data Synchronization: Strategies and Tool Selection

This article reviews four common MySQL‑to‑Elasticsearch synchronization methods—synchronous dual‑write, asynchronous dual‑write via MQ, timer‑based SQL extraction, and real‑time Binlog replication—evaluates their pros and cons, and compares popular migration tools such as Canal, Alibaba DTS, Databus and others.

BinlogCDCData Migration Tools
0 likes · 11 min read
MySQL to Elasticsearch Data Synchronization: Strategies and Tool Selection
TAL Education Technology
TAL Education Technology
Jun 11, 2024 · Cloud Native

Containerizing Elasticsearch: Architecture Upgrade, API Gateway Integration, and Cloud‑Native Migration

This article details how a large‑scale Elasticsearch deployment was transformed from physical servers to a Kubernetes‑based, containerized architecture, addressing cost, scalability, API compatibility, security, observability, and multi‑cloud migration using the 极限网关 API gateway.

API GatewayCloud NativeElasticsearch
0 likes · 11 min read
Containerizing Elasticsearch: Architecture Upgrade, API Gateway Integration, and Cloud‑Native Migration
MaGe Linux Operations
MaGe Linux Operations
Jun 10, 2024 · Cloud Native

Deploy NFS, ECK, Elasticsearch, Kibana & Filebeat on Kubernetes

This guide walks through installing NFS on all nodes, creating a dynamic storage class with Helm, setting up Elastic Cloud on Kubernetes (ECK) operator, deploying Elasticsearch and Kibana clusters, configuring Filebeat for log collection, and tuning system parameters for a production‑ready Kubernetes environment.

ECKElasticsearchFilebeat
0 likes · 18 min read
Deploy NFS, ECK, Elasticsearch, Kibana & Filebeat on Kubernetes
Su San Talks Tech
Su San Talks Tech
Jun 10, 2024 · Databases

Mastering MySQL‑to‑Elasticsearch Sync: 4 Strategies & Top Migration Tools

This article compares four MySQL‑to‑Elasticsearch synchronization methods—synchronous dual‑write, asynchronous dual‑write, SQL extraction, and Binlog‑based real‑time sync—evaluates their pros and cons, and reviews popular migration tools such as Canal, Alibaba DTS, Databus, Flink, CloudCanal, Maxwell, and DRDS.

BinlogCDCElasticsearch
0 likes · 14 min read
Mastering MySQL‑to‑Elasticsearch Sync: 4 Strategies & Top Migration Tools