Tagged articles
1178 articles
Page 3 of 12
JD Tech Talk
JD Tech Talk
Feb 5, 2025 · Databases

Optimizing Query Performance and Data Architecture for JD BIP Procurement System

This article details how JD’s BIP procurement system tackled massive data volume and complex query performance issues by reducing slow SQL, partitioning “in‑stock” orders, migrating large datasets to Elasticsearch, implementing dynamic query routing, and establishing robust monitoring, resulting in a 92% data reduction and smoother operations.

Elasticsearchquery optimization
0 likes · 11 min read
Optimizing Query Performance and Data Architecture for JD BIP Procurement System
Raymond Ops
Raymond Ops
Feb 3, 2025 · Operations

Master Elasticsearch Snapshots and Security: Step‑by‑Step NFS Backup Guide

This guide walks you through configuring Elasticsearch snapshot backups using NFS, installing and using elasticdump for data export, securing the cluster with SSL certificates, setting up user authentication, and managing Kibana access, providing complete commands, configuration snippets, and visual diagrams for each step.

BackupElasticsearchRestore
0 likes · 17 min read
Master Elasticsearch Snapshots and Security: Step‑by‑Step NFS Backup Guide
ITPUB
ITPUB
Feb 1, 2025 · Databases

How to Query Elasticsearch with SQL: A Step‑by‑Step Guide

This tutorial explains how to use Elasticsearch's built‑in SQL interface to replace complex Query DSL statements with familiar SQL syntax, covering environment setup, index creation, data insertion, and a variety of query examples such as filtering, ordering, grouping, aggregation, and date manipulation.

Data RetrievalElasticsearchQuery DSL
0 likes · 8 min read
How to Query Elasticsearch with SQL: A Step‑by‑Step Guide
Top Architect
Top Architect
Jan 31, 2025 · Databases

Data Synchronization Strategies Between MySQL and Elasticsearch

This article explains why MySQL alone struggles with large‑scale, complex queries, introduces Elasticsearch as a high‑performance search engine, and compares several synchronization approaches—including synchronous and asynchronous dual‑write, Logstash, binlog real‑time sync, Canal, and Alibaba Cloud DTS—highlighting their pros, cons, and suitable scenarios.

CanalElasticsearchLogstash
0 likes · 14 min read
Data Synchronization Strategies Between MySQL and Elasticsearch
MaGe Linux Operations
MaGe Linux Operations
Jan 29, 2025 · Operations

Deploy ELK Stack: Complete Guide to Elasticsearch, Logstash & Kibana Setup

This guide walks through the ELK log analysis system—explaining its components, core concepts, log processing workflow, and step‑by‑step deployment of Elasticsearch, Logstash, Kibana, and supporting plugins on a multi‑node environment, including configuration, startup commands, and troubleshooting tips.

ELKElasticsearchKibana
0 likes · 15 min read
Deploy ELK Stack: Complete Guide to Elasticsearch, Logstash & Kibana Setup
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Jan 22, 2025 · Databases

A Complete Comparison of Elasticsearch Performance Testing Tools

The article reviews Elasticsearch performance testing options—including the official Rally benchmark suite, third‑party solutions such as Logz.io and JMeter, and the open‑source INFINI Loadgen—detailing their automation, version handling, metric reporting, sample benchmark results, and guidance on selecting the right tool for specific workloads.

BenchmarkElasticsearchJMeter
0 likes · 7 min read
A Complete Comparison of Elasticsearch Performance Testing Tools
Top Architect
Top Architect
Jan 20, 2025 · Databases

MySQL to Elasticsearch Data Synchronization Strategies and Tools

This article explains why MySQL‑Elasticsearch synchronization is needed for large‑scale queries, compares several synchronization approaches such as synchronous and asynchronous dual‑write, Logstash, Binlog, Canal, and Alibaba DTS, and discusses their advantages, disadvantages, and typical application scenarios.

CanalDTSElasticsearch
0 likes · 16 min read
MySQL to Elasticsearch Data Synchronization Strategies and Tools
Top Architect
Top Architect
Jan 17, 2025 · Databases

MySQL to Elasticsearch Data Synchronization Strategies: Sync Write, Async Write, Logstash, Binlog, Canal, and DTS

This article explains various methods for synchronizing data between MySQL and Elasticsearch—including synchronous and asynchronous double‑write, Logstash pipelines, real‑time Binlog replication, Canal parsing, and Alibaba Cloud DTS—detailing their implementation approaches, advantages, disadvantages, and typical application scenarios.

CanalElasticsearchLogstash
0 likes · 16 min read
MySQL to Elasticsearch Data Synchronization Strategies: Sync Write, Async Write, Logstash, Binlog, Canal, and DTS
MaGe Linux Operations
MaGe Linux Operations
Jan 15, 2025 · Operations

Master Elasticsearch 7.10 on CentOS: Complete Install & Config Guide

This guide walks you through downloading, installing, and configuring Elasticsearch 7.10 on CentOS, covering environment setup, user creation, service start options, essential settings like paths, heap size, system limits, and troubleshooting tips for a production‑ready deployment.

ConfigurationDevOpsElasticsearch
0 likes · 26 min read
Master Elasticsearch 7.10 on CentOS: Complete Install & Config Guide
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Jan 14, 2025 · Databases

How to Build a Custom Elasticsearch Query that Sorts by Time Buckets and Relevance

This article walks through creating a custom Elasticsearch 8.x query that first groups documents into time buckets (e.g., within 3 days, 4‑7 days, older) using a pre‑computed time_bucket field, then sorts each bucket by the _score relevance of the content field, covering pipeline definition, mapping, sample data, DSL query, and practical considerations.

DSL queryElasticsearchIngest Pipeline
0 likes · 11 min read
How to Build a Custom Elasticsearch Query that Sorts by Time Buckets and Relevance
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Jan 13, 2025 · Operations

Top Logstash Interview Questions 11‑20: Answers and Practical Configurations

This article provides concise answers and example configurations for eleven common Logstash interview questions, covering HTTP input/poller plugins, the Split filter, pipeline debugging, performance monitoring with Metricbeat, Grok failure handling, secure communication, multi‑source collection, multiple outputs, differences from Elasticsearch ingest pipelines, and Kibana pipeline management.

ElasticsearchLogstashPipeline
0 likes · 7 min read
Top Logstash Interview Questions 11‑20: Answers and Practical Configurations
macrozheng
macrozheng
Jan 6, 2025 · Backend Development

Discover Elasticvue: A Lightweight Open‑Source GUI for Managing Elasticsearch

This article introduces Elasticvue, a free open‑source Elasticsearch GUI that supports ES 7.x/8.x, explains how to install it via Docker, demonstrates its features such as cluster monitoring, index and shard management, document search, and REST queries using a real e‑commerce project example.

BackendDockerElasticsearch
0 likes · 7 min read
Discover Elasticvue: A Lightweight Open‑Source GUI for Managing Elasticsearch
Architect
Architect
Jan 2, 2025 · Databases

Data Synchronization Strategies Between MySQL and Elasticsearch

This article explains why MySQL alone struggles with large‑scale queries, introduces Elasticsearch as a complementary search engine, and compares several synchronization approaches—including synchronous and asynchronous dual‑write, Logstash, Binlog, Canal, and Alibaba Cloud DTS—detailing their implementations, advantages, disadvantages, and suitable use cases.

BinlogCanalDTS
0 likes · 16 min read
Data Synchronization Strategies Between MySQL and Elasticsearch
JD Tech
JD Tech
Dec 26, 2024 · Databases

Optimizing Query Performance for JD's BIP Procurement System with JED, JimKV, and Elasticsearch

This article details how JD's BIP procurement system tackled massive query‑performance challenges by segmenting order data, leveraging the JED distributed MySQL solution, introducing JimKV for hot‑data caching, and offloading complex searches to Elasticsearch, resulting in dramatically reduced load and faster user experiences.

Big DataDatabase OptimizationElasticsearch
0 likes · 11 min read
Optimizing Query Performance for JD's BIP Procurement System with JED, JimKV, and Elasticsearch
Sohu Tech Products
Sohu Tech Products
Dec 25, 2024 · Operations

Mastering Elasticsearch Query Limits: Tips to Boost Performance

This article explains the five major Elasticsearch query limits—including result size, max clause count, field data, join operations, and query throughput—provides concrete code examples, and offers practical optimization strategies to improve performance and ensure cluster stability.

BackendElasticsearchPerformance Optimization
0 likes · 11 min read
Mastering Elasticsearch Query Limits: Tips to Boost Performance
Su San Talks Tech
Su San Talks Tech
Dec 25, 2024 · Databases

Discover Elasticvue: A Lightweight Yet Powerful Elasticsearch GUI

This guide introduces Elasticvue, a lightweight and powerful Elasticsearch GUI, walks through downloading and installing the tool, configuring clusters, creating and managing indices via both GUI and REST, and demonstrates adding and viewing data with practical code examples.

ElasticsearchGUIIndex Management
0 likes · 5 min read
Discover Elasticvue: A Lightweight Yet Powerful Elasticsearch GUI
Top Architect
Top Architect
Dec 20, 2024 · Databases

Database Optimization, Sharding, and Pagination Issues: Lessons from a Large‑Scale MySQL Deployment

The article shares a senior architect’s experience with large‑scale MySQL tables, discussing why sharding and Elasticsearch were introduced, the pagination bug caused by Sharding‑JDBC, and a comprehensive set of hardware, software, and SQL tuning recommendations, including a full MySQL configuration example.

Elasticsearchmysqloptimization
0 likes · 14 min read
Database Optimization, Sharding, and Pagination Issues: Lessons from a Large‑Scale MySQL Deployment
Top Architect
Top Architect
Dec 19, 2024 · Databases

MySQL to Elasticsearch Data Synchronization Strategies and Tools

This article examines various methods for synchronizing MySQL data with Elasticsearch, including synchronous and asynchronous dual writes, Logstash pipelines, binlog streaming, and Alibaba Cloud DTS, outlining implementation approaches, advantages, disadvantages, and suitable application scenarios for each solution.

BinlogCanalDTS
0 likes · 15 min read
MySQL to Elasticsearch Data Synchronization Strategies and Tools
MaGe Linux Operations
MaGe Linux Operations
Dec 18, 2024 · Big Data

Mastering ELK Stack: Step-by-Step Installation, Configuration, and Usage

Learn how to install, configure, and operate the ELK stack—Elasticsearch, Logstash, and Kibana—by following detailed steps for preparing servers, setting up each component, tuning performance, deploying plugins, and testing log collection and visualization, enabling efficient log management and analysis.

ELKElasticsearchKibana
0 likes · 18 min read
Mastering ELK Stack: Step-by-Step Installation, Configuration, and Usage
JD Retail Technology
JD Retail Technology
Dec 12, 2024 · Databases

Optimizing Query Performance for JD's BIP Procurement System with JED, JimKV, and Elasticsearch

This article presents a comprehensive case study of how JD's procurement system (BIP) tackled massive data volume and complex query challenges by redesigning data models, introducing heterogeneous storage for inbound orders, leveraging JED and JimKV, and offloading complex searches to Elasticsearch, resulting in dramatically reduced database load and improved user experience.

Database OptimizationElasticsearchJD supply chain
0 likes · 11 min read
Optimizing Query Performance for JD's BIP Procurement System with JED, JimKV, and Elasticsearch
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Dec 10, 2024 · Databases

Exploring Domestic Alternatives to Elasticsearch When ES Is Restricted

This article analyzes why organizations are seeking domestic replacements for Elasticsearch due to policy, licensing, and cost constraints, and evaluates several options—including OpenSearch, XunSearch, Lucene/Solr, native database extensions, Milvus, and EasySearch—highlighting their strengths, weaknesses, and suitable scenarios.

EasysearchElasticsearchMilvus
0 likes · 13 min read
Exploring Domestic Alternatives to Elasticsearch When ES Is Restricted
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Dec 5, 2024 · Databases

Practical Elasticsearch Filter Context Cases: When It Speeds Up Queries and When It Doesn't

This article examines two practical Elasticsearch filter‑context scenarios, showing how converting a must clause to a filter can activate the query cache and reduce latency, while also revealing cases where filter context offers no speed benefit and explaining the underlying ConstantScore behavior.

ConstantScoreElasticsearchfilter context
0 likes · 5 min read
Practical Elasticsearch Filter Context Cases: When It Speeds Up Queries and When It Doesn't
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Dec 5, 2024 · Databases

Key Elasticsearch Performance Tweaks: Cutting Query Latency from 50 ms to Under 1 ms

In a micro‑service that uses Elasticsearch to fetch product listings, a series of targeted optimizations—including shard reduction, segment merging, keyword mapping, request‑cache activation, and PIT‑based sorting—slashed query latency from 50‑60 ms to under 1 ms and boosted throughput to about 50 k queries per second.

ElasticsearchKeyword MappingPIT
0 likes · 11 min read
Key Elasticsearch Performance Tweaks: Cutting Query Latency from 50 ms to Under 1 ms
Top Architect
Top Architect
Nov 29, 2024 · Databases

Data Synchronization Strategies between MySQL and Elasticsearch

The article explains why MySQL alone struggles with large‑scale, complex queries, introduces Elasticsearch as a complementary search engine, and details multiple synchronization approaches—including synchronous and asynchronous double‑write, Logstash, Binlog, Canal, and Alibaba DTS—along with their advantages, disadvantages, and typical use cases.

CanalDTSElasticsearch
0 likes · 16 min read
Data Synchronization Strategies between MySQL and Elasticsearch
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Nov 25, 2024 · Backend Development

What Elasticsearch Query Limits Should You Know?

This article explains the five major Elasticsearch query limits—including result size, max clause count, field data, join operations, and query throughput—detailing their default values, why they exist, and practical solutions such as using search_after, scroll API, and resource monitoring to keep clusters stable and performant.

Elasticsearchfielddatamax clause count
0 likes · 11 min read
What Elasticsearch Query Limits Should You Know?
21CTO
21CTO
Nov 19, 2024 · Databases

Why Vector Databases Like Milvus Outperform Elasticsearch in Hybrid Search

This article explains how combining dense vector‑based semantic search with traditional keyword matching using a unified vector database such as Milvus delivers superior performance, scalability, and simplicity compared to maintaining separate Elasticsearch and vector‑search stacks.

ElasticsearchHybrid SearchMilvus
0 likes · 9 min read
Why Vector Databases Like Milvus Outperform Elasticsearch in Hybrid Search
Top Architect
Top Architect
Nov 17, 2024 · Databases

Data Synchronization Strategies Between MySQL and Elasticsearch

This article explains why MySQL alone may struggle with large‑scale, complex queries, introduces Elasticsearch as a high‑performance search engine, and compares several synchronization approaches—including synchronous and asynchronous dual‑write, Logstash, Binlog, Canal, and Alibaba Cloud DTS—detailing their advantages, disadvantages, and suitable scenarios.

BinlogCanalDTS
0 likes · 14 min read
Data Synchronization Strategies Between MySQL and Elasticsearch
Su San Talks Tech
Su San Talks Tech
Nov 16, 2024 · Databases

Why MySQL Pagination Slows Down on Large Tables and How to Fix It

This article examines how pagination queries on massive MySQL tables become dramatically slower as the offset grows, defines what constitutes a slow SQL, and presents three practical optimization techniques—including returning only primary keys, range filtering, and using Elasticsearch—to dramatically improve query performance.

Database OptimizationElasticsearchSQL
0 likes · 10 min read
Why MySQL Pagination Slows Down on Large Tables and How to Fix It
dbaplus Community
dbaplus Community
Nov 12, 2024 · Databases

How to Query Elasticsearch with SQL: A Step‑by‑Step Guide

This tutorial shows how to use Elasticsearch's built‑in SQL support to run familiar MySQL‑style queries—creating an index, inserting documents, and performing SELECT, WHERE, ORDER BY, GROUP BY, LIMIT, aggregation, date and string functions—making ES data retrieval as easy as relational databases.

Data RetrievalElasticsearchQuery DSL
0 likes · 7 min read
How to Query Elasticsearch with SQL: A Step‑by‑Step Guide
Sohu Tech Products
Sohu Tech Products
Nov 6, 2024 · Operations

Design and Implementation of a Business Operation Log Management System Using Canal and Elasticsearch

The article presents a decoupled business operation log management architecture that uses Alibaba’s Canal to capture MySQL binlog changes, streams them through Kafka, and stores structured before‑and‑after records in Elasticsearch with nested mappings, enabling multi‑table correlation via transaction IDs, visual querying, and reliable rollback without modifying application code.

BackendCanalElasticsearch
0 likes · 12 min read
Design and Implementation of a Business Operation Log Management System Using Canal and Elasticsearch
ITPUB
ITPUB
Nov 5, 2024 · Operations

Master EFLK: Deep‑Inspection Guide for Elasticsearch, Filebeat, Logstash & Kibana

This guide presents a comprehensive, step‑by‑step deep‑inspection plan for the EFLK stack, covering Elasticsearch health checks, node performance metrics, shard and index monitoring, Logstash and Kibana validation, DSL query examples, and automated Python‑based metric collection with cron scheduling.

ElasticsearchKibanaLogstash
0 likes · 13 min read
Master EFLK: Deep‑Inspection Guide for Elasticsearch, Filebeat, Logstash & Kibana
Efficient Ops
Efficient Ops
Nov 4, 2024 · Cloud Native

Build an ELK Log Center for Docker Containers in Minutes

This guide walks you through setting up an ELK stack to collect, centralize, and visualize logs from Dockerized applications, covering rsyslog configuration, container deployment for Elasticsearch, Logstash, Kibana, and Nginx, and demonstrates verification via Kibana queries.

DockerELKElasticsearch
0 likes · 5 min read
Build an ELK Log Center for Docker Containers in Minutes
Top Architect
Top Architect
Nov 4, 2024 · Operations

Centralized Log Collection and Monitoring with Filebeat and Graylog

This article explains how to use Filebeat as a lightweight log shipper together with Graylog for centralized log aggregation, storage, and analysis, covering installation, configuration files, Docker deployment, Spring Boot integration, and query techniques for efficient operations monitoring.

DockerElasticsearchFilebeat
0 likes · 18 min read
Centralized Log Collection and Monitoring with Filebeat and Graylog
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Nov 3, 2024 · Big Data

How to Build a Scalable Business Operation Log System with Canal and Elasticsearch

This article walks through the design and implementation of a decoupled, high‑performance business operation log solution that captures MySQL binlog changes via Canal, streams them through Kafka, and stores and queries them in Elasticsearch, addressing challenges such as batch operations, multi‑table transactions, and non‑business data filtering.

BinlogCanalElasticsearch
0 likes · 13 min read
How to Build a Scalable Business Operation Log System with Canal and Elasticsearch
Sohu Tech Products
Sohu Tech Products
Oct 30, 2024 · Operations

Comprehensive EFLK (Elasticsearch, Filebeat, Logstash, Kibana) Deep Inspection and Monitoring Guide

This comprehensive guide details a step‑by‑step deep‑inspection and monitoring strategy for an Elasticsearch‑Filebeat‑Logstash‑Kibana (EFLK) stack, covering cluster health, node and shard metrics, index status, query profiling, Filebeat, Logstash and Kibana validation, DSL query examples, and a Python script for automated metric collection.

EFLKElasticsearchFilebeat
0 likes · 12 min read
Comprehensive EFLK (Elasticsearch, Filebeat, Logstash, Kibana) Deep Inspection and Monitoring Guide
Architect
Architect
Oct 29, 2024 · Databases

Four Pagination Strategies: MySQL LIMIT OFFSET, Primary‑Key Filtering, HasMore Scrolling, and Elasticsearch

This article compares four pagination techniques—MySQL LIMIT OFFSET, LIMIT with primary‑key filtering, HasMore scrolling, and Elasticsearch pagination—explaining their implementations, advantages, drawbacks such as deep‑page performance issues, and recommending appropriate scenarios for each method.

Elasticsearchmysqlpagination
0 likes · 6 min read
Four Pagination Strategies: MySQL LIMIT OFFSET, Primary‑Key Filtering, HasMore Scrolling, and Elasticsearch
Top Architect
Top Architect
Oct 26, 2024 · Operations

Centralized Log Collection with Filebeat and Graylog

This article explains how to use Filebeat as a lightweight log shipper together with Graylog, Elasticsearch, and MongoDB to collect, process, and visualize logs from multiple environments, including detailed configuration examples, deployment scripts, and integration with Docker and Spring Boot.

DockerElasticsearchFilebeat
0 likes · 19 min read
Centralized Log Collection with Filebeat and Graylog
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Oct 24, 2024 · Backend Development

Full Elasticsearch 8.x Java API Client Code Ready for Immediate Project Use

This article walks through the new features of the Elasticsearch 8.x Java API client, shows how to set up the development environment, initialize the client with HTTPS or API‑key authentication, and provides complete, ready‑to‑run code examples for index creation, document indexing, searching, aggregations, and scripted sorting.

BackendElasticsearchElasticsearch 8.x
0 likes · 15 min read
Full Elasticsearch 8.x Java API Client Code Ready for Immediate Project Use
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Oct 23, 2024 · Cloud Computing

How Elasticsearch Serverless Cuts Log Analysis Costs by 50%

At the 2024 Cloud Xi Conference, Alibaba Cloud expert Jia Xinyu detailed how Elasticsearch Serverless addresses core log‑analysis pain points with out‑of‑the‑box, high‑performance, pay‑as‑you‑go capabilities, delivering significant cost savings and eliminating operational overhead.

Cost OptimizationElasticsearchServerless
0 likes · 14 min read
How Elasticsearch Serverless Cuts Log Analysis Costs by 50%
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Oct 18, 2024 · Artificial Intelligence

Integrate Alibaba Cloud AI Search with Elasticsearch: A Step‑by‑Step Guide

This tutorial walks you through configuring Elasticsearch’s Open Inference API to connect with Alibaba Cloud AI Search, covering setup of text generation, rerank, sparse and dense vector services, and demonstrates end‑to‑end requests with code examples for building RAG and semantic search applications.

Alibaba Cloud AI SearchElasticsearchInference API
0 likes · 11 min read
Integrate Alibaba Cloud AI Search with Elasticsearch: A Step‑by‑Step Guide
Java Architecture Stack
Java Architecture Stack
Oct 15, 2024 · Backend Development

How to Build Powerful Search, Log, and Recommendation Solutions with Elasticsearch

This guide walks through five real‑world Elasticsearch use cases—including full‑text product search with highlighting, centralized log collection and analysis, personalized video recommendation, price‑range aggregation for e‑commerce, and geo‑location restaurant search—detailing index design, query syntax, Docker setup, and front‑end integration.

Backend DevelopmentElasticsearchFull‑Text Search
0 likes · 35 min read
How to Build Powerful Search, Log, and Recommendation Solutions with Elasticsearch
Senior Tony
Senior Tony
Oct 12, 2024 · Backend Development

When Monolith Meets Microservices: API Composition vs CQRS for Complex Queries

This article compares API composition and CQRS patterns for handling distributed queries in evolving monolithic systems, illustrating their workflows with e‑commerce and online‑education examples, discussing performance trade‑offs, implementation details using Canal and ElasticSearch, and offering practical guidance on when to adopt each approach.

API compositionBackend ArchitectureCQRS
0 likes · 8 min read
When Monolith Meets Microservices: API Composition vs CQRS for Complex Queries
macrozheng
macrozheng
Oct 8, 2024 · Databases

Why RediSearch Beats Elasticsearch on Low‑End Servers: A Hands‑On Comparison

This article introduces RediSearch, compares its memory usage and query performance with Elasticsearch on modest hardware, shows installation steps, demonstrates core index commands and Java integration, and concludes with practical advice on using RediSearch as a lightweight full‑text search engine.

ElasticsearchFull‑Text SearchJava
0 likes · 11 min read
Why RediSearch Beats Elasticsearch on Low‑End Servers: A Hands‑On Comparison
dbaplus Community
dbaplus Community
Sep 24, 2024 · Backend Development

How Ctrip Scaled Its Vacation Product Log System to Billions of Records

This article recounts the evolution of Ctrip's vacation product log platform—from a single‑table DB solution to a platformized ES + HBase architecture—detailing the challenges of massive data volume, the design of RowKey, write and query flows, and the subsequent business and supplier empowerment.

BackendElasticsearchHBase
0 likes · 14 min read
How Ctrip Scaled Its Vacation Product Log System to Billions of Records
Wukong Talks Architecture
Wukong Talks Architecture
Sep 23, 2024 · Backend Development

Evolution of the Ctrip Travel Product Log System: Architecture, Challenges, and Solutions

This article describes the development trajectory of Ctrip's travel product log system, detailing its three major phases—from a single‑table DB approach to a platform‑based solution and finally an empowered version—while discussing technical challenges, design decisions, and the implementation of HBase, Elasticsearch, and related components to handle billions of log entries efficiently.

BackendBig DataElasticsearch
0 likes · 15 min read
Evolution of the Ctrip Travel Product Log System: Architecture, Challenges, and Solutions
HelloTech
HelloTech
Sep 20, 2024 · Big Data

Optimizing Elasticsearch Mapping to Reduce High CPU Usage: Challenges, Solutions, and Results

By refactoring the station‑profile index to eliminate over‑indexed and mis‑typed fields—cutting complex types from 282 to 74 and keywords from 67 to 59—the team lowered CPU peaks from 60 % to 50 %, reduced average CPU to 20 %, cut query latency to 150 ms, accelerated Flink sync to 10 minutes, and decommissioned two nodes, achieving substantial performance gains and cost savings.

CPU performanceElasticsearchMapping Optimization
0 likes · 10 min read
Optimizing Elasticsearch Mapping to Reduce High CPU Usage: Challenges, Solutions, and Results
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Sep 10, 2024 · Artificial Intelligence

Unlocking AI Search with Alibaba Cloud Elasticsearch: Vectors, HNSW & RAG

This article details Alibaba Cloud Elasticsearch's AI search advancements, covering embedding vectors, HNSW-based approximate nearest neighbor search, hardware-accelerated vector engines, sparse vectors, hybrid retrieval, the Inference API, and RAG implementations that together boost performance, efficiency, and relevance for modern AI-driven search applications.

ElasticsearchHNSWRAG
0 likes · 11 min read
Unlocking AI Search with Alibaba Cloud Elasticsearch: Vectors, HNSW & RAG
DataFunSummit
DataFunSummit
Sep 4, 2024 · Artificial Intelligence

How Elasticsearch Powers Retrieval‑Augmented Generation (RAG) Applications

This article explains how Elasticsearch’s advanced search capabilities—including vector and semantic search, hardware acceleration, hybrid retrieval, model re‑ranking, multi‑vector support, and integrated security—enable robust RAG implementations and outlines future directions such as a new compute engine, stronger vector engines, and cloud‑native serverless deployment.

AIElasticsearchHybrid Search
0 likes · 9 min read
How Elasticsearch Powers Retrieval‑Augmented Generation (RAG) Applications
Efficient Ops
Efficient Ops
Sep 1, 2024 · Backend Development

Master Elasticsearch: From Basics to Advanced Performance Tuning

This article walks through Elasticsearch’s licensing history, version selection, installation, cluster health monitoring, shard routing, storage mechanisms, refresh and translog processes, segment merging, and practical performance optimizations such as disk choices, index settings, and JVM tuning.

ClusterElasticsearchSearch
0 likes · 21 min read
Master Elasticsearch: From Basics to Advanced Performance Tuning
Top Architect
Top Architect
Aug 30, 2024 · Databases

MySQL to Elasticsearch Data Synchronization Strategies and Tools

This article examines various methods for synchronizing MySQL data with Elasticsearch, including synchronous and asynchronous dual‑write, Logstash pipelines, binlog real‑time replication, Canal, and Alibaba Cloud DTS, comparing their architectures, advantages, disadvantages, and suitable application scenarios.

Elasticsearchdata synchronizationdatabases
0 likes · 17 min read
MySQL to Elasticsearch Data Synchronization Strategies and Tools
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Aug 23, 2024 · Artificial Intelligence

How Elasticsearch Evolved into a Hybrid AI-Powered Search Engine

This article traces Elasticsearch's transformation from a pure text search engine to a versatile hybrid platform that integrates structured, geospatial, aggregation, and vector search capabilities, highlighting its AI-driven innovations, performance optimizations, and growing adoption across enterprises and academia.

AI searchElasticsearchHybrid Search
0 likes · 13 min read
How Elasticsearch Evolved into a Hybrid AI-Powered Search Engine
Ctrip Technology
Ctrip Technology
Aug 22, 2024 · Backend Development

Evolution of Ctrip Vacation Product Log System: From Single‑Table DB to ES + HBase Platform

This article details the three‑stage evolution of Ctrip's vacation product log system—from a simple single‑table DB approach, through a platform‑based ES + HBase solution, to a scalable V3.0 architecture that improves storage, search, and business empowerment while handling billions of log entries.

BackendElasticsearchdata pipeline
0 likes · 16 min read
Evolution of Ctrip Vacation Product Log System: From Single‑Table DB to ES + HBase Platform
High Availability Architecture
High Availability Architecture
Aug 16, 2024 · Big Data

Introduction to Elasticsearch: Core Concepts, Query Types, Pagination, and Data Synchronization

This article provides a comprehensive overview of Elasticsearch, covering its distributed storage architecture, core data model concepts, analysis and query capabilities, practical next‑token pagination techniques, join strategies, and various data synchronization methods for integrating Elasticsearch with other systems.

Big DataElasticsearchQuery DSL
0 likes · 13 min read
Introduction to Elasticsearch: Core Concepts, Query Types, Pagination, and Data Synchronization
Efficient Ops
Efficient Ops
Aug 14, 2024 · Operations

Building a Real-Time Log Monitoring System with ELK, Kafka, and Python

This article details how to construct a log‑monitoring platform using the ELK stack, Kafka buffering, and a Python scheduler to collect, process, and alert on error logs, offering practical configuration tips and performance optimizations for production environments.

ELKElasticsearchKafka
0 likes · 10 min read
Building a Real-Time Log Monitoring System with ELK, Kafka, and Python
MaGe Linux Operations
MaGe Linux Operations
Aug 9, 2024 · Operations

Mastering Elasticsearch Data Sync and Cluster Architecture: Strategies & Best Practices

This article explains how to keep MySQL and Elasticsearch data in sync using synchronous calls, asynchronous notifications, or binlog listeners, and dives deep into Elasticsearch cluster design, node roles, distributed storage, query phases, split‑brain handling, and fault‑tolerance mechanisms.

Cluster ArchitectureDistributed QueryElasticsearch
0 likes · 8 min read
Mastering Elasticsearch Data Sync and Cluster Architecture: Strategies & Best Practices
Top Architect
Top Architect
Aug 6, 2024 · Databases

MySQL to Elasticsearch Data Synchronization Strategies and Tools

This article explains various methods for synchronizing MySQL data to Elasticsearch, including synchronous and asynchronous double‑write, Logstash pipelines, binlog‑based real‑time sync, Canal, and Alibaba Cloud DTS, comparing their advantages, disadvantages, and suitable scenarios.

BinlogCanalDTS
0 likes · 16 min read
MySQL to Elasticsearch Data Synchronization Strategies and Tools
Open Source Tech Hub
Open Source Tech Hub
Aug 4, 2024 · Databases

Sync RDS MySQL Data to Alibaba Cloud Elasticsearch with DTS

This guide walks you through using Alibaba Cloud Data Transmission Service (DTS) to continuously synchronize production data from an RDS MySQL instance to an Elasticsearch cluster, covering prerequisites, task creation, verification, Kibana queries, and incremental sync testing.

Alibaba CloudDTSElasticsearch
0 likes · 7 min read
Sync RDS MySQL Data to Alibaba Cloud Elasticsearch with DTS
Open Source Tech Hub
Open Source Tech Hub
Aug 1, 2024 · Databases

How to Sync MySQL Data to Elasticsearch: Strategies, Pros, and Pitfalls

This article explains why MySQL‑Elasticsearch synchronization is needed, compares six practical approaches—including sync write, async write, Logstash, binlog, Canal, and Alibaba Cloud DTS—detailing their implementation methods, advantages, disadvantages, and suitable use cases for large‑scale data environments.

BinlogCanalDTS
0 likes · 13 min read
How to Sync MySQL Data to Elasticsearch: Strategies, Pros, and Pitfalls
Sohu Tech Products
Sohu Tech Products
Jul 31, 2024 · Databases

Elasticsearch ILM Migration Performance Optimization Strategies

To prevent IO saturation during Elasticsearch ILM hot‑to‑cold migrations, the article recommends batching migrations, fine‑tuning max_bytes_per_sec, upgrading cold‑node storage and adding hot nodes, and automating monitoring with scripts that pause or resume ILM based on real‑time utilization thresholds.

Backend DevelopmentElasticsearchILM
0 likes · 7 min read
Elasticsearch ILM Migration Performance Optimization Strategies
Open Source Tech Hub
Open Source Tech Hub
Jul 27, 2024 · Backend Development

Master Elasticsearch with PHP: From Basics to Real‑World Search Implementation

This guide explains why e‑commerce platforms need a high‑performance search engine, introduces Elasticsearch fundamentals, compares it with traditional engines, and provides step‑by‑step PHP code for installing, configuring, indexing, and querying data, complete with practical examples and best‑practice tips.

Backend DevelopmentElasticsearchFull‑Text Search
0 likes · 9 min read
Master Elasticsearch with PHP: From Basics to Real‑World Search Implementation
Su San Talks Tech
Su San Talks Tech
Jul 26, 2024 · Databases

Mastering MySQL‑to‑Elasticsearch Sync: 4 Strategies & Top Migration Tools

This guide compares four MySQL‑to‑Elasticsearch synchronization methods—synchronous dual‑write, asynchronous MQ‑based dual‑write, timer‑driven SQL extraction, and real‑time Binlog replication—and reviews popular CDC tools such as Canal, Alibaba Cloud DTS, Databus, and others to help you choose the right solution.

BinlogCDCCanal
0 likes · 13 min read
Mastering MySQL‑to‑Elasticsearch Sync: 4 Strategies & Top Migration Tools
Sohu Tech Products
Sohu Tech Products
Jul 17, 2024 · Backend Development

Mastering Elasticsearch: Painless Scripts for Advanced Array Operations

This article provides a step‑by‑step guide on using Elasticsearch’s Painless scripting language to create, index, and manipulate array‑type fields, covering basic operations like length and element access, as well as advanced aggregations, filtering, and weighted calculations, while highlighting performance considerations.

ArrayBackendElasticsearch
0 likes · 9 min read
Mastering Elasticsearch: Painless Scripts for Advanced Array Operations
JD Cloud Developers
JD Cloud Developers
Jul 17, 2024 · Databases

Choosing the Right Database: MySQL, Redis, HBase, ClickHouse, MongoDB, Elasticsearch, Neo4j, Prometheus & Milvus Explained

Explore nine major database technologies—from traditional relational MySQL to NoSQL Redis, columnar HBase and ClickHouse, document-oriented MongoDB, search engine Elasticsearch, graph Neo4j, time‑series Prometheus, and vector Milvus—plus practical best‑practice guides, real‑world polyglot persistence scenarios, and recommended resources for mastering modern data storage.

ClickHouseElasticsearchHBase
0 likes · 50 min read
Choosing the Right Database: MySQL, Redis, HBase, ClickHouse, MongoDB, Elasticsearch, Neo4j, Prometheus & Milvus Explained
JD Tech Talk
JD Tech Talk
Jul 17, 2024 · Databases

A Comprehensive Guide to 9 Database Types and Polyglot Persistence

This article provides an in‑depth overview of nine major database categories—including relational, key‑value, columnar, document, graph, time‑series, and vector databases—detailing their strengths, weaknesses, best practices, and typical application scenarios, and explains how polyglot persistence combines multiple databases for optimal performance and scalability.

ClickHouseElasticsearchHBase
0 likes · 41 min read
A Comprehensive Guide to 9 Database Types and Polyglot Persistence
Volcano Engine Developer Services
Volcano Engine Developer Services
Jul 3, 2024 · Backend Development

How We Scaled a Billion‑Item Search Engine with Elasticsearch: From Zero to One

This article details the practical journey of building and scaling an Elasticsearch‑based search system that supports tens of millions to billions of items, covering architecture design, capacity planning, multi‑data‑center deployment, data synchronization via RocketMQ and Flink, and multi‑layer reconciliation to ensure consistency and high QPS.

ConsistencyElasticsearchFlink
0 likes · 15 min read
How We Scaled a Billion‑Item Search Engine with Elasticsearch: From Zero to One
JD Tech
JD Tech
Jul 2, 2024 · Big Data

Real‑Time Monitoring Dashboard for Logistics Supply Chain: Architecture, Data Modeling, and Stability Design

This article presents the design and implementation of a high‑availability, real‑time logistics supply‑chain monitoring dashboard, covering its data processing pipeline with Flink, storage choices between Elasticsearch and ClickHouse, multi‑layer architecture, metric consistency, stability mechanisms, extensibility configurations, and monitoring practices.

Big DataClickHouseDashboard
0 likes · 11 min read
Real‑Time Monitoring Dashboard for Logistics Supply Chain: Architecture, Data Modeling, and Stability Design
Open Source Linux
Open Source Linux
Jul 1, 2024 · Operations

Deploy a Full ELK Stack on a Single Ubuntu Server

This guide walks you through installing Java, Elasticsearch, Kibana, Logstash, and Filebeat on Ubuntu 18.04, configuring a dedicated data disk, adjusting service settings, and testing log collection with a complete script for a compact ELK demo environment.

ELKElasticsearchFilebeat
0 likes · 11 min read
Deploy a Full ELK Stack on a Single Ubuntu Server
Dangbei Technology Team
Dangbei Technology Team
Jun 28, 2024 · Backend Development

Boost Elasticsearch Prefix Search with Edge N‑Gram: A Practical Guide

This article explains how to overcome performance bottlenecks in high‑concurrency Elasticsearch prefix searches by applying an edge‑ngram tokenizer, detailing the problem, configuration steps, analysis results, and query recommendations for faster, more accurate search experiences.

Elasticsearchedge n-gramprefix search
0 likes · 10 min read
Boost Elasticsearch Prefix Search with Edge N‑Gram: A Practical Guide
dbaplus Community
dbaplus Community
Jun 25, 2024 · Databases

How Didi Scales Elasticsearch: Architecture, Performance Tuning, and Cost Optimization

This article details Didi’s use of Elasticsearch 7.6, covering its architecture on physical machines, gateway and control layers, user console features, deployment models, data synchronization strategies, engine iterations such as fine‑grained tiered protection, multi‑active replication, JDK 17/ZGC performance upgrades, cost reductions, multi‑tenant isolation, security enhancements, and future migration to ES 8.13.

DataSyncElasticsearchMultitenant
0 likes · 17 min read
How Didi Scales Elasticsearch: Architecture, Performance Tuning, and Cost Optimization
IT Services Circle
IT Services Circle
Jun 24, 2024 · Databases

Understanding Elasticsearch Architecture: Inverted Index, Term Dictionary, Segments, and Distributed Search

This article explains how Elasticsearch transforms simple keyword matching into a high‑performance, scalable search engine by using inverted indexes, term dictionaries, posting lists, term indexes, stored fields, doc values, segments, and distributed node architectures to achieve fast, reliable full‑text search on massive data sets.

ElasticsearchSegmentTerm Dictionary
0 likes · 16 min read
Understanding Elasticsearch Architecture: Inverted Index, Term Dictionary, Segments, and Distributed Search
Top Architect
Top Architect
Jun 17, 2024 · Backend Development

High‑Availability Architecture and Performance Optimization for a Large‑Scale Membership System

This article describes how a unified membership system serving billions of users across multiple platforms achieves high performance and high availability through dual‑center Elasticsearch clusters, traffic isolation, deep ES optimizations, Redis caching, dual‑center MySQL partitioning, seamless migration, and fine‑grained flow‑control and degradation strategies.

ElasticsearchPerformance OptimizationSystem Architecture
0 likes · 22 min read
High‑Availability Architecture and Performance Optimization for a Large‑Scale Membership System
Zhuanzhuan Tech
Zhuanzhuan Tech
Jun 12, 2024 · Databases

Designing a Scalable Persistence Layer: Sharding, Query Optimization, and Read/Write Splitting

This article shares a practical case study on how a coupon‑distribution system evolved from a single‑table design to a sharded, multi‑database architecture with query optimization, ElasticSearch integration, and read/write splitting to handle growing data volume, complex queries, and increasing request traffic.

ElasticsearchScalabilitydatabases
0 likes · 12 min read
Designing a Scalable Persistence Layer: Sharding, Query Optimization, and Read/Write Splitting
IT Services Circle
IT Services Circle
Jun 12, 2024 · Databases

MySQL to Elasticsearch Data Synchronization: Strategies and Tool Selection

This article reviews four common MySQL‑to‑Elasticsearch synchronization methods—synchronous dual‑write, asynchronous dual‑write via MQ, timer‑based SQL extraction, and real‑time Binlog replication—evaluates their pros and cons, and compares popular migration tools such as Canal, Alibaba DTS, Databus and others.

BinlogCDCData Migration Tools
0 likes · 11 min read
MySQL to Elasticsearch Data Synchronization: Strategies and Tool Selection
TAL Education Technology
TAL Education Technology
Jun 11, 2024 · Cloud Native

Containerizing Elasticsearch: Architecture Upgrade, API Gateway Integration, and Cloud‑Native Migration

This article details how a large‑scale Elasticsearch deployment was transformed from physical servers to a Kubernetes‑based, containerized architecture, addressing cost, scalability, API compatibility, security, observability, and multi‑cloud migration using the 极限网关 API gateway.

Cloud NativeElasticsearchKubernetes
0 likes · 11 min read
Containerizing Elasticsearch: Architecture Upgrade, API Gateway Integration, and Cloud‑Native Migration
MaGe Linux Operations
MaGe Linux Operations
Jun 10, 2024 · Cloud Native

Deploy NFS, ECK, Elasticsearch, Kibana & Filebeat on Kubernetes

This guide walks through installing NFS on all nodes, creating a dynamic storage class with Helm, setting up Elastic Cloud on Kubernetes (ECK) operator, deploying Elasticsearch and Kibana clusters, configuring Filebeat for log collection, and tuning system parameters for a production‑ready Kubernetes environment.

ECKElasticsearchFilebeat
0 likes · 18 min read
Deploy NFS, ECK, Elasticsearch, Kibana & Filebeat on Kubernetes
Su San Talks Tech
Su San Talks Tech
Jun 10, 2024 · Databases

Mastering MySQL‑to‑Elasticsearch Sync: 4 Strategies & Top Migration Tools

This article compares four MySQL‑to‑Elasticsearch synchronization methods—synchronous dual‑write, asynchronous dual‑write, SQL extraction, and Binlog‑based real‑time sync—evaluates their pros and cons, and reviews popular migration tools such as Canal, Alibaba DTS, Databus, Flink, CloudCanal, Maxwell, and DRDS.

BinlogCDCElasticsearch
0 likes · 14 min read
Mastering MySQL‑to‑Elasticsearch Sync: 4 Strategies & Top Migration Tools
ZhongAn Tech Team
ZhongAn Tech Team
Jun 4, 2024 · Databases

Elasticsearch 8.x Performance Boosts, New Features, and Migration Guide

This article details how upgrading from Elasticsearch 5.x/2.x to 8.x dramatically improves search, aggregation, and write performance while reducing storage costs, introduces vector KNN, synthetic _source, TSDS, searchable snapshots, security enhancements, and provides migration examples and code snippets for enterprise search platforms.

Data MigrationElasticsearchHybrid Ranking
0 likes · 18 min read
Elasticsearch 8.x Performance Boosts, New Features, and Migration Guide
Code Ape Tech Column
Code Ape Tech Column
May 28, 2024 · Databases

Query Separation: A Practical Approach to Optimizing Large Table Reads

This article explains the concept of query separation, outlines its suitable scenarios, compares implementation methods such as synchronous, asynchronous, and binlog approaches, discusses storage system choices like MongoDB, HBase, and Elasticsearch, and addresses consistency and operational challenges when decoupling read workloads from write workloads.

Data ArchitectureElasticsearchMQ
0 likes · 8 min read
Query Separation: A Practical Approach to Optimizing Large Table Reads
ITPUB
ITPUB
May 26, 2024 · Cloud Native

Containerizing Elasticsearch & ClickHouse on Kubernetes: Bilibili’s Scalable, Low‑Cost Solution

This article details Bilibili’s journey of containerizing Elasticsearch and ClickHouse on Kubernetes, covering the challenges of stateful services, architectural decisions, custom operators, storage and network solutions, deployment steps, observability enhancements, and the resulting cost, quality, and efficiency gains.

ClickHouseCloud NativeElasticsearch
0 likes · 38 min read
Containerizing Elasticsearch & ClickHouse on Kubernetes: Bilibili’s Scalable, Low‑Cost Solution