The article explains how Elasticsearch achieves sub‑second search over billions of log entries by combining sharding, immutable segment writes, a three‑layer inverted index, and a two‑phase query‑then‑fetch process that distributes work across nodes.
This article provides a comprehensive overview of ElasticSearch, covering its definition, core components such as indexes, shards and replicas, the analysis pipeline, inverted index mechanics, and the two‑stage search process that enables scalable, fault‑tolerant full‑text search in big‑data environments.
Quickwit is a Rust‑based distributed search engine that enables sub‑second queries directly on cloud object storage, and its documentation details the architecture, core concepts, installation, data ingestion, log management, tracing, deployment options, configuration, and operational best practices.
The article explains how our driver‑passenger matching service migrated from load‑balanced Elasticsearch access to a direct RestClient, then automated node discovery using the built‑in Sniffer and SniffOnFailureListener, detailing its scheduling, request logic, and how this eliminates manual IP management while keeping the client in sync with cluster topology.
This article explains the fundamentals of structured and unstructured data, introduces Lucene’s inverted index, and details how Elasticsearch builds on Lucene to provide distributed, near‑real‑time search with concepts such as clusters, shards, replicas, routing, and performance optimizations.
This article provides a comprehensive introduction to Elasticsearch, covering data types, Lucene fundamentals, inverted indexes, cluster components, node roles, shard and replica mechanisms, mapping, installation, health monitoring, write path, storage strategies, segment management, refresh and translog processes, as well as practical performance and JVM tuning tips.
This article introduces Elasticsearch as a distributed, high‑performance search engine, explains its cluster architecture, node roles, shard and replica mechanisms, write and refresh processes, and outlines search handling techniques such as pagination, scroll and search‑after with practical curl examples.
This article explains how ElasticSearch achieves near real‑time search by using immutable inverted indexes, segment merging, shard distribution, and a translog for durability, while also offering practical guidance on how to study the system effectively.
This article examines Elasticsearch’s distributed search architecture, explains the two‑phase query and fetch process, identifies performance and relevance scoring challenges, and presents optimization techniques such as Search After with point‑in‑time, Scroll API usage, and DFS query‑then‑fetch for accurate scoring.
In an interview, Tencent Cloud senior engineer Chen Xi explains how Tencent optimizes Elasticsearch for massive log, monitoring, and document search workloads by prioritizing stability through kernel tweaks, boosting performance with scenario‑specific settings, cutting costs via redundant storage trimming and off‑heap indexing, and leveraging rich data‑pipeline components and robust distributed cluster management to lower operational overhead while anticipating future ecosystem growth and community collaboration.
Didi transformed its massive single‑cluster Elasticsearch deployment into a transparent multi‑cluster architecture using TribeNode and cross‑cluster search, isolating workloads, reducing fault impact, and achieving five‑fold scale while preserving a single‑cluster appearance for services, despite added configuration complexity and stability challenges.
This article compares the two leading open‑source search engines, Solr and Elasticsearch, examining their architectures, features, deployment ease, scalability, community support, and ideal use cases to help you decide which solution best matches your application requirements.
This article explains how 1号店 built a distributed search engine with horizontal scaling, custom sharding and routing strategies, automated deployment, rapid expansion, and real‑time monitoring to handle the massive traffic spikes of the annual 11.11 e‑commerce promotion.
In this interview, Elastic Stack evangelist Zeng Yong discusses his experiences promoting the ELK stack, the benefits of distributed remote work, ELK's role in big‑data scenarios, comparisons with Hadoop, recent product developments, and upcoming topics for the GIAC conference.
This article explains the design, table schema, indexing workflow, and query processing of a distributed full‑text search system that stores documents and token information separately in a distributed database, improving scalability and performance over traditional Lucene‑based solutions.
This article explains how a major e‑commerce platform built a horizontally scalable distributed search engine, designed efficient sharding and routing strategies, and implemented automated deployment, rapid scaling, and real‑time monitoring to handle the massive traffic of the 11.11 shopping festival.
