Tag

distributed search

0 views collected around this technical thread.

HelloTech
HelloTech
Sep 19, 2023 · Databases

Deep Dive into Elasticsearch RestClient Sniffer and Node Discovery Mechanism

The article explains how our driver‑passenger matching service migrated from load‑balanced Elasticsearch access to a direct RestClient, then automated node discovery using the built‑in Sniffer and SniffOnFailureListener, detailing its scheduling, request logic, and how this eliminates manual IP management while keeping the client in sync with cluster topology.

ElasticsearchJavaNode Discovery
0 likes · 11 min read
Deep Dive into Elasticsearch RestClient Sniffer and Node Discovery Mechanism
Efficient Ops
Efficient Ops
Dec 21, 2022 · Big Data

How Elasticsearch Leverages Lucene’s Inverted Index for Real‑Time Distributed Search

This article explains the fundamentals of structured and unstructured data, introduces Lucene’s inverted index, and details how Elasticsearch builds on Lucene to provide distributed, near‑real‑time search with concepts such as clusters, shards, replicas, routing, and performance optimizations.

ElasticsearchInverted IndexLucene
0 likes · 36 min read
How Elasticsearch Leverages Lucene’s Inverted Index for Real‑Time Distributed Search
Architect
Architect
Feb 6, 2022 · Big Data

Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization

This article provides a comprehensive introduction to Elasticsearch, covering data types, Lucene fundamentals, inverted indexes, cluster components, node roles, shard and replica mechanisms, mapping, installation, health monitoring, write path, storage strategies, segment management, refresh and translog processes, as well as practical performance and JVM tuning tips.

ElasticsearchInverted IndexPerformance Optimization
0 likes · 37 min read
Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization
政采云技术
政采云技术
Nov 18, 2021 · Databases

Elasticsearch Series Part 1: Introduction to System Concepts and Read/Write Flow

This article introduces Elasticsearch as a distributed, high‑performance search engine, explains its cluster architecture, node roles, shard and replica mechanisms, write and refresh processes, and outlines search handling techniques such as pagination, scroll and search‑after with practical curl examples.

Cluster ArchitectureElasticsearchSearch API
0 likes · 11 min read
Elasticsearch Series Part 1: Introduction to System Concepts and Read/Write Flow
Top Architect
Top Architect
Nov 7, 2021 · Backend Development

Understanding Near Real‑Time Search and Core Architecture of ElasticSearch

This article explains how ElasticSearch achieves near real‑time search by using immutable inverted indexes, segment merging, shard distribution, and a translog for durability, while also offering practical guidance on how to study the system effectively.

ElasticsearchInverted IndexSegment
0 likes · 8 min read
Understanding Near Real‑Time Search and Core Architecture of ElasticSearch
vivo Internet Technology
vivo Internet Technology
Nov 6, 2019 · Big Data

Elasticsearch Optimization Practices at Tencent: An Interview with Tencent Cloud Engineer Chen Xi

In an interview, Tencent Cloud senior engineer Chen Xi explains how Tencent optimizes Elasticsearch for massive log, monitoring, and document search workloads by prioritizing stability through kernel tweaks, boosting performance with scenario‑specific settings, cutting costs via redundant storage trimming and off‑heap indexing, and leveraging rich data‑pipeline components and robust distributed cluster management to lower operational overhead while anticipating future ecosystem growth and community collaboration.

Big DataDatabase OptimizationElasticsearch
0 likes · 4 min read
Elasticsearch Optimization Practices at Tencent: An Interview with Tencent Cloud Engineer Chen Xi
Didi Tech
Didi Tech
Jan 7, 2019 · Big Data

Didi's Multi-Cluster Elasticsearch Architecture: Challenges and Practices

Didi transformed its massive single‑cluster Elasticsearch deployment into a transparent multi‑cluster architecture using TribeNode and cross‑cluster search, isolating workloads, reducing fault impact, and achieving five‑fold scale while preserving a single‑cluster appearance for services, despite added configuration complexity and stability challenges.

DidiElasticsearchMulti-Cluster
0 likes · 17 min read
Didi's Multi-Cluster Elasticsearch Architecture: Challenges and Practices
Efficient Ops
Efficient Ops
Nov 13, 2017 · Databases

How to Build a Distributed Full‑Text Search System Using a Distributed Database

This article explains the design, table schema, indexing workflow, and query processing of a distributed full‑text search system that stores documents and token information separately in a distributed database, improving scalability and performance over traditional Lucene‑based solutions.

Database DesignFull-Text SearchIndexing
0 likes · 13 min read
How to Build a Distributed Full‑Text Search System Using a Distributed Database