BestHub
Sign in
Tagged articles

Elasticsearch

1286 articles · Page 8 of 13
Selected Java Interview Questions
Selected Java Interview Questions
Mar 9, 2022 · Big Data

Elasticsearch Overview: Core Concepts, Architecture, and Performance Optimization

This article provides a comprehensive overview of Elasticsearch, covering its data types, Lucene-based inverted index, cluster architecture, sharding and replication mechanisms, mapping definitions, basic usage, health monitoring, storage internals, and practical performance tuning tips for large‑scale search deployments.

ClusterElasticsearchLucene
0 likes · 36 min read
Elasticsearch Overview: Core Concepts, Architecture, and Performance Optimization
NiuNiu MaTe
NiuNiu MaTe
Mar 8, 2022 · Backend Development

How a Junior Engineer Landed a Tencent Backend Offer: Interview Experience & Tips

This article shares a junior engineer's detailed journey of securing a backend engineering offer at Tencent, covering three interview rounds, key technical topics like Spring, HashMap, Elasticsearch, Redis, and personal reflections on strengths, weaknesses, and preparation strategies.

Backend DevelopmentElasticsearchInterview Experience
0 likes · 5 min read
How a Junior Engineer Landed a Tencent Backend Offer: Interview Experience & Tips
Ops Development Stories
Ops Development Stories
Feb 24, 2022 · Big Data

Master Elasticsearch: Core Concepts, APIs, Mapping, and Performance Tuning

This comprehensive guide explains Elasticsearch fundamentals—including documents, indices, nodes, clusters, REST and Document APIs, query DSL, relevance scoring, distributed architecture, real‑time indexing, search execution, pagination, scroll, aggregations, data modeling, mapping options, parent/child relationships, reindexing, and practical cluster and write/read performance optimizations.

AggregationElasticsearchcluster tuning
0 likes · 58 min read
Master Elasticsearch: Core Concepts, APIs, Mapping, and Performance Tuning
Top Architect
Top Architect
Feb 21, 2022 · Databases

Key New Features in Elasticsearch 8.0

Elasticsearch 8.0 introduces major updates including 7.x REST API compatibility headers, default-enabled security with registration tokens, known issues on ARM/macOS, a preview KNN search API using dense_vector, storage reductions for keyword and text fields, faster geo indexing, PyTorch model support, and numerous other enhancements across aggregations, allocation, analysis, authentication, and core infrastructure.

ElasticsearchKNNPyTorch
0 likes · 10 min read
Key New Features in Elasticsearch 8.0
IT Architects Alliance
IT Architects Alliance
Feb 18, 2022 · Databases

Designing and Deploying Elasticsearch for Large‑Scale Reading Records and Search in a .NET Platform

This article explains how to evaluate, select, and implement Elasticsearch as a scalable NoSQL search engine for handling tens of millions of reading‑record entries and full‑text work‑search, covering architectural trade‑offs, memory usage, indexing strategies, cluster sharding, pagination limits, server sizing, and .NET integration with code examples.

.NETElasticsearchNoSQL
0 likes · 31 min read
Designing and Deploying Elasticsearch for Large‑Scale Reading Records and Search in a .NET Platform
Laravel Tech Community
Laravel Tech Community
Feb 17, 2022 · Backend Development

Key New Features and Changes in Elasticsearch 8.0 Release

Elasticsearch 8.0 introduces major updates including 7.x REST API compatibility headers, default‑enabled security with registration tokens, protected system indices, a preview KNN search API, storage‑efficient keyword/match_only_text/text fields, faster indexing for geo_point and geo_shape, PyTorch model support, and numerous deprecations and enhancements across aggregations, allocation, analysis, authentication, cluster coordination, and engine components.

BackendElasticsearchKNN
0 likes · 8 min read
Key New Features and Changes in Elasticsearch 8.0 Release
MaGe Linux Operations
MaGe Linux Operations
Feb 15, 2022 · Backend Development

What’s New in Elasticsearch 8.0? Key Features, Security, and API Changes

Elasticsearch 8.0 introduces major updates including 7.x REST API compatibility headers, default-enabled security with enrollment tokens, protected system indices, a preview KNN search API, storage‑saving field encodings, faster geo indexing, and numerous deprecations and enhancements across aggregations, authentication, cluster coordination, and packaging.

API CompatibilityElasticsearchKNN
0 likes · 10 min read
What’s New in Elasticsearch 8.0? Key Features, Security, and API Changes
Java High-Performance Architecture
Java High-Performance Architecture
Feb 15, 2022 · Backend Development

What’s New in Elasticsearch 8.0? Key Features, Security Enhancements, and Performance Boosts

Elasticsearch 8.0 introduces 7.x REST API compatibility headers, default‑on security features with automatic enrollment tokens, tighter protection of system indices, a preview KNN search API, storage‑saving field encodings, faster geo‑point and geo‑shape indexing, PyTorch model support, and a long list of deprecations and internal improvements.

BackendElasticsearchsearch engine
0 likes · 10 min read
What’s New in Elasticsearch 8.0? Key Features, Security Enhancements, and Performance Boosts
政采云技术
政采云技术
Feb 15, 2022 · Big Data

Performance Investigation and Optimization of an Elasticsearch Search Service

This article describes a performance bottleneck in a high‑traffic search service, details the investigation of hardware limits, long‑tail query impact, load‑testing methodology, and the subsequent optimizations—including SSD upgrade, data‑structure reduction, and Elasticsearch segment tuning—that reduced disk I/O and improved throughput.

ElasticsearchSegment Optimizationdisk I/O
0 likes · 11 min read
Performance Investigation and Optimization of an Elasticsearch Search Service
Top Architect
Top Architect
Feb 14, 2022 · Databases

Elasticsearch Fundamentals: Architecture, Indexing, Sharding, and Performance Optimization

This comprehensive guide explains Elasticsearch’s core concepts—including its distributed architecture, indexing process, shard routing, refresh and translog mechanisms, segment merging, and performance tuning—while providing practical examples and configuration tips for building scalable, near‑real‑time search solutions.

Elasticsearchindexingperformance tuning
0 likes · 35 min read
Elasticsearch Fundamentals: Architecture, Indexing, Sharding, and Performance Optimization
Big Data Technology & Architecture
Big Data Technology & Architecture
Feb 13, 2022 · Big Data

What's New in Elasticsearch 8.0 – Key Features and Changes

The article provides a comprehensive overview of Elasticsearch 8.0, highlighting major updates such as 7.x REST API compatibility headers, default-enabled security, system‑index protection, a new KNN search API, storage and indexing optimizations, PyTorch model support, and numerous deprecations and feature removals across the stack.

8.0APIElasticsearch
0 likes · 10 min read
What's New in Elasticsearch 8.0 – Key Features and Changes
Programmer DD
Programmer DD
Feb 12, 2022 · Databases

What’s New in Elasticsearch 8.0? Key Features and Migration Tips

Elasticsearch 8.0 introduces major changes such as 7.x REST API compatibility headers, default‑enabled security with registration tokens, protected system indices, a technical preview of KNN search, storage‑saving field encodings, faster geo‑point indexing, PyTorch model support for NLP, and numerous deprecations and improvements across aggregations, allocation, analysis, authentication, cluster coordination, and packaging.

APIElasticsearchKNN
0 likes · 10 min read
What’s New in Elasticsearch 8.0? Key Features and Migration Tips
HelloTech
HelloTech
Feb 10, 2022 · Operations

Elasticsearch Allocation Deciders: Overview, Configuration, and Core Algorithms

Elasticsearch’s AllocationDecider abstract class powers dynamic shard placement, with concrete deciders—such as awareness, rebalance, disk‑threshold, filter, version, and snapshot—controlling node selection, replication, and movement, while the AllocationService and its default BalancedShardsAllocator use weighted balance formulas to allocate, relocate, and rebalance shards whenever index changes, settings updates, or cluster state transitions occur.

AllocationDeciderClusterManagementConfiguration
0 likes · 12 min read
Elasticsearch Allocation Deciders: Overview, Configuration, and Core Algorithms
Architect
Architect
Feb 6, 2022 · Big Data

Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization

This article provides a comprehensive introduction to Elasticsearch, covering data types, Lucene fundamentals, inverted indexes, cluster components, node roles, shard and replica mechanisms, mapping, installation, health monitoring, write path, storage strategies, segment management, refresh and translog processes, as well as practical performance and JVM tuning tips.

Distributed SearchElasticsearchPerformance Optimization
0 likes · 37 min read
Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization
dbaplus Community
dbaplus Community
Jan 26, 2022 · Big Data

Why Does Elasticsearch Aggregate Faster with Fewer Terms? Uncover the Secrets

This article examines a real‑world Elasticsearch cluster handling hundreds of terabytes, explains why high‑cardinality aggregations can be slower, and shows how setting execution_hint=map and tuning doc_values dramatically improves aggregation performance for ultra‑high‑concurrency workloads.

AggregationData AnalyticsElasticsearch
0 likes · 12 min read
Why Does Elasticsearch Aggregate Faster with Fewer Terms? Uncover the Secrets
Top Architect
Top Architect
Jan 25, 2022 · Big Data

Elasticsearch Cluster Deployment and Management Guide (Mac/Windows)

This article explains why Elasticsearch should run in a cluster, describes the cluster concept, provides step‑by‑step configuration for three nodes on macOS/Windows, demonstrates health checks, failover, horizontal scaling, routing calculations, shard control, and the read/write workflow, all illustrated with code snippets and screenshots.

ClusterElasticsearchhigh availability
0 likes · 10 min read
Elasticsearch Cluster Deployment and Management Guide (Mac/Windows)
Qingyun Technology Community
Qingyun Technology Community
Jan 19, 2022 · Frontend Development

How to Build a Powerful Advanced Search UI with Dynamic Filters

This article explains the design and step‑by‑step implementation of an advanced search interface that lets users configure multiple conditions, choose operators based on field types, and define logical relationships, ultimately generating a FilterConfig that can be sent to Elasticsearch for precise data retrieval.

ElasticsearchTypeScriptadvanced-search
0 likes · 8 min read
How to Build a Powerful Advanced Search UI with Dynamic Filters
Java Interview Crash Guide
Java Interview Crash Guide
Jan 18, 2022 · Databases

Why We Switched from SQL Server to Elasticsearch: A Real‑World Scaling Journey

This article shares a practical experience of replacing a massive SQL Server data store with Elasticsearch, covering the motivations, architectural design, performance advantages, indexing mechanisms, data synchronization strategies, implementation details, and operational considerations for handling tens of billions of records.

Database ScalingElasticsearchNoSQL
0 likes · 38 min read
Why We Switched from SQL Server to Elasticsearch: A Real‑World Scaling Journey
Architecture Digest
Architecture Digest
Jan 15, 2022 · Databases

Designing and Implementing Elasticsearch for Large‑Scale Data Search and Storage

This article details the business background, technical advantages, architecture, indexing mechanisms, clustering, data synchronization strategies, API design, and performance monitoring of Elasticsearch, illustrating how it replaces costly SQL LIKE queries with a scalable, high‑performance search solution for massive user activity data.

ElasticsearchNoSQLdata synchronization
0 likes · 29 min read
Designing and Implementing Elasticsearch for Large‑Scale Data Search and Storage
Architecture Digest
Architecture Digest
Jan 10, 2022 · Operations

Comprehensive Guide to Deploying Filebeat and Graylog for Centralized Log Collection

This article explains how to use Filebeat and Graylog together for centralized log collection, covering Filebeat’s role, configuration files, input modules, Graylog’s architecture, pipeline rules, and step‑by‑step deployment using Docker and docker‑compose, providing practical commands and examples for operational environments.

DockerElasticsearchFilebeat
0 likes · 14 min read
Comprehensive Guide to Deploying Filebeat and Graylog for Centralized Log Collection
Efficient Ops
Efficient Ops
Jan 9, 2022 · Operations

How to Collect Nginx Access and Error Logs with Filebeat, Logstash, and Rsyslog

This guide demonstrates multiple ways to gather Nginx access and error logs—directly with Filebeat to Elasticsearch, via Filebeat to Logstash then Elasticsearch, and using rsyslog to forward logs to Logstash—providing step‑by‑step configurations, code snippets, and visual illustrations for each method.

ElasticsearchFilebeatLog Collection
0 likes · 9 min read
How to Collect Nginx Access and Error Logs with Filebeat, Logstash, and Rsyslog
21CTO
21CTO
Jan 4, 2022 · Operations

Deploy Searchable Snapshots in Elasticsearch 7.14: A Complete Step‑by‑Step Guide

This article explains the principles behind Elasticsearch searchable snapshots, details the DataTier model and node role optimizations, and provides a full practical walkthrough—including cluster setup, COS repository creation, ILM policy configuration, index templates, mounting strategies, and performance considerations—using ES 7.14.2.

Data TierElasticsearchILM
0 likes · 15 min read
Deploy Searchable Snapshots in Elasticsearch 7.14: A Complete Step‑by‑Step Guide
Tencent Music Tech Team
Tencent Music Tech Team
Jan 4, 2022 · Big Data

Elasticsearch Fundamentals: Architecture, Indexing, Query DSL and Search Mechanics

Elasticsearch is a distributed, schemaless search engine built on Lucene that stores JSON documents in sharded indexes, uses immutable segments and merges, provides a flexible Query DSL with aggregations and relevance scoring, and executes distributed query‑then‑fetch searches with features like scrolling, optimistic locking, and zero‑downtime reindexing.

AnalyzersDistributed ArchitectureElasticsearch
0 likes · 26 min read
Elasticsearch Fundamentals: Architecture, Indexing, Query DSL and Search Mechanics
Tencent Cloud Developer
Tencent Cloud Developer
Dec 31, 2021 · Big Data

Searchable Snapshots in Elasticsearch 7.14: Principles and Practical Implementation

The article explains Elasticsearch 7.14’s production‑ready searchable snapshot feature, detailing tiered node roles, allocation preferences, full and partial mount types, and provides a step‑by‑step Tencent Cloud COS setup—including license activation, repository creation, ILM policy, index template and automatic mounting—to achieve cost‑effective, large‑scale data storage.

Cold TierData TierElasticsearch
0 likes · 14 min read
Searchable Snapshots in Elasticsearch 7.14: Principles and Practical Implementation
Open Source Linux
Open Source Linux
Dec 29, 2021 · Backend Development

How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes

This article explains how Elasticsearch uses inverted indexes, term dictionaries, and compression techniques like FOR and Roaring Bitmaps to enable rapid full‑text search, contrasting its approach with traditional relational databases and offering practical indexing tips for large‑scale applications.

CompressionElasticsearchLucene
0 likes · 15 min read
How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes
Java Captain
Java Captain
Dec 18, 2021 · Databases

Performance Benchmark of RedisJSON vs MongoDB and ElasticSearch

The report presents extensive YCSB‑based performance benchmarks showing that RedisJSON (with RediSearch) outperforms MongoDB and ElasticSearch by large margins in isolated writes, isolated reads, mixed workloads, and latency across a variety of operation mixes on identical AWS hardware.

BenchmarkElasticsearchMongoDB
0 likes · 15 min read
Performance Benchmark of RedisJSON vs MongoDB and ElasticSearch
JD Cloud Developers
JD Cloud Developers
Dec 15, 2021 · Big Data

How JD Retail Scales Billion‑Item Selection with ClickHouse & Elasticsearch

This article details JD Retail's strategic "Nirvana" product‑selection platform, describing the technical challenges of handling billions of items and hundreds of tags, and presenting a dual‑engine solution using ClickHouse and Elasticsearch with Spark‑driven data pipelines to achieve fast filtering, multidimensional analytics, and efficient storage.

ClickHouseElasticsearchProduct Selection
0 likes · 15 min read
How JD Retail Scales Billion‑Item Selection with ClickHouse & Elasticsearch
HelloTech
HelloTech
Dec 13, 2021 · Big Data

Smart Matching Engine for Ride-Sharing: Technical Implementation and Algorithms

The Smart Matching Engine for Haolo’s ride‑sharing service ingests driver and passenger orders via Kafka‑Flink pipelines into Elasticsearch, then applies multi‑stage matching—nearby search, itinerary‑based filtering using ETA, angle, distance, route‑similarity and shared‑mileage calculations—and finally ranks results with evolving pre‑sorting and algorithmic models, including PMML and deep‑learning, to optimize driver‑passenger pairing.

ElasticsearchFlinkKafka
0 likes · 9 min read
Smart Matching Engine for Ride-Sharing: Technical Implementation and Algorithms
Top Architect
Top Architect
Dec 12, 2021 · Databases

Elasticsearch Cluster and Data Layer Architecture Overview

This article explains Elasticsearch’s cluster and data layer architecture, covering nodes, indices, shards, replicas, mixed and tiered deployment models, storage options, and the trade‑offs of different distributed system designs for scalable systems.

ElasticsearchReplicacluster architecture
0 likes · 14 min read
Elasticsearch Cluster and Data Layer Architecture Overview
政采云技术
政采云技术
Dec 9, 2021 · Fundamentals

Understanding Elasticsearch Inverted Index and Its Optimization Techniques

This article explains how Elasticsearch leverages Lucene's inverted index, term dictionaries, and posting list compression methods such as FST and Frame‑of‑Reference to achieve fast, accurate, and tolerant search performance, while also discussing practical implementation details and examples.

ElasticsearchPosting List Compressionfst
0 likes · 11 min read
Understanding Elasticsearch Inverted Index and Its Optimization Techniques
Open Source Linux
Open Source Linux
Dec 8, 2021 · Backend Development

How Elasticsearch Uses Lucene’s Inverted Index for Lightning‑Fast Search

This article explains how Elasticsearch leverages Lucene’s inverted index, detailing the structure of term dictionaries, postings lists, compression techniques like Frame‑of‑Reference and Roaring Bitmaps, and query optimizations such as filter caches and skip‑list intersections to achieve fast, memory‑efficient search.

CompressionElasticsearchLucene
0 likes · 19 min read
How Elasticsearch Uses Lucene’s Inverted Index for Lightning‑Fast Search
Programmer DD
Programmer DD
Dec 8, 2021 · Operations

Master Log Collection with Filebeat and Graylog: A Step‑by‑Step Guide

This article explains why centralized log collection is essential for multi‑environment services, introduces Graylog’s architecture, details Filebeat’s role and workflow, provides configuration examples, and walks through Docker‑based deployment of both Filebeat and Graylog for robust log management.

DockerElasticsearchFilebeat
0 likes · 14 min read
Master Log Collection with Filebeat and Graylog: A Step‑by‑Step Guide
Programmer DD
Programmer DD
Dec 3, 2021 · Backend Development

Build a File Upload & Search System with Elasticsearch and IK Analyzer

This guide walks through creating a file upload service that indexes Word, PDF, and TXT files in Elasticsearch, uses an ingest‑attachment pipeline to extract text, configures Chinese IK analyzers for precise keyword search, and demonstrates Java code for indexing, querying, and highlighting results.

ElasticsearchIK analyzerIngest Pipeline
0 likes · 12 min read
Build a File Upload & Search System with Elasticsearch and IK Analyzer
DataFunSummit
DataFunSummit
Dec 2, 2021 · Backend Development

Integrating Elasticsearch with Spring Boot: A Step‑by‑Step Guide

This article explains how to integrate Elasticsearch into a Spring Boot project, covering version compatibility, supported access methods, dependency setup, configuration, entity mapping with annotations, repository creation, and unit testing to verify successful indexing and retrieval.

Backend DevelopmentElasticsearchJava
0 likes · 9 min read
Integrating Elasticsearch with Spring Boot: A Step‑by‑Step Guide
21CTO
21CTO
Nov 27, 2021 · Backend Development

Three Common System Architecture Patterns Every Backend Engineer Should Know

This article introduces three widely used system architecture designs—single‑database single‑application, content distribution with CDN/OSS, and read‑write separation with master‑slave databases and Elasticsearch—detailing their structures, advantages, disadvantages, and typical usage scenarios.

CDNContent DistributionElasticsearch
0 likes · 7 min read
Three Common System Architecture Patterns Every Backend Engineer Should Know
Qunar Tech Salon
Qunar Tech Salon
Nov 24, 2021 · Databases

Comprehensive Guide to Elasticsearch Index Design, Settings, and Mapping

This article provides a detailed guide on Elasticsearch index design, covering index settings, shard and replica planning, mapping strategies, complex types, lifecycle management, template usage, and practical best‑practice recommendations for large‑scale log data clusters.

ElasticsearchMappingSettings
0 likes · 27 min read
Comprehensive Guide to Elasticsearch Index Design, Settings, and Mapping
政采云技术
政采云技术
Nov 18, 2021 · Databases

Elasticsearch Series Part 1: Introduction to System Concepts and Read/Write Flow

This article introduces Elasticsearch as a distributed, high‑performance search engine, explains its cluster architecture, node roles, shard and replica mechanisms, write and refresh processes, and outlines search handling techniques such as pagination, scroll and search‑after with practical curl examples.

Distributed SearchElasticsearchSearch API
0 likes · 11 min read
Elasticsearch Series Part 1: Introduction to System Concepts and Read/Write Flow
Java High-Performance Architecture
Java High-Performance Architecture
Nov 12, 2021 · Databases

Elasticsearch Cluster Architecture: Nodes, Shards, and Deployment Options

This article explains the core concepts of Elasticsearch’s distributed architecture—including nodes, indices, shards, replicas—and compares mixed and tiered deployment models, while also discussing data storage strategies, replica benefits, and the trade‑offs of local‑file versus shared‑storage distributed systems.

ElasticsearchReplicadistributed systems
0 likes · 15 min read
Elasticsearch Cluster Architecture: Nodes, Shards, and Deployment Options
Java Interview Crash Guide
Java Interview Crash Guide
Nov 11, 2021 · Big Data

How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes and Compression

This article explains how Elasticsearch uses inverted indexes, term dictionaries, and advanced compression techniques like Frame of Reference and Roaring Bitmaps to enable rapid, scalable search over massive datasets, contrasting its approach with traditional relational database queries and detailing practical optimization tips.

CompressionElasticsearchLucene
0 likes · 16 min read
How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes and Compression
Programmer DD
Programmer DD
Nov 4, 2021 · Backend Development

How Elasticsearch Achieves Near Real-Time Search: Core Mechanisms Explained

This article explains how Elasticsearch implements near real-time search by using immutable inverted indexes, segment merging, shard distribution, and a translog for durability, detailing the challenges of persistence, disk I/O, and data recovery in a distributed environment.

ElasticsearchNear Real-Time Searchdata persistence
0 likes · 9 min read
How Elasticsearch Achieves Near Real-Time Search: Core Mechanisms Explained
dbaplus Community
dbaplus Community
Oct 21, 2021 · Databases

How We Scaled an E‑commerce Order System with Sharding, Consistent Hashing, and Zero‑Downtime Migration

This article details how a rapidly growing e‑commerce platform migrated from a single MySQL instance to a 16‑shard architecture using Sharding‑Jdbc, introduced consistent‑hashing to mitigate data skew, leveraged ES+HBase for multi‑dimensional queries, and implemented zero‑downtime migration strategies such as dual‑write and Canal replication.

Database ScalingElasticsearchHBase
0 likes · 21 min read
How We Scaled an E‑commerce Order System with Sharding, Consistent Hashing, and Zero‑Downtime Migration
Code Ape Tech Column
Code Ape Tech Column
Oct 21, 2021 · Backend Development

Integrating Spring Cloud Sleuth and Zipkin for Distributed Tracing in Microservices

This tutorial explains the principles of distributed tracing, why it is needed for microservice architectures, and provides step‑by‑step instructions for adding Spring Cloud Sleuth and Zipkin—including Maven dependencies, configuration, Docker deployment, and Elasticsearch persistence—to a Spring Cloud project.

DockerElasticsearchSleuth
0 likes · 14 min read
Integrating Spring Cloud Sleuth and Zipkin for Distributed Tracing in Microservices
Java High-Performance Architecture
Java High-Performance Architecture
Oct 14, 2021 · Operations

Build a Real‑Time Log Collection Pipeline with SpringBoot, Kafka, Filebeat, Logstash & Kibana

This guide walks through setting up a complete log‑collection and visualization pipeline—including SpringBoot log4j2 configuration, Kafka broker creation, Filebeat forwarding, Logstash processing, and Kibana dashboard setup—so you can capture, ship, and analyze application logs in real time.

ElasticsearchFilebeatKafka
0 likes · 17 min read
Build a Real‑Time Log Collection Pipeline with SpringBoot, Kafka, Filebeat, Logstash & Kibana
Efficient Ops
Efficient Ops
Oct 11, 2021 · Operations

Collect Nginx Access & Error Logs with Filebeat, Logstash, and Rsyslog

This guide walks through three practical methods for harvesting Nginx access and error logs—directly with Filebeat to Elasticsearch, via Filebeat‑Logstash‑Elasticsearch pipeline, and using Rsyslog to forward logs to Logstash—complete with configuration snippets and visual illustrations.

ElasticsearchFilebeatLog Collection
0 likes · 8 min read
Collect Nginx Access & Error Logs with Filebeat, Logstash, and Rsyslog
Sohu Tech Products
Sohu Tech Products
Oct 6, 2021 · Databases

Elasticsearch Cluster Architecture and Distributed System Design

This article explains the architecture of Elasticsearch clusters, covering node roles, index, shard and replica concepts, deployment models, data storage mechanisms, and compares two distributed system designs—local‑file‑system and shared‑file‑system—highlighting their advantages and trade‑offs.

Data StorageElasticsearchReplication
0 likes · 14 min read
Elasticsearch Cluster Architecture and Distributed System Design
IT Architects Alliance
IT Architects Alliance
Oct 6, 2021 · Big Data

Understanding Elasticsearch Inverted Index and Efficient Search Retrieval

This article explains how Elasticsearch uses inverted indexes, term dictionaries, and postings lists—along with compression techniques like Frame of Reference and Roaring Bitmaps—to achieve fast, memory‑efficient search queries, and provides practical tips for optimizing indexing and query performance.

CompressionElasticsearchLucene
0 likes · 14 min read
Understanding Elasticsearch Inverted Index and Efficient Search Retrieval
Tongcheng Travel Technology Center
Tongcheng Travel Technology Center
Sep 30, 2021 · Operations

High‑Availability Architecture Design for the Integrated Membership System of Tongcheng and eLong

This article details the design and implementation of a high‑performance, highly available membership system for the merged Tongcheng‑eLong platform, covering Elasticsearch dual‑center clusters, traffic‑isolated three‑cluster architecture, deep ES optimizations, Redis caching and dual‑center clusters, MySQL dual‑center partitioning, migration strategies, and future fine‑grained flow‑control and degradation measures.

ElasticsearchMySQLRedis
0 likes · 21 min read
High‑Availability Architecture Design for the Integrated Membership System of Tongcheng and eLong
IT Architects Alliance
IT Architects Alliance
Sep 29, 2021 · Databases

Understanding Elasticsearch Inverted Index: Fast Retrieval, Compression, and Query Techniques

This article explains how Elasticsearch uses inverted index structures—including term dictionaries, term indexes, and postings lists—combined with compression methods like Frame‑of‑Reference and Roaring Bitmaps to achieve fast search, efficient storage, and effective union queries compared to traditional relational databases.

CompressionElasticsearchLucene
0 likes · 14 min read
Understanding Elasticsearch Inverted Index: Fast Retrieval, Compression, and Query Techniques
macrozheng
macrozheng
Sep 22, 2021 · Backend Development

Build a Real-Time Log Pipeline with SpringBoot, Kafka, Filebeat, Logstash and Kibana

This guide walks through setting up a complete log‑collection and visualization pipeline—preparing servers, configuring a SpringBoot project with Log4j2, deploying Kafka, installing Filebeat, creating Logstash pipelines, and visualizing logs in Elasticsearch and Kibana—so you can monitor application logs in real time.

ElasticsearchFilebeatKafka
0 likes · 17 min read
Build a Real-Time Log Pipeline with SpringBoot, Kafka, Filebeat, Logstash and Kibana
DevOps Cloud Academy
DevOps Cloud Academy
Sep 21, 2021 · Operations

Practical Elasticsearch Operations and Performance Tuning Guide

This article extends previous Elasticsearch cheat sheets with practical commands and step‑by‑step instructions for shard allocation, replica adjustment, cluster settings, slow‑log configuration, mapping routing, force merge, bulk writes, refresh intervals, translog durability, heap sizing, disk‑space monitoring, and troubleshooting strategies.

ElasticsearchOperationscluster-management
0 likes · 7 min read
Practical Elasticsearch Operations and Performance Tuning Guide
Top Architect
Top Architect
Sep 21, 2021 · Databases

Elasticsearch Cluster Architecture and Deployment Strategies

This article explains Elasticsearch's core concepts—nodes, indices, shards, and replicas—describes the indexing flow, compares mixed and layered deployment models, and discusses data‑layer architectures, helping readers choose the appropriate cluster design for reliability and scalability.

Cluster DeploymentElasticsearchReplica
0 likes · 13 min read
Elasticsearch Cluster Architecture and Deployment Strategies
Top Architect
Top Architect
Sep 16, 2021 · Backend Development

Building a Log Collection and Visualization Pipeline with SpringBoot, Log4j2, Kafka, Filebeat, Logstash, Elasticsearch, and Kibana

This tutorial walks through the end‑to‑end setup of a logging pipeline that starts with a SpringBoot application using Log4j2, forwards logs to Kafka, collects them with Filebeat, processes them via Logstash, and finally visualizes them in Elasticsearch and Kibana, covering server preparation, configuration files, and essential code snippets.

ElasticsearchFilebeatKafka
0 likes · 17 min read
Building a Log Collection and Visualization Pipeline with SpringBoot, Log4j2, Kafka, Filebeat, Logstash, Elasticsearch, and Kibana
Selected Java Interview Questions
Selected Java Interview Questions
Sep 15, 2021 · Big Data

Performance and Feature Comparison between Elasticsearch and ClickHouse for Log Analytics

This article compares Elasticsearch and ClickHouse in terms of architecture, query capabilities, and performance for log analytics, presenting test setups, Docker‑compose configurations, query examples, and benchmark results that show ClickHouse generally outperforms Elasticsearch in most basic query scenarios.

ClickHouseElasticsearchLog Analytics
0 likes · 12 min read
Performance and Feature Comparison between Elasticsearch and ClickHouse for Log Analytics
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Sep 14, 2021 · Backend Development

How to Efficiently Batch Insert Data with Spring Boot and Elasticsearch

This guide demonstrates how to set up Spring Boot 2.3.12 with Elasticsearch 7.8, configure separate JPA and Elasticsearch repositories, and implement two batch insertion methods—using ElasticsearchRestTemplate and repository saveAll—while measuring performance, showing comparable execution times for inserting 10,000 records.

Backend DevelopmentBatch InsertElasticsearch
0 likes · 4 min read
How to Efficiently Batch Insert Data with Spring Boot and Elasticsearch
Top Architect
Top Architect
Sep 9, 2021 · Big Data

Building a Site Search Engine with Elasticsearch, Spring Boot, and IK Analyzer

This article demonstrates how to construct a full‑text site search solution by selecting Elasticsearch as the search engine, Spring Boot for the backend service, and the IK analyzer for Chinese tokenization, covering environment setup, project architecture, key code implementations, UI pages, and a concise conclusion on the effectiveness of the approach.

Backend DevelopmentElasticsearchIK analyzer
0 likes · 18 min read
Building a Site Search Engine with Elasticsearch, Spring Boot, and IK Analyzer
IT Architects Alliance
IT Architects Alliance
Sep 8, 2021 · Operations

How to Build a Real‑Time ELK Log Analysis Platform on Ubuntu

This step‑by‑step guide explains how to set up the open‑source ELK stack (Elasticsearch, Logstash, Kibana) on an Ubuntu machine, configure Logstash as shipper and indexer, integrate Spring Boot and Nginx logs, and run the whole platform as a background service using Supervisor.

ELKElasticsearchKibana
0 likes · 19 min read
How to Build a Real‑Time ELK Log Analysis Platform on Ubuntu
Selected Java Interview Questions
Selected Java Interview Questions
Sep 7, 2021 · Big Data

Elasticsearch Basics: Core Concepts, Indexing, Write and Search Processes, Cluster Management and Performance Tips

This article provides a comprehensive overview of Elasticsearch, covering its fundamental architecture, key concepts such as indices, shards and replicas, the complete write and search workflows, consistency mechanisms, master node election, and practical performance‑tuning recommendations for large‑scale deployments.

Elasticsearchbig datacluster-management
0 likes · 15 min read
Elasticsearch Basics: Core Concepts, Indexing, Write and Search Processes, Cluster Management and Performance Tips
Architect
Architect
Sep 4, 2021 · Databases

Understanding Elasticsearch Fast Retrieval: Inverted Index, Term Dictionary, and Compression Techniques

This article explains how Elasticsearch achieves fast data retrieval by comparing it with traditional relational databases, detailing search engine fundamentals, the structure of Lucene's inverted index—including term dictionaries, postings lists, and term indexes—and the compression techniques such as Frame of Reference and Roaring Bitmaps that optimize storage and query performance.

CompressionElasticsearchLucene
0 likes · 14 min read
Understanding Elasticsearch Fast Retrieval: Inverted Index, Term Dictionary, and Compression Techniques
Programmer DD
Programmer DD
Sep 3, 2021 · Backend Development

How to Set Default Values in Elasticsearch: Pipelines, Scripts, and Workarounds

This article explains three practical methods for assigning default values in Elasticsearch—using ingest pipelines, update‑by‑query scripts, and pipeline scripts—while also addressing how to maintain create_time and update_time fields in a way similar to relational databases.

BackendDefault ValuesElasticsearch
0 likes · 6 min read
How to Set Default Values in Elasticsearch: Pipelines, Scripts, and Workarounds
Tencent Cloud Developer
Tencent Cloud Developer
Aug 26, 2021 · Big Data

Recap of Shenzhen Elasticsearch Meetup – Community Growth, Compression Optimization, Real‑time Data Fusion, and Cluster Practices

The first Shenzhen Elasticsearch meetup on August 21, 2021, jointly hosted by the ES Chinese community and Tencent Cloud, gathered experts from Tencent, Tapdata, ByteDance and Vivo to showcase rapid community growth, compression‑encoding optimizations, real‑time ES‑MongoDB data fusion, custom kernel extensions, large‑scale cluster practices, and concluded with extensive Q&A and networking.

CompressionElasticsearchReal-time Data Fusion
0 likes · 11 min read
Recap of Shenzhen Elasticsearch Meetup – Community Growth, Compression Optimization, Real‑time Data Fusion, and Cluster Practices
dbaplus Community
dbaplus Community
Aug 22, 2021 · Operations

Master Elasticsearch Performance: Memory, CPU, Shards, and Cluster Tuning

This guide presents practical best‑practice configurations for Elasticsearch clusters in production, covering JVM heap sizing, CPU thread‑pool tuning, optimal shard counts, replica strategies, hot‑warm node architecture, node role settings, common troubleshooting tips, cache handling, refresh intervals, and essential monitoring APIs.

ClusterElasticsearchMemory
0 likes · 14 min read
Master Elasticsearch Performance: Memory, CPU, Shards, and Cluster Tuning
MaGe Linux Operations
MaGe Linux Operations
Aug 22, 2021 · Information Security

What Happens When an Elasticsearch Database Exposes 2 Million Sensitive Records?

In July, security researcher Bob Diachenko uncovered an exposed Elasticsearch cluster leaking nearly two million personal records—including passport details and no‑fly indicators—highlighting the severe impact of unsecured Elasticsearch deployments and offering recommendations to prevent future breaches.

Elasticsearchdata breachinformation security
0 likes · 5 min read
What Happens When an Elasticsearch Database Exposes 2 Million Sensitive Records?
Top Architect
Top Architect
Aug 19, 2021 · Backend Development

Comprehensive Domain Interface Design and Implementation in Java Backend Systems

This article explores comprehensive domain interface design in Java backend development, showing how to model domain objects as interfaces, implement repositories for JPA, MyBatis, and Elasticsearch, handle associations with JPA annotations, and apply these patterns in the open‑source Mallfoundry e‑commerce platform.

Domain-Driven DesignElasticsearchJPA
0 likes · 8 min read
Comprehensive Domain Interface Design and Implementation in Java Backend Systems
Sohu Tech Products
Sohu Tech Products
Aug 18, 2021 · Databases

Understanding Slow Queries, Index Optimization, and Search Solutions with MySQL, Elasticsearch, and HBase

This article explains why MySQL queries become slow, how proper indexing and index‑pushdown can improve performance, discusses common index‑failure causes, and then introduces Elasticsearch and HBase as complementary search and storage solutions for large‑scale data, including practical usage tips and architectural considerations.

ElasticsearchHBaseMySQL
0 likes · 18 min read
Understanding Slow Queries, Index Optimization, and Search Solutions with MySQL, Elasticsearch, and HBase
Top Architect
Top Architect
Aug 18, 2021 · Big Data

Elasticsearch Indexing and Retrieval Optimization for Billion‑Scale Data

This article describes how a top architect optimized Elasticsearch for handling billions of records, covering Lucene fundamentals, index and shard design, DocValues, query performance tuning, bulk indexing strategies, hardware considerations, and testing methods to achieve sub‑second query responses across multi‑year data ranges.

ElasticsearchIndex OptimizationLucene
0 likes · 12 min read
Elasticsearch Indexing and Retrieval Optimization for Billion‑Scale Data
Tencent Cloud Developer
Tencent Cloud Developer
Aug 17, 2021 · Big Data

Elasticsearch Technical Event in Shenzhen

The Shenzhen Elasticsearch technical event, co‑hosted by the Elastic Chinese community and Tencent Cloud, presented practical sessions on optimizing the Elastic Stack for search, real‑time analytics, logging, security and APM, featuring compression encoding, MongoDB fusion, ByteDance extensions, cost‑effective log storage, Lucene indexing, cross‑cluster replication, vector engine integration, and large‑scale case studies from Tencent, Tiptop Data and vivo.

ElasticsearchMongoDBReal-time Data
0 likes · 4 min read
Elasticsearch Technical Event in Shenzhen
Qunar Tech Salon
Qunar Tech Salon
Aug 16, 2021 · Operations

Design and Practice of Qunar Data Synchronization Platform: ES Multi‑Version Migration, High Availability, and Data Consistency

The article details Qunar's data synchronization platform that aggregates MySQL data into Elasticsearch, covering its architecture, component choices, ES5‑to‑ES7 migration, hot‑plugging, reindexing, high‑availability design, consistency guarantees, operational optimizations, and future roadmap.

ETLElasticsearchMySQL
0 likes · 16 min read
Design and Practice of Qunar Data Synchronization Platform: ES Multi‑Version Migration, High Availability, and Data Consistency
Top Architect
Top Architect
Aug 14, 2021 · Big Data

Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization

This article provides a comprehensive introduction to Elasticsearch, covering its underlying Lucene-based inverted index, data types, shard routing, cluster roles, discovery mechanisms, refresh and translog handling, segment merging, and practical performance and JVM tuning tips for building scalable, near‑real‑time search systems.

Elasticsearchindexingperformance tuning
0 likes · 35 min read
Elasticsearch Overview: Architecture, Core Concepts, and Performance Optimization