BestHub
Sign in
Tagged articles
48 articles
Page 1 of 1
MaGe Linux Operations
MaGe Linux Operations
Aug 9, 2024 · Operations

Mastering Elasticsearch Data Sync and Cluster Architecture: Strategies & Best Practices

This article explains how to keep MySQL and Elasticsearch data in sync using synchronous calls, asynchronous notifications, or binlog listeners, and dives deep into Elasticsearch cluster design, node roles, distributed storage, query phases, split‑brain handling, and fault‑tolerance mechanisms.

Cluster ArchitectureDistributed QueryElasticsearch
0 likes · 8 min read
Mastering Elasticsearch Data Sync and Cluster Architecture: Strategies & Best Practices
Architect
Architect
Oct 29, 2023 · Databases

MongoDB Cluster Architecture: Master‑Slave, Replica Set, and Sharding

This article explains MongoDB's three cluster architectures—deprecated Master‑Slave replication, the highly available Replica Set with automatic failover, and horizontal scaling Sharding—detailing their roles, data flow, advantages, limitations, and operational considerations for building reliable, scalable databases.

Cluster ArchitectureDatabase ReplicationMongoDB
0 likes · 13 min read
MongoDB Cluster Architecture: Master‑Slave, Replica Set, and Sharding
Efficient Ops
Efficient Ops
Jul 3, 2022 · Cloud Native

Understanding Kubernetes: Core Components and How They Work Together

This article provides a concise, concept‑level overview of Kubernetes architecture, explaining the roles of master and worker nodes, Pods, networking, scheduling, storage, services, scaling, and controller interactions, illustrated with diagrams to help beginners grasp the system’s complexity.

Cloud NativeCluster ArchitectureKubernetes
0 likes · 10 min read
Understanding Kubernetes: Core Components and How They Work Together
MaGe Linux Operations
MaGe Linux Operations
Jun 19, 2022 · Big Data

Visualizing Kafka: Core Concepts Explained with Diagrams

This article provides a diagram‑driven walkthrough of Kafka’s fundamental concepts—including topics, partitions, producers, consumers, consumer groups, and cluster architecture—explaining how messages flow, are stored, and achieve reliability and ordering within a distributed streaming system.

Cluster ArchitectureKafkaPartitions
0 likes · 6 min read
Visualizing Kafka: Core Concepts Explained with Diagrams
Big Data Technology & Architecture
Big Data Technology & Architecture
Apr 16, 2022 · Databases

ClickHouse Practical Guide: Engine Selection, Cluster Architecture, and Operational Best Practices

This article provides a comprehensive overview of ClickHouse, covering its core use cases, detailed explanations of the various table engines, recommended schema and deployment patterns, performance‑tuning parameters, tooling choices, and operational guidelines for building and maintaining high‑availability OLAP clusters.

Cluster ArchitectureOLAPTable Engines
0 likes · 24 min read
ClickHouse Practical Guide: Engine Selection, Cluster Architecture, and Operational Best Practices
Top Architect
Top Architect
Mar 22, 2022 · Big Data

Elasticsearch Cluster Architecture and Data Layer Design

This article explains Elasticsearch's cluster architecture, including nodes, indices, shards, and replicas, compares mixed and tiered deployment models, discusses the data storage layer and replication trade‑offs, and presents two typical distributed data system designs with their advantages and drawbacks.

Cluster ArchitectureElasticsearchdata replication
0 likes · 14 min read
Elasticsearch Cluster Architecture and Data Layer Design
Big Data Technology & Architecture
Big Data Technology & Architecture
Feb 22, 2022 · Databases

ClickHouse Best Practices: Table Engines, Cluster Architecture, and Operational Guidelines

This guide provides a comprehensive overview of ClickHouse, covering its core use cases, detailed table‑engine choices, cluster design, Zookeeper integration, query and data‑loading best practices, client tools, and key configuration parameters to ensure high performance and reliability in OLAP workloads.

Cluster ArchitectureOLAPTable Engines
0 likes · 23 min read
ClickHouse Best Practices: Table Engines, Cluster Architecture, and Operational Guidelines
DataFunSummit
DataFunSummit
Feb 18, 2022 · Databases

ClickHouse Usage Guide: Application Scenarios, Table Engine Selection, Development Standards, Cluster Architecture, and Configuration

This comprehensive guide introduces ClickHouse as a high‑performance columnar DBMS, outlines its typical OLAP use cases, explains the four families of table engines with detailed MergeTree variants, provides SQL creation syntax, shares development and write best practices, and describes cluster architecture, Zookeeper role, chproxy, client tools, availability considerations, and key configuration parameters.

Cluster ArchitectureSQL Best PracticesTable Engines
0 likes · 22 min read
ClickHouse Usage Guide: Application Scenarios, Table Engine Selection, Development Standards, Cluster Architecture, and Configuration
Top Architect
Top Architect
Dec 12, 2021 · Databases

Elasticsearch Cluster and Data Layer Architecture Overview

This article explains Elasticsearch’s cluster and data layer architecture, covering nodes, indices, shards, replicas, mixed and tiered deployment models, storage options, and the trade‑offs of different distributed system designs for scalable systems.

Cluster ArchitectureElasticsearchreplica
0 likes · 14 min read
Elasticsearch Cluster and Data Layer Architecture Overview
Top Architect
Top Architect
Nov 19, 2021 · Big Data

Understanding Kafka’s Design: Topics, Partitions, Consumer Groups, and Cluster Architecture

This article explains Kafka’s core design concepts—including the role of a message system, topics, partitions, producers, consumers, consumer groups, replica management, controller coordination with Zookeeper, performance optimizations like sequential writes and zero‑copy, and its network thread model—illustrated with diagrams and code snippets.

Cluster ArchitectureKafkaconsumer groups
0 likes · 12 min read
Understanding Kafka’s Design: Topics, Partitions, Consumer Groups, and Cluster Architecture
政采云技术
政采云技术
Nov 18, 2021 · Databases

Elasticsearch Series Part 1: Introduction to System Concepts and Read/Write Flow

This article introduces Elasticsearch as a distributed, high‑performance search engine, explains its cluster architecture, node roles, shard and replica mechanisms, write and refresh processes, and outlines search handling techniques such as pagination, scroll and search‑after with practical curl examples.

Cluster ArchitectureDistributed SearchElasticsearch
0 likes · 11 min read
Elasticsearch Series Part 1: Introduction to System Concepts and Read/Write Flow
Sohu Tech Products
Sohu Tech Products
Oct 6, 2021 · Databases

Elasticsearch Cluster Architecture and Distributed System Design

This article explains the architecture of Elasticsearch clusters, covering node roles, index, shard and replica concepts, deployment models, data storage mechanisms, and compares two distributed system designs—local‑file‑system and shared‑file‑system—highlighting their advantages and trade‑offs.

Cluster ArchitectureElasticsearchReplication
0 likes · 14 min read
Elasticsearch Cluster Architecture and Distributed System Design
Efficient Ops
Efficient Ops
Jul 21, 2021 · Cloud Native

Demystifying Kubernetes: Core Components and How They Work Together

This article provides a concise, question‑driven overview of Kubernetes, explaining the roles of master and node components, pod networking, scheduling, storage, service exposure, scaling, and controller interactions, while summarizing the essential objects and processes that power a cloud‑native cluster.

Cloud NativeCluster ArchitectureContainers
0 likes · 10 min read
Demystifying Kubernetes: Core Components and How They Work Together
IT Architects Alliance
IT Architects Alliance
Apr 5, 2021 · Operations

Design and Implementation of a Handcrafted Distributed Cluster (MyCluster)

This article describes how to design and build a native distributed cluster called MyCluster without using any existing frameworks, covering master‑slave architecture, leader election, split‑brain handling, centralized configuration management, custom communication protocols, state transitions, and client interfaces.

Cluster ArchitectureConfiguration ManagementDistributed Systems
0 likes · 13 min read
Design and Implementation of a Handcrafted Distributed Cluster (MyCluster)
ITPUB
ITPUB
Mar 1, 2021 · Databases

Designing a Scalable Comment Service: Vivo’s MongoDB Architecture Deep Dive

This article details Vivo's journey in building a company‑wide comment platform, explaining why MongoDB was chosen over MySQL, how its sharded cluster is structured, the challenges of shard‑key selection, and the practical steps taken to scale and maintain the system.

Cluster ArchitectureComment SystemDatabase design
0 likes · 10 min read
Designing a Scalable Comment Service: Vivo’s MongoDB Architecture Deep Dive
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Dec 2, 2020 · Databases

How Pika’s Native Distributed Cluster Overcomes Redis Capacity Limits

This article explains Pika’s native distributed cluster architecture, detailing its deployment structure, data distribution with tables and slots, request processing flow, both non‑consistent and Raft‑based log replication, and the enhanced metadata management that enables scalable, high‑availability storage beyond single‑node Redis limitations.

Cluster ArchitecturePikaReplication
0 likes · 10 min read
How Pika’s Native Distributed Cluster Overcomes Redis Capacity Limits
360 Tech Engineering
360 Tech Engineering
Nov 24, 2020 · Databases

Architecture and Design of Pika Native Distributed Cluster

The article explains the background, architecture, data distribution, processing flow, replication mechanisms, and management features of Pika's native distributed cluster, detailing how Etcd, LVS, and RocksDB are used to achieve scalable, persistent Redis-compatible storage with table isolation and flexible slot replication.

Cluster ArchitecturePikaRedis Compatibility
0 likes · 8 min read
Architecture and Design of Pika Native Distributed Cluster
Java Architect Essentials
Java Architect Essentials
Sep 23, 2020 · Big Data

Evolution of JD.com Order Center Elasticsearch Cluster Architecture

The article details how JD.com's order center migrated its massive order query workload from MySQL to Elasticsearch, iteratively improving cluster isolation, node deployment, replica tuning, master‑slave redundancy, version upgrades, and data synchronization while addressing performance pitfalls such as deep pagination and FieldData usage.

Big DataCluster ArchitectureElasticsearch
0 likes · 12 min read
Evolution of JD.com Order Center Elasticsearch Cluster Architecture
Top Architect
Top Architect
Sep 23, 2020 · Big Data

Evolution of JD.com Order Center Elasticsearch Cluster Architecture

This article details how JD.com’s order center migrated its Elasticsearch cluster from a basic, default‑configured setup to a highly available, dual‑cluster architecture with increased replicas, dedicated hardware, version upgrades, and optimized shard and pagination strategies to handle billions of documents and hundreds of millions of daily queries.

Cluster Architecturedata synchronizationhigh availability
0 likes · 12 min read
Evolution of JD.com Order Center Elasticsearch Cluster Architecture
Architect's Tech Stack
Architect's Tech Stack
Sep 13, 2020 · Big Data

Evolution and Optimization of JD Daojia Order Center Elasticsearch Cluster

This article details how JD Daojia's order center migrated from a simple MySQL‑backed system to a high‑throughput Elasticsearch cluster, describing each architectural phase, performance tuning measures, dual‑cluster real‑time backup, version upgrades, data synchronization strategies, and the key pitfalls encountered such as deep pagination and FieldData memory issues.

Cluster ArchitectureDocValuesDual Write
0 likes · 11 min read
Evolution and Optimization of JD Daojia Order Center Elasticsearch Cluster
Big Data Technology & Architecture
Big Data Technology & Architecture
Sep 11, 2020 · Big Data

Evolution of JD.com Order Center Elasticsearch Cluster Architecture

This article details how JD.com's order center migrated its Elasticsearch cluster from a simple, default‑configured setup to a highly available, multi‑replica, dual‑cluster architecture with version upgrades, data synchronization strategies, and performance optimizations to support billions of documents and hundreds of millions of daily queries.

Big DataCluster ArchitectureElasticsearch
0 likes · 12 min read
Evolution of JD.com Order Center Elasticsearch Cluster Architecture
Selected Java Interview Questions
Selected Java Interview Questions
Sep 3, 2020 · Operations

Evolution of JD.com Order Center Elasticsearch Cluster Architecture and Lessons Learned

This article details the progressive evolution of JD.com’s order center Elasticsearch cluster—from its initial default setup through isolation, replica optimization, master‑slave adjustments, and real‑time dual‑cluster backup—highlighting architectural decisions, scaling strategies, synchronization methods, and operational challenges encountered.

Cluster ArchitectureElasticsearchdata synchronization
0 likes · 13 min read
Evolution of JD.com Order Center Elasticsearch Cluster Architecture and Lessons Learned
Laravel Tech Community
Laravel Tech Community
Aug 31, 2020 · Big Data

Evolution of JD Daojia Order System Elasticsearch Cluster Architecture

This article details the step‑by‑step evolution of the JD Daojia order‑center Elasticsearch cluster—from an initial loosely configured deployment to a real‑time dual‑cluster architecture with replica tuning, master‑slave adjustments, data‑sync strategies, and lessons learned about pagination, fielddata, and doc values—highlighting how each phase improved query throughput, stability, and scalability for billions of documents.

Big DataCluster ArchitectureElasticsearch
0 likes · 12 min read
Evolution of JD Daojia Order System Elasticsearch Cluster Architecture
Top Architect
Top Architect
Aug 11, 2020 · Big Data

Kafka Basics and Cluster Architecture Overview

This article provides a comprehensive introduction to Kafka, covering its role as a messaging system, core concepts such as topics, partitions, producers, consumers, and messages, and then delves into the cluster architecture including replicas, consumer groups, controller coordination with Zookeeper, performance optimizations, log segmentation, and network design.

Cluster ArchitectureKafkaMessage Queue
0 likes · 11 min read
Kafka Basics and Cluster Architecture Overview
ITPUB
ITPUB
May 11, 2020 · Operations

Scaling JD.com Order Search: Real‑Time Dual‑Cluster Elasticsearch Architecture

This article details how JD.com’s order center evolved its Elasticsearch deployment from a single, default‑configured cluster to a real‑time, dual‑cluster architecture with replica tuning, master‑slave failover, version upgrades, and optimized data synchronization to handle billions of documents and hundreds of millions of daily queries.

Cluster ArchitectureElasticsearchdata synchronization
0 likes · 13 min read
Scaling JD.com Order Search: Real‑Time Dual‑Cluster Elasticsearch Architecture
Big Data Technology Architecture
Big Data Technology Architecture
Feb 24, 2020 · Operations

Evolution and Optimization of JD.com Order Center Elasticsearch Cluster Architecture

This article details how JD.com’s order center migrated its Elasticsearch cluster through multiple architectural stages—initial deployment, isolation, replica tuning, master‑slave adjustments, and real‑time dual‑cluster backup—while addressing data synchronization, scaling, and performance pitfalls to achieve high availability and query stability.

Cluster ArchitectureElasticsearchJD.com
0 likes · 13 min read
Evolution and Optimization of JD.com Order Center Elasticsearch Cluster Architecture
Qunar Tech Salon
Qunar Tech Salon
Dec 20, 2019 · Big Data

Understanding Flink Cluster Startup and Job Execution Process

This article explains the architecture of a Flink cluster, detailing the startup procedures for JobManager and TaskManager, the three deployment modes, and the end‑to‑end flow of a Flink job from client code through StreamGraph, JobGraph, ExecutionGraph to the physical execution on TaskManagers.

Big DataCluster ArchitectureFlink
0 likes · 10 min read
Understanding Flink Cluster Startup and Job Execution Process
360 Tech Engineering
360 Tech Engineering
Dec 5, 2019 · Databases

Design and Implementation of a High‑Availability InfluxDB Cluster at 360

This article introduces the fundamentals of time‑series databases, explains why InfluxDB was chosen, describes the TSM storage engine and shard concepts, outlines the internal 360 InfluxDB‑HA architecture, compares its performance with a single node, and provides integration and future‑development guidelines.

Cluster ArchitectureInfluxDBmonitoring
0 likes · 8 min read
Design and Implementation of a High‑Availability InfluxDB Cluster at 360
Java Backend Technology
Java Backend Technology
Nov 12, 2019 · Backend Development

How JD.com Scaled Its Order System with Elasticsearch: A Journey Through Cluster Evolution

This article details how JD Daojia's order center migrated from MySQL to Elasticsearch, iteratively refined its ES cluster architecture across five stages, tackled scalability and reliability challenges, and implemented robust data synchronization and optimization techniques to support billions of documents and hundreds of millions of daily queries.

BackendCluster ArchitectureElasticsearch
0 likes · 13 min read
How JD.com Scaled Its Order System with Elasticsearch: A Journey Through Cluster Evolution
Big Data Technology & Architecture
Big Data Technology & Architecture
Nov 2, 2019 · Big Data

Evolution of Elasticsearch Cluster Architecture for JD Daojia Order Center

This article details how JD Daojia's order center migrated its Elasticsearch cluster through multiple architectural stages—from an initial loosely configured setup to a real‑time dual‑cluster solution—addressing scalability, high availability, data synchronization, and performance optimization for billions of documents and hundreds of millions of daily queries.

Big DataCluster ArchitectureElasticsearch
0 likes · 12 min read
Evolution of Elasticsearch Cluster Architecture for JD Daojia Order Center
Big Data Technology Architecture
Big Data Technology Architecture
Sep 16, 2019 · Operations

Evolution of the Elasticsearch Cluster Architecture in JD.com Order System

This article details how JD.com’s order center migrated its Elasticsearch cluster from a basic, mixed‑node setup to a real‑time, dual‑cluster architecture with increased replicas, physical isolation, version upgrades, and a robust data‑sync strategy to handle billions of documents and hundreds of millions of daily queries.

Cluster ArchitectureElasticsearchdata synchronization
0 likes · 13 min read
Evolution of the Elasticsearch Cluster Architecture in JD.com Order System
Java Backend Technology
Java Backend Technology
Sep 4, 2019 · Operations

Scaling JD Daojia Order Search with Elasticsearch: Cluster Evolution Journey

JD Daojia’s order center faced massive query loads, prompting a shift from MySQL to Elasticsearch and a multi‑stage evolution of its ES cluster—from an initial loosely configured setup, through isolation, replica tuning, master‑slave adjustments, to a real‑time dual‑cluster architecture—enhancing stability, throughput, and scalability.

Cluster ArchitectureElasticsearchdata synchronization
0 likes · 13 min read
Scaling JD Daojia Order Search with Elasticsearch: Cluster Evolution Journey
Architecture Digest
Architecture Digest
Aug 19, 2019 · Big Data

Elasticsearch Cluster Architecture and Distributed Data System Design

This article explains Elasticsearch's cluster architecture, including nodes, indices, shards, replicas, deployment models, and data layer storage, and compares two types of distributed data system designs—local file‑system based and shared‑storage based—highlighting their advantages and trade‑offs.

Cluster ArchitectureDistributed SystemsElasticsearch
0 likes · 13 min read
Elasticsearch Cluster Architecture and Distributed Data System Design
ITPUB
ITPUB
Aug 12, 2019 · Operations

How JD.com Scaled Its Order Search with a Real‑Time Dual Elasticsearch Cluster

This article details JD.com’s order center journey from a simple Elasticsearch deployment to a highly available, dual‑cluster architecture, covering isolation, replica tuning, hot‑cold data separation, version upgrades, and practical lessons on pagination, field data, and doc values.

Cluster ArchitectureElasticsearchdata synchronization
0 likes · 13 min read
How JD.com Scaled Its Order Search with a Real‑Time Dual Elasticsearch Cluster
dbaplus Community
dbaplus Community
Dec 27, 2018 · Operations

How JD Daojia Scaled Its Order Search with a Real‑Time Dual Elasticsearch Cluster

This article details how JD Daojia’s order center migrated from MySQL‑only reads to a multi‑stage Elasticsearch architecture, describing each evolution step, data‑sync strategies, performance pitfalls, and the final real‑time active‑passive cluster that ensures high availability for billions of daily queries.

Cluster ArchitectureElasticsearchdata-sync
0 likes · 14 min read
How JD Daojia Scaled Its Order Search with a Real‑Time Dual Elasticsearch Cluster
21CTO
21CTO
Dec 3, 2018 · Operations

How JD Daojia Scaled Its Elasticsearch Cluster to Billions of Docs: Lessons and Pitfalls

This article details JD Daojia's order center Elasticsearch architecture evolution—from a chaotic initial deployment to a real‑time dual‑cluster backup—covering scaling strategies, data synchronization methods, and the practical pitfalls encountered along the way.

Cluster ArchitectureElasticsearchdata synchronization
0 likes · 14 min read
How JD Daojia Scaled Its Elasticsearch Cluster to Billions of Docs: Lessons and Pitfalls
JD Tech
JD Tech
Dec 3, 2018 · Backend Development

Evolution of JD.com Order Center Elasticsearch Cluster Architecture

This article details how JD.com’s order center migrated its Elasticsearch cluster through multiple stages—from an initial unoptimized deployment to a real‑time dual‑cluster backup solution—addressing scalability, reliability, shard tuning, version upgrades, and data synchronization strategies to support billions of documents and hundreds of millions of daily queries.

Cluster ArchitectureElasticsearchJD.com
0 likes · 13 min read
Evolution of JD.com Order Center Elasticsearch Cluster Architecture
Dada Group Technology
Dada Group Technology
Nov 30, 2018 · Big Data

Evolution of JD Daojia Order Center Elasticsearch Cluster: Architecture, Scaling, and Lessons Learned

This article details how JD Daojia's order center migrated from MySQL to a multi‑stage Elasticsearch cluster—covering initial deployment, isolation, replica tuning, primary‑secondary setup, real‑time dual‑cluster upgrades, data synchronization methods, and key pitfalls—to achieve massive scalability, high availability, and performance for billions of orders.

Cluster ArchitectureElasticsearchScalability
0 likes · 13 min read
Evolution of JD Daojia Order Center Elasticsearch Cluster: Architecture, Scaling, and Lessons Learned
Tongcheng Travel Technology Center
Tongcheng Travel Technology Center
Sep 26, 2017 · Operations

Design and Implementation of a High‑Performance, High‑Reliability Four‑Layer Load Balancer (TVS) with FullNat Model

The article describes the motivation, architecture, FullNat forwarding process, high‑availability mechanisms, and performance‑optimizing techniques of TVS, a custom four‑layer load‑balancing platform built to overcome LVS limitations and meet the company’s demanding traffic and reliability requirements.

Cluster ArchitectureDPDKFullNAT
0 likes · 11 min read
Design and Implementation of a High‑Performance, High‑Reliability Four‑Layer Load Balancer (TVS) with FullNat Model
ITPUB
ITPUB
Aug 6, 2016 · Databases

Understanding K-DB Lock Structure and Operation Mechanisms

This article explains the components stored in each K-DB lock—including data block address, instance ID, lock mode, block state, and role—and describes how locks are created, used, and released, with a focus on the CWLS module that manages lock granting and conversion in a clustered environment.

CWLSCluster ArchitectureDatabase Locks
0 likes · 7 min read
Understanding K-DB Lock Structure and Operation Mechanisms