BestHub
Sign in
Tagged articles

distributed databases

115 articles · Page 1 of 2
Linyb Geek Road
Linyb Geek Road
Jun 30, 2026 · Backend Development

How to Design Pagination for Billion‑Row Sharded Databases in an Interview

The article systematically breaks down pagination challenges in billion‑row sharded databases, compares common sharding strategies and middleware architectures, analyzes the performance drawbacks of a naïve global‑query approach, and presents several practical alternatives—including keyset pagination, two‑stage queries, index‑table tricks, and external search or NewSQL solutions—while highlighting their trade‑offs for interview discussions.

SQLShardingdistributed databases
0 likes · 24 min read
How to Design Pagination for Billion‑Row Sharded Databases in an Interview
Volcano Engine Developer Services
Volcano Engine Developer Services
Jan 26, 2026 · Databases

How Volcano Engine veDB Scales to Tens of Thousands of Pods with Cloud‑Native Architecture

This article explains how Volcano Engine's veDB leverages compute‑storage separation, Kubernetes operators, and declarative operations to achieve extreme deployment density, seamless scaling, and high‑availability for millions of database instances, while addressing the challenges of traditional VM‑based deployments.

Cloud Nativedatabase scalingdistributed databases
0 likes · 14 min read
How Volcano Engine veDB Scales to Tens of Thousands of Pods with Cloud‑Native Architecture
macrozheng
macrozheng
Dec 26, 2025 · Databases

NewSQL vs Middleware Sharding: Which Architecture Really Wins?

This article objectively compares middleware‑based sharding solutions with native NewSQL distributed databases, examining their architectural differences, transaction handling, high‑availability, scaling, SQL support, storage engines, and maturity to help engineers decide which approach best fits their workload.

CAP theoremNewSQLPaxos
0 likes · 20 min read
NewSQL vs Middleware Sharding: Which Architecture Really Wins?
Lobster Programming
Lobster Programming
Sep 28, 2025 · Databases

Mastering Pagination in Sharded Databases: Global Query and No‑Skip Strategies

With massive data growth, sharding databases introduces pagination challenges; this article explains the root cause of pagination issues in sharded environments, presents the global query method, its pros and cons, and introduces the no‑skip optimization to improve performance while maintaining data accuracy.

distributed databasesglobal queryno-skip optimization
0 likes · 7 min read
Mastering Pagination in Sharded Databases: Global Query and No‑Skip Strategies
Su San Talks Tech
Su San Talks Tech
Sep 22, 2025 · Backend Development

Mastering Pagination in Billion‑Row Sharded Databases: Interview‑Ready Strategies

This article dissects the challenges of implementing pagination on billion‑row sharded tables, explains common sharding strategies, compares SDK, Proxy, and Sidecar architectures, and presents practical solutions such as global query, infinite scroll, two‑phase queries, index tables, and external storage to help engineers ace interview questions.

Performance OptimizationShardingbackend interview
0 likes · 24 min read
Mastering Pagination in Billion‑Row Sharded Databases: Interview‑Ready Strategies
Architect's Journey
Architect's Journey
Sep 10, 2025 · Databases

Why Taobao Order IDs End with the Same Six Digits: Inside the Gene Method

The article explains why the last six digits of Taobao order numbers are constant, revealing the “gene” method that embeds a hashed user identifier to bind orders to specific shards, thereby improving query performance, ensuring balanced data distribution, and supporting scalability in large e‑commerce systems.

Database DesignRoutingSharding
0 likes · 8 min read
Why Taobao Order IDs End with the Same Six Digits: Inside the Gene Method
Su San Talks Tech
Su San Talks Tech
Jul 12, 2025 · Databases

Why the 3‑Table JOIN Ban Exists and How to Overcome It

This article explores the origins of the "no more than three‑table JOIN" rule, explains MySQL's join algorithm limitations, shows real‑world performance pain points in distributed architectures, and presents practical solutions such as step‑wise queries, denormalization, and materialized views to safely break the restriction.

Database PerformanceDenormalizationdistributed databases
0 likes · 11 min read
Why the 3‑Table JOIN Ban Exists and How to Overcome It
Xiaolei Talks DB
Xiaolei Talks DB
Jun 5, 2025 · Databases

How Zhihu Scaled Its Data Architecture with OceanBase: A Multi‑Database Journey

Zhihu’s evolving data architecture transitioned from a single MySQL setup to a heterogeneous ecosystem of SQL, NoSQL, and graph databases, ultimately adopting OceanBase for its multi‑tenant, high‑compression capabilities, supported by tools like OMS, OCP, and ob‑operator to achieve cost savings, performance gains, and robust operations.

Multi‑TenantOceanBasePerformance Optimization
0 likes · 12 min read
How Zhihu Scaled Its Data Architecture with OceanBase: A Multi‑Database Journey
AntTech
AntTech
May 23, 2025 · Databases

OceanBase Breaks Records at ICDE 2025 with Six Papers and a Best Industry Award

At ICDE 2025 in Hong Kong, OceanBase showcased six accepted papers—including a Best Industry and Application Paper Runner‑Up award—while also hosting a technical symposium on AI‑era databases and presenting detailed abstracts on distributed database innovations, secure query processing, federated learning, hypergraph clustering, query equivalence, and cardinality‑estimation workload generation.

AIDatabase ResearchICDE 2025
0 likes · 12 min read
OceanBase Breaks Records at ICDE 2025 with Six Papers and a Best Industry Award
Architect
Architect
May 4, 2025 · Databases

NewSQL vs Middleware Sharding: Which Architecture Truly Wins?

This article objectively compares middleware‑based sharding with NewSQL distributed databases, examining architecture, distributed transactions, performance, high availability, scaling, SQL support, storage engines, and ecosystem maturity to help architects decide which solution fits their specific workload and operational constraints.

CAP theoremDatabase ArchitectureNewSQL
0 likes · 20 min read
NewSQL vs Middleware Sharding: Which Architecture Truly Wins?
Top Architect
Top Architect
Mar 13, 2025 · Databases

Choosing Between NewSQL Databases and Middleware‑Based Sharding: Advantages, Trade‑offs and Practical Guidance

The article objectively compares NewSQL distributed databases with middleware‑plus‑sharding solutions, covering architectural differences, distributed transaction handling, high‑availability, scaling, SQL support, storage engines, maturity, and provides a decision‑making checklist to help engineers select the most suitable approach for their workloads.

High AvailabilityNewSQLTransaction Management
0 likes · 23 min read
Choosing Between NewSQL Databases and Middleware‑Based Sharding: Advantages, Trade‑offs and Practical Guidance
Architecture Digest
Architecture Digest
Mar 3, 2025 · Databases

NewSQL vs Middleware Sharding: A Comparative Analysis of Distributed Databases

This article objectively compares NewSQL distributed databases with traditional middleware‑based sharding solutions, examining their architectures, distributed transaction support, high availability, scaling, SQL capabilities, and maturity to help readers decide which approach best fits their workload and operational constraints.

High AvailabilityNewSQLTransaction
0 likes · 18 min read
NewSQL vs Middleware Sharding: A Comparative Analysis of Distributed Databases
macrozheng
macrozheng
Mar 1, 2025 · Databases

NewSQL vs Middleware Sharding: Which Database Architecture Truly Wins?

An in‑depth comparison of NewSQL databases and middleware‑based sharding reveals each approach’s architectural strengths, distributed transaction handling, scalability, HA mechanisms, storage engine design, and ecosystem maturity, guiding readers on when to adopt NewSQL versus traditional sharding solutions.

NewSQLShardingdistributed databases
0 likes · 18 min read
NewSQL vs Middleware Sharding: Which Database Architecture Truly Wins?
Radish, Keep Going!
Radish, Keep Going!
Feb 6, 2025 · Databases

How Google Cloud Spanner Achieves Global Scale with Paxos and TrueTime

This article explains how Google Cloud Spanner combines relational database features with NoSQL scalability, using multi‑version storage, TrueTime, Paxos consensus, and dynamic sharding to deliver a globally distributed, strongly consistent, high‑availability database solution.

Google Cloud SpannerPaxosTrueTime
0 likes · 15 min read
How Google Cloud Spanner Achieves Global Scale with Paxos and TrueTime
IT Services Circle
IT Services Circle
Oct 25, 2024 · Databases

Database Management Challenges in the Cloud Era and How Apache ShardingSphere Addresses Them

The article outlines the growing difficulties of managing diverse databases in cloud-native environments, introduces Apache ShardingSphere as a comprehensive open‑source solution with three core capabilities—connectivity, enhancement, and pluggability—and guides readers through a three‑step learning path from fundamentals to deployment and testing.

Cloud NativeDatabase ManagementDatabase Middleware
0 likes · 9 min read
Database Management Challenges in the Cloud Era and How Apache ShardingSphere Addresses Them
macrozheng
macrozheng
Aug 23, 2024 · Databases

NewSQL vs Middleware Sharding: Which Architecture Truly Wins?

This article objectively compares NewSQL databases with middleware‑based sharding solutions, examining architecture, distributed transactions, CAP constraints, high availability, scaling, SQL support, storage engines, and maturity to help readers choose the right approach for their workloads.

CAP theoremHigh AvailabilityNewSQL
0 likes · 19 min read
NewSQL vs Middleware Sharding: Which Architecture Truly Wins?
Architect
Architect
Jul 29, 2024 · Databases

NewSQL vs Middleware Sharding: Which Architecture Truly Wins?

This article objectively compares NewSQL distributed databases with traditional middleware‑based sharding solutions, examining their architectures, transaction models, scalability, high‑availability mechanisms, storage engines, maturity, and offering a decision framework to help engineers choose the most suitable approach for their workloads.

CAP theoremDatabase ArchitectureNewSQL
0 likes · 20 min read
NewSQL vs Middleware Sharding: Which Architecture Truly Wins?
Architecture Digest
Architecture Digest
Apr 19, 2024 · Databases

Comparing NewSQL Distributed Databases with Middleware‑Based Sharding: Advantages, Trade‑offs, and Use Cases

The article objectively compares NewSQL distributed databases with traditional middleware‑based sharding solutions, examining their architectural differences, distributed transaction support, performance, scalability, high‑availability mechanisms, storage engines, and practical suitability for various application scenarios.

CAP theoremHigh AvailabilityNewSQL
0 likes · 18 min read
Comparing NewSQL Distributed Databases with Middleware‑Based Sharding: Advantages, Trade‑offs, and Use Cases
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Mar 21, 2024 · Databases

What Makes Distributed Databases Tick? Features, Examples, and Real‑World Picks

This article explains what distributed databases are, outlines their four key characteristics—high performance, scalability, high availability, and data consistency—and reviews five prominent systems (OceanBase, TDSQL, Google Spanner, CockroachDB, and TiDB) that illustrate these concepts in real‑world applications.

Data ConsistencyNewSQLdistributed databases
0 likes · 6 min read
What Makes Distributed Databases Tick? Features, Examples, and Real‑World Picks
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Mar 21, 2024 · Cloud Native

LightPool: An NVMe‑oF‑Based High‑Performance and Lightweight Storage Pool Architecture for Cloud‑Native Distributed Databases

The article presents LightPool, a cloud‑native storage‑pooling solution that leverages NVMe‑over‑Fabric, Kubernetes‑based scheduling, and a lightweight user‑space engine to deliver high‑performance, low‑cost, and highly available storage for large‑scale distributed databases while eliminating traditional bottlenecks.

NVMe-oFcloud-nativedistributed databases
0 likes · 13 min read
LightPool: An NVMe‑oF‑Based High‑Performance and Lightweight Storage Pool Architecture for Cloud‑Native Distributed Databases
Aikesheng Open Source Community
Aikesheng Open Source Community
Mar 21, 2024 · Cloud Native

LightPool: A NVMe‑oF‑Based High‑Performance and Lightweight Storage Pool Architecture for Cloud‑Native Distributed Databases

The article introduces LightPool, an open‑source NVMe‑over‑Fabric storage pool system presented at HPCA 2024, which combines cloud‑native design, high‑performance lightweight storage engine, and advanced scheduling to improve resource efficiency, cost, and availability for large‑scale distributed databases.

HPCALiteIONVMe-oF
0 likes · 12 min read
LightPool: A NVMe‑oF‑Based High‑Performance and Lightweight Storage Pool Architecture for Cloud‑Native Distributed Databases
AntData
AntData
Mar 21, 2024 · Cloud Computing

LightPool: A Cloud‑Native NVMe‑oF Based High‑Performance Storage Pool Architecture for Distributed Databases

The article introduces LightPool, an open‑source cloud‑native storage‑pool architecture built on NVMe‑over‑Fabric that delivers high performance, low cost, and high availability for large‑scale distributed databases, and explains its design, scheduling, storage engine, and hot‑upgrade/migration capabilities presented at the 30th IEEE HPCA conference.

LiteIONVMe-oFcloud-native
0 likes · 13 min read
LightPool: A Cloud‑Native NVMe‑oF Based High‑Performance Storage Pool Architecture for Distributed Databases
DataFunSummit
DataFunSummit
Feb 1, 2024 · Databases

StarRocks 3.0 Storage‑Compute Separation Architecture: Design, Implementation, and Evaluation

This article explains the storage‑compute separation architecture introduced in StarRocks 3.0, presents industry case studies, details the design of StarOS and compute nodes, discusses technical challenges and key techniques, and evaluates cost, reliability, elasticity, and performance through benchmarks and user feedback.

Cloud NativeStarRocksStorage Compute Separation
0 likes · 11 min read
StarRocks 3.0 Storage‑Compute Separation Architecture: Design, Implementation, and Evaluation
dbaplus Community
dbaplus Community
Dec 25, 2023 · Databases

When Should You Choose Distributed Over Centralized Databases? A Practical Guide

This article examines the current landscape of Chinese databases, compares centralized and distributed architectures, outlines when distributed solutions are truly needed, provides performance test data, and offers practical advice on sharding, SQL design, and avoiding cross‑node bottlenecks.

Database ArchitectureShardingcentralized vs distributed
0 likes · 14 min read
When Should You Choose Distributed Over Centralized Databases? A Practical Guide
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
Dec 4, 2023 · Databases

How GaiaDB‑X Powers Next‑Gen Banking Core Systems: Architecture & Real‑World Cases

This article examines the challenges of legacy mainframe‑based banking core systems, explains why banks are shifting to general‑purpose servers, outlines the distributed architecture and database requirements, and showcases GaiaDB‑X’s multi‑layer design and real‑world financial deployments.

GaiaDB-Xbanking core systemsdistributed databases
0 likes · 24 min read
How GaiaDB‑X Powers Next‑Gen Banking Core Systems: Architecture & Real‑World Cases
Aikesheng Open Source Community
Aikesheng Open Source Community
Nov 29, 2023 · Databases

When to Use Distributed vs. Centralized Databases: Analysis, Benchmarks, and Best Practices

This article examines the trade‑offs between centralized and distributed OLTP databases, presents industry usage statistics, performance benchmarks, practical questions for migration, and detailed guidance on sharding, SQL design, and operational considerations to help decide when a distributed solution is truly needed.

Database ArchitectureOLTPSharding
0 likes · 12 min read
When to Use Distributed vs. Centralized Databases: Analysis, Benchmarks, and Best Practices
ITPUB
ITPUB
Sep 22, 2023 · Databases

What Will the Third‑Generation Distributed Database Look Like? Key Features and Challenges

The article reviews 70 years of database evolution, outlines the two historic generations of distributed databases, highlights unresolved issues of correctness, performance and usability, and proposes a forward‑looking “third‑generation” vision that seeks 100 % data integrity, top speed, and true ease of use.

CAP theoremUsabilitydata correctness
0 likes · 13 min read
What Will the Third‑Generation Distributed Database Look Like? Key Features and Challenges
ITPUB
ITPUB
Aug 7, 2023 · Databases

What Exactly Is a Distributed Database? Definitions, Features, and Architecture Explained

This article defines distributed databases, examines their external traits such as write‑heavy, low‑latency, massive concurrency, massive storage and high reliability, explores internal architectures like client‑side sharding, proxy middleware and unit‑based designs, compares them with Amazon Aurora, and summarizes key takeaways.

High concurrencyOLTPReliability
0 likes · 19 min read
What Exactly Is a Distributed Database? Definitions, Features, and Architecture Explained
Architects' Tech Alliance
Architects' Tech Alliance
Jun 4, 2023 · Databases

Hybrid Deployment Strategies for Distributed Databases on X86 and ARM Servers

This article examines hybrid deployment schemes for distributed databases across X86 and ARM server architectures, detailing cross‑cluster, multi‑data‑center, and single‑data‑center approaches, and discusses their applicability to financial industry workloads, performance testing, and gradual migration strategies.

ArmFinancial Industrydistributed databases
0 likes · 10 min read
Hybrid Deployment Strategies for Distributed Databases on X86 and ARM Servers
Huolala Tech
Huolala Tech
May 18, 2023 · Databases

When to Adopt Distributed Databases? A Practical Guide to Choosing the Right Architecture

This article examines why traditional single‑node databases struggle with growing data volumes, outlines the three main distributed‑database architectures, compares their trade‑offs in availability, consistency, scalability and operational complexity, and offers practical criteria for deciding whether a distributed solution is truly needed.

Cloud DatabasesDatabase ArchitectureHTAP
0 likes · 25 min read
When to Adopt Distributed Databases? A Practical Guide to Choosing the Right Architecture
StarRing Big Data Open Lab
StarRing Big Data Open Lab
Mar 15, 2023 · Databases

Why Distributed Analytical Databases Are the Future: Inside ArgoDB’s Architecture

This article explains the architecture and key components of distributed analytical databases, contrasting them with MPP systems, and details the design of StarRing’s ArgoDB—including its storage, compute, transaction, and SQL engines—highlighting scalability, elasticity, and resource management for modern data warehousing.

ArgoDBSQLStorage Engine
0 likes · 16 min read
Why Distributed Analytical Databases Are the Future: Inside ArgoDB’s Architecture
dbaplus Community
dbaplus Community
Mar 11, 2023 · Databases

Optimizing Distributed Database Sorting with Proxy Buffers and Priority Queues

This article examines the architecture of distributed databases, identifies the challenges of global sorting across shards, and presents both in‑memory and disk‑based proxy sorting solutions, detailing buffer configuration, merge‑sort and priority‑queue techniques, performance trade‑offs, and practical constraints for large‑scale queries.

distributed databasesexternal mergemerge sort
0 likes · 10 min read
Optimizing Distributed Database Sorting with Proxy Buffers and Priority Queues
Architects' Tech Alliance
Architects' Tech Alliance
Feb 28, 2023 · Databases

Hybrid Deployment Strategies for Distributed Databases across X86 and ARM Server Architectures

The article examines three hybrid deployment schemes—cross‑cluster, multi‑data‑center within a cluster, and single‑data‑center within a cluster—for distributed databases running on both X86 and ARM servers, highlighting their technical steps, benefits, and relevance to the financial industry.

ArmFinancial Industrydistributed databases
0 likes · 8 min read
Hybrid Deployment Strategies for Distributed Databases across X86 and ARM Server Architectures
Efficient Ops
Efficient Ops
Feb 12, 2023 · Databases

Why Single‑Node MySQL Is No Longer Enough: Embrace Distributed Databases

The article explains the limitations of standalone MySQL for large‑scale workloads, explores sharding, read/write separation, and middleware approaches, and argues that modern distributed databases and cloud‑native solutions are the sustainable path forward for data‑intensive applications.

Cloud DatabasesShardingdatabase scaling
0 likes · 6 min read
Why Single‑Node MySQL Is No Longer Enough: Embrace Distributed Databases
Architect's Guide
Architect's Guide
Jan 26, 2023 · Databases

Primary Key and Index Design for Distributed Databases

The article explains why auto‑increment primary keys are unsuitable for sharded databases, recommends globally unique ordered identifiers, and details index and global‑table strategies—including redundant tables, index tables, and embedding shard information in keys—to achieve efficient single‑shard queries.

Primary KeySQLSharding
0 likes · 10 min read
Primary Key and Index Design for Distributed Databases
ITPUB
ITPUB
Jan 4, 2023 · Databases

Can Cassandra Beat RDBMS Distributed Bottlenecks? A Deep Dive into Decentralized Databases

The article traces the evolution from Codd's relational model to modern RDBMS scaling limits, explains why centralized Hadoop/HBase architectures struggle with high‑concurrency workloads, and shows how Cassandra’s decentralized design—using consistent hashing, gossip, and virtual nodes—overcomes these bottlenecks while offering flexible consistency guarantees.

CassandraHBaseHDFS
0 likes · 22 min read
Can Cassandra Beat RDBMS Distributed Bottlenecks? A Deep Dive into Decentralized Databases
ITPUB
ITPUB
Jan 1, 2023 · Databases

Why Single-Node MySQL Fails and Distributed Databases Are the Future

Even non-programmers notice MySQL’s growing pains—large tables, oversized databases, and read-heavy workloads—prompting a shift toward distributed databases, where sharding, read/write separation, and cloud-native solutions like TiDB or Aurora replace traditional middleware, marking the end of single-node MySQL dominance.

Middlewaredatabase scalingdistributed databases
0 likes · 7 min read
Why Single-Node MySQL Fails and Distributed Databases Are the Future
ITPUB
ITPUB
Dec 28, 2022 · Databases

How TDSQL‑PG Achieves Real‑Time HTAP: Architecture, Storage, and Optimization Insights

This article presents a comprehensive overview of TDSQL‑PG's HTAP capabilities, detailing the evolution of its storage, compute, transaction management, hybrid row‑column storage, cost‑based optimizer, vectorized execution, and resource isolation strategies for handling mixed OLTP and OLAP workloads.

HTAPHybrid storageQuery Optimization
0 likes · 18 min read
How TDSQL‑PG Achieves Real‑Time HTAP: Architecture, Storage, and Optimization Insights
IT Architects Alliance
IT Architects Alliance
Oct 10, 2022 · Databases

Designing Routing Keys for Database Sharding in an Order Platform

The article explains how to choose and implement routing keys for database sharding in an online food ordering system, covering supported scenarios, user‑side and merchant‑side keys, single‑ and multi‑database strategies, and the impact on data distribution and query efficiency.

Routing KeyShardingdistributed databases
0 likes · 6 min read
Designing Routing Keys for Database Sharding in an Order Platform
IT Architects Alliance
IT Architects Alliance
Sep 15, 2022 · Databases

Designing Indexes and Primary Keys for Distributed Database Architectures

Effective index and primary key design in distributed database architectures requires using globally unique, ordered identifiers instead of auto‑increment keys, embedding shard information in keys, employing auxiliary index tables, and handling global tables to ensure queries target a single shard, thereby preserving scalability and performance.

Primary KeyShardingUUID
0 likes · 11 min read
Designing Indexes and Primary Keys for Distributed Database Architectures
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Sep 12, 2022 · Databases

Why Auto‑Increment Fails in Distributed Databases and How to Design Scalable Indexes

This article explains why using auto‑increment primary keys in a distributed database leads to collisions and performance issues, and presents practical strategies such as ordered UUIDs, embedding shard keys, index tables, and global table replication to achieve efficient, scalable index design.

Index Optimizationdistributed databasesglobal UUID
0 likes · 10 min read
Why Auto‑Increment Fails in Distributed Databases and How to Design Scalable Indexes
Top Architect
Top Architect
Aug 11, 2022 · Databases

Primary Key and Index Design for Distributed Databases

The article explains why auto‑increment primary keys are unsuitable for sharded databases, recommends using globally unique ordered identifiers such as UUIDs or Snowflake IDs, and discusses index design strategies—including index tables, embedding shard keys, and handling global tables—to ensure efficient single‑shard queries.

Primary KeyUUIDdistributed databases
0 likes · 10 min read
Primary Key and Index Design for Distributed Databases
Tencent Cloud Developer
Tencent Cloud Developer
Jul 21, 2022 · Databases

Distributed Databases in Financial Industry: Selection and Implementation Practices

The article highlights how distributed databases are essential for the financial industry’s high‑performance, scalable, and highly available data needs, outlines a webinar covering expert selection criteria, implementation tactics, integration challenges, cloud‑native adoption, and real‑world case studies for regulated financial environments.

Data ScalabilityFinTechFinancial Industry
0 likes · 3 min read
Distributed Databases in Financial Industry: Selection and Implementation Practices
ITPUB
ITPUB
Mar 23, 2022 · Databases

Optimizing Distributed Database Sorting: Memory, Disk, and Proxy Strategies

This article examines the architecture of distributed databases, identifies challenges in sorting large result sets across shards, and presents step-by-step memory‑based, disk‑based, and incremental proxy sorting techniques, including buffer sizing, priority‑queue merging, and trade‑offs to avoid OOM and excessive I/O.

Memory Managementdistributed databasesproxy
0 likes · 12 min read
Optimizing Distributed Database Sorting: Memory, Disk, and Proxy Strategies
vivo Internet Technology
vivo Internet Technology
Feb 28, 2022 · Databases

Distributed Database Sorting Solutions

In distributed databases, proxies must merge sorted results from multiple shards, but large result sets exceed memory limits; the article proposes a batch‑fetching approach using per‑shard sort buffers and a priority‑queue merge, eliminating disk I/O and reducing network waste while preserving global order.

Data PartitioningDatabase ArchitectureSorting Algorithms
0 likes · 15 min read
Distributed Database Sorting Solutions
AntTech
AntTech
Feb 18, 2022 · Databases

Parallel Evolution of Electric Vehicles and Distributed Databases: A Comparative Analysis

The article examines the strikingly similar development trajectories of electric vehicles and distributed databases, tracing their historical origins, technological challenges, market dynamics, and recent breakthroughs such as Tesla's autonomous electric cars and OceanBase's native HTAP capabilities, while highlighting the role of open‑source and scaling strategies.

HTAPOceanBaseTechnology evolution
0 likes · 15 min read
Parallel Evolution of Electric Vehicles and Distributed Databases: A Comparative Analysis
ITPUB
ITPUB
Jan 7, 2022 · Databases

Exploring the TiDB Ecosystem: Tools, Automation, and Operations for Distributed Databases

The article explains what an ecosystem means, then defines a distributed‑database ecosystem and uses TiDB as a case study to detail upstream/downstream migration tools, backup and recovery solutions, monitoring and alerting, daily operational utilities, the TiDB Operator for Kubernetes, automation platforms, and emerging projects built on TiDB components.

TiDBbackupdistributed databases
0 likes · 8 min read
Exploring the TiDB Ecosystem: Tools, Automation, and Operations for Distributed Databases
Java Interview Crash Guide
Java Interview Crash Guide
Dec 10, 2021 · Databases

Mastering Database Sharding: When and How to Split Your Data

This article explains the concepts, types, advantages, and challenges of database sharding—including vertical and horizontal partitioning—covers when to consider splitting, practical strategies for handling transactions, joins, pagination, global IDs, and lists popular middleware solutions for implementing sharding in production.

Global ID GenerationHorizontal ShardingVertical Sharding
0 likes · 25 min read
Mastering Database Sharding: When and How to Split Your Data
dbaplus Community
dbaplus Community
Nov 7, 2021 · Databases

Why Distributed Databases Matter: From Early DBMS to Modern NewSQL

This article traces the evolution of database systems—from the first network and hierarchical models through relational databases, NoSQL sharding, and finally modern distributed SQL—explaining why distributed databases emerged, how they handle data distribution, consistency, SQL-to‑KV mapping, and transaction challenges.

Data ReplicationNewSQLSQL to KV
0 likes · 16 min read
Why Distributed Databases Matter: From Early DBMS to Modern NewSQL
ITPUB
ITPUB
Nov 5, 2021 · Databases

Why Distributed Databases Face Consistency Challenges and How to Address Them

The article explains how distributed database systems appear as a single logical database but operate over a network of nodes, detailing failures, stale reads, consistency models, architecture anomalies, sharding, replication, and various read/write scenarios that illustrate the complexity of achieving strong consistency.

CAP theoremShardingTransaction
0 likes · 16 min read
Why Distributed Databases Face Consistency Challenges and How to Address Them
21CTO
21CTO
Sep 19, 2021 · Databases

From Two‑Site Three‑Center to Three‑Site Five‑Center: NetBank’s Database Architecture Evolution

NetBank’s database deployment has evolved from a simple two‑site three‑center disaster‑recovery model to a sophisticated three‑site five‑center architecture, incorporating distributed databases, multi‑tenant isolation, transaction consistency, latency optimization, and containerized deployment to achieve high availability, scalability, and cost efficiency.

Database ArchitectureDisaster RecoveryMulti‑tenant
0 likes · 19 min read
From Two‑Site Three‑Center to Three‑Site Five‑Center: NetBank’s Database Architecture Evolution
ITPUB
ITPUB
Sep 17, 2021 · Databases

How NetBank Scaled Its Database: From Two‑Site Three‑Center to Three‑Site Five‑Center Architecture

This article details NetBank's evolution of database deployment—from early distributed setups to a unitized, cloud‑native architecture—covering disaster‑recovery upgrades, distributed database design, multi‑tenant strategies, containerized migration, and the performance and operational impacts of moving to a three‑site five‑center model.

Disaster RecoveryHigh AvailabilityMulti‑tenant
0 likes · 20 min read
How NetBank Scaled Its Database: From Two‑Site Three‑Center to Three‑Site Five‑Center Architecture
IT Architects Alliance
IT Architects Alliance
Sep 6, 2021 · Databases

Comprehensive Overview of Data Models, Storage Engines, Transactions, Consistency, and Replication in Modern Databases

This article provides a detailed summary of database concepts including data models (relational, document, graph), storage engine architectures (page‑oriented B‑tree, log‑structured LSM), transaction mechanisms, isolation levels, distributed transaction protocols, partitioning strategies, indexing, consistency models, and consensus algorithms such as Lamport timestamps and Raft.

Data ModelsStorage Enginesconsensus algorithms
0 likes · 29 min read
Comprehensive Overview of Data Models, Storage Engines, Transactions, Consistency, and Replication in Modern Databases
21CTO
21CTO
Sep 1, 2021 · Databases

How BaikalDB Redefines Cloud‑Native Distributed Databases for Modern Business Needs

This article examines the evolving data‑storage demands of large‑scale commercial advertising systems, traces the development of BaikalDB from early MySQL sharding to a heterogeneous, cloud‑native distributed database, and explains its storage, compute, and scheduling designs that deliver high reliability, low cost, and millisecond‑level performance.

BaikalDBSQL Compatibilityadvertising systems
0 likes · 27 min read
How BaikalDB Redefines Cloud‑Native Distributed Databases for Modern Business Needs
Tencent Architect
Tencent Architect
Jun 17, 2021 · Fundamentals

The Importance, Challenges, and Best Practices of Code Review in TDSQL‑C

This article explains why code review is critical, outlines its benefits and common difficulties, describes the TDSQL‑C distributed database architecture, and presents a detailed code‑review workflow, author and reviewer responsibilities, commit conventions, and cultural practices to improve software quality and reliability.

TDSQL-Cbest practicescode review
0 likes · 11 min read
The Importance, Challenges, and Best Practices of Code Review in TDSQL‑C
Volcano Engine Developer Services
Volcano Engine Developer Services
Jun 7, 2021 · Databases

Why Distributed Database Architectures Matter: From Shared‑Nothing to Shared‑Storage

This article introduces the fundamentals of distributed database architectures, compares Shared‑Nothing and Shared‑Storage designs, explains their three‑tier structure, core engine components, SQL execution flow, performance and cost optimizations, and showcases a real‑world high‑traffic deployment in Douyin’s Spring Festival event.

SQLcost optimizationdistributed databases
0 likes · 19 min read
Why Distributed Database Architectures Matter: From Shared‑Nothing to Shared‑Storage
Volcano Engine Developer Services
Volcano Engine Developer Services
May 15, 2021 · Cloud Native

Douyin’s Spring Festival Red Packet: Service Mesh, Distributed DBs & IaaS Secrets

The Volcano Engine Developer Community’s May 15 online Meetup showcased four technical sessions—Service Mesh traffic management, distributed databases, mobile file distribution, and IaaS virtualization—detailing how Douyin’s Spring Festival red‑packet event handled massive traffic and ensured high performance.

Cloud NativeHigh concurrencyIaaS virtualization
0 likes · 4 min read
Douyin’s Spring Festival Red Packet: Service Mesh, Distributed DBs & IaaS Secrets
Tencent Cloud Developer
Tencent Cloud Developer
May 12, 2021 · Databases

Evolution and Architecture of Distributed Databases: A TDSQL Case Study

The talk traces the evolution of distributed databases—from early shared‑memory and shared‑nothing designs through New‑SQL breakthroughs—to Tencent’s HTAP‑oriented TDSQL, highlighting its strong‑consistency architecture, anomaly taxonomy, and performance advantages over systems like Google Spanner while addressing modern scalability and hardware challenges.

Database ArchitectureHTAPTDSQL
0 likes · 22 min read
Evolution and Architecture of Distributed Databases: A TDSQL Case Study
Volcano Engine Developer Services
Volcano Engine Developer Services
May 10, 2021 · Databases

How Distributed Databases Powered Douyin’s Spring Festival Red‑Envelope Event

In a May 15 meetup, ByteDance engineer Ma Haoxiang discussed his background, the culture at ByteDance, recommended resources, and detailed how distributed databases differ from traditional relational databases, highlighting their massive capacity, low cost, high performance, and the specific performance and disaster‑recovery challenges faced during Douyin’s Spring Festival red‑envelope activity.

Disaster RecoveryDouyinSpring Festival
0 likes · 7 min read
How Distributed Databases Powered Douyin’s Spring Festival Red‑Envelope Event
Architects' Tech Alliance
Architects' Tech Alliance
Feb 4, 2021 · Databases

What Makes NewSQL Databases Advanced? A Comparative Analysis with Middleware‑Based Sharding

This article objectively compares NewSQL distributed databases with traditional middleware‑plus‑sharding solutions, examining architecture, distributed transactions, CAP constraints, high‑availability, scaling, storage engines, maturity, and practical adoption scenarios to help readers decide which approach best fits their needs.

NewSQLShardingTransactional Consistency
0 likes · 17 min read
What Makes NewSQL Databases Advanced? A Comparative Analysis with Middleware‑Based Sharding
Programmer DD
Programmer DD
Jan 12, 2021 · Databases

NewSQL vs Sharding: Which Database Architecture Truly Wins?

This article objectively compares NewSQL distributed databases with middleware‑based sharding solutions, examining their architectural differences, distributed transaction handling, high‑availability mechanisms, scaling and sharding strategies, SQL support, storage engines, and overall maturity to help readers decide which approach best fits their workload.

High AvailabilityNewSQLSharding
0 likes · 21 min read
NewSQL vs Sharding: Which Database Architecture Truly Wins?
Alibaba Cloud Developer
Alibaba Cloud Developer
Jan 4, 2021 · Databases

Why Cloud‑Native Distributed Databases Are the Future of Enterprise Data

The article reviews the evolution of database systems driven by cloud computing, big‑data demands and distributed architectures, highlights Alibaba Cloud’s cloud‑native offerings such as PolarDB and AnalyticDB, and discusses trends, security, and best practices for modern enterprise data platforms.

Alibaba CloudBig DataDatabase Security
0 likes · 14 min read
Why Cloud‑Native Distributed Databases Are the Future of Enterprise Data
Code Ape Tech Column
Code Ape Tech Column
Dec 11, 2020 · Databases

ShardingSphere Overview, Core Concepts, and Horizontal Sharding Example with Spring Boot

This article introduces Apache ShardingSphere's architecture—including ShardingSphere‑JDBC, ShardingSphere‑Proxy, and the upcoming Sidecar—explains data sharding principles, read/write splitting, and provides a complete Spring Boot example with Maven dependencies, Java source code, and configuration files for horizontal database partitioning.

JDBCRead‑Write SplittingShardingSphere
0 likes · 19 min read
ShardingSphere Overview, Core Concepts, and Horizontal Sharding Example with Spring Boot
JD Tech Talk
JD Tech Talk
Nov 17, 2020 · Databases

JUST Engine: Novel Spatio‑Temporal Indexes and Data Models for Large‑Scale Urban Data Management

The article introduces the JUST engine, a spatio‑temporal data platform that extends GeoMesa with three new indexes (Z2T, XZ2T, time_range), defines nine common and three specialized data models, provides default indexing strategies, and offers detailed SQL usage guidelines for efficient querying of massive urban datasets.

Big DataDatabasesGeoMesa
0 likes · 25 min read
JUST Engine: Novel Spatio‑Temporal Indexes and Data Models for Large‑Scale Urban Data Management
Alibaba Cloud Developer
Alibaba Cloud Developer
Sep 23, 2020 · Databases

How TDDL Revolutionized Database Scaling at Alibaba: Lessons from 2007

This article recounts the 2007 challenges faced by Taobao's monolithic MySQL setup and explains how the TDDL middleware introduced SQL optimization, sharding, read‑write separation, caching, and dynamic scaling to transform the system into a distributed, high‑performance database solution.

Read‑Write SeparationTDDLdatabase sharding
0 likes · 16 min read
How TDDL Revolutionized Database Scaling at Alibaba: Lessons from 2007
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Sep 9, 2020 · Databases

Understanding CAP, BASE, and Eventual Consistency: A Practical Guide

This article explains the CAP theorem, the trade‑offs among consistency, availability, and partition tolerance, introduces the BASE model and its properties, and details how different database systems implement various consistency guarantees such as strong, eventual, and causal consistency.

BASE modelCAP theoremConsistency trade‑offs
0 likes · 11 min read
Understanding CAP, BASE, and Eventual Consistency: A Practical Guide
Big Data Technology & Architecture
Big Data Technology & Architecture
Jun 25, 2020 · Databases

MySQL Replication, Data Sharding, and Distributed Database Deployment Overview

This article explains MySQL replication (master‑slave and master‑master), data sharding principles and implementations, and various distributed database deployment architectures, covering replication mechanisms, advantages, failure recovery, sharding strategies, middleware like Mycat, and scaling solutions for high‑availability systems.

Database ArchitectureShardingdistributed databases
0 likes · 14 min read
MySQL Replication, Data Sharding, and Distributed Database Deployment Overview
Programmer DD
Programmer DD
Apr 18, 2020 · Databases

Why Apache ShardingSphere’s Graduation Marks a New Era for Distributed Databases

Apache ShardingSphere, the open‑source distributed database middleware originally contributed by Dangdang and now backed by the Apache Software Foundation, has graduated to a top‑level Apache project, showcasing its evolution from a simple JDBC sharding driver to a comprehensive ecosystem with JDBC, Proxy, and Sidecar components, adopted by over 120 companies.

Apache ShardingSphereCloud Nativedatabase clustering
0 likes · 12 min read
Why Apache ShardingSphere’s Graduation Marks a New Era for Distributed Databases
Java Backend Technology
Java Backend Technology
Apr 6, 2020 · Databases

Why NewSQL Databases Outperform Middleware Sharding? A Deep Comparison

This article objectively compares NewSQL databases with middleware‑based sharding solutions, examining architecture, distributed transactions, CAP constraints, performance, high availability, scaling, SQL support, storage engines, maturity, and provides practical guidance for choosing the right approach.

CAP theoremNewSQLSharding
0 likes · 18 min read
Why NewSQL Databases Outperform Middleware Sharding? A Deep Comparison
dbaplus Community
dbaplus Community
Mar 8, 2020 · Databases

Why Distributed Databases Need a New Architecture: From Two‑Phase Commit to Raft

This article examines the pressures driving banks to redesign their core database systems, compares three distributed‑access approaches, explains the components of modern distributed databases, analyzes two‑phase and three‑phase commit issues, and evaluates consensus algorithms, CAP/BASE trade‑offs, GTM design, and point‑in‑time recovery.

CAP theoremGTMRaft
0 likes · 19 min read
Why Distributed Databases Need a New Architecture: From Two‑Phase Commit to Raft
Alibaba Cloud Developer
Alibaba Cloud Developer
Feb 27, 2020 · Databases

How Cloud‑Native Distributed Databases Are Shaping the Future of Enterprise Data

This article reviews the evolution, market trends, core components, architectural challenges, and emerging technologies of cloud‑native distributed database systems, highlighting Alibaba Cloud's solutions such as POLARDB, AnalyticDB, and AI‑driven management platforms that enable elastic, high‑availability, and intelligent data services for modern enterprises.

Alibaba CloudBig DataHTAP
0 likes · 26 min read
How Cloud‑Native Distributed Databases Are Shaping the Future of Enterprise Data
Sohu Tech Products
Sohu Tech Products
Jan 8, 2020 · Databases

Understanding Distributed Database Scenarios and Data Partitioning

This article explains the primary use cases for distributed databases, contrasts them with traditional databases, and describes how data partitioning and metadata enable clients to locate data without scanning all nodes, highlighting both external user benefits and internal implementation challenges.

Data PartitioningHigh Availabilitydistributed databases
0 likes · 3 min read
Understanding Distributed Database Scenarios and Data Partitioning
DataFunTalk
DataFunTalk
Nov 21, 2019 · Backend Development

Design and Architecture of a High‑Performance Commercial Advertising Platform

This article presents a comprehensive overview of the technical architecture behind a commercial advertising platform, covering business fundamentals, microservice migration, service governance, distributed storage, real‑time billing, and large‑scale reporting, and explains the practical engineering choices made at Alibaba.

Cloud NativeMicroservicesService Governance
0 likes · 17 min read
Design and Architecture of a High‑Performance Commercial Advertising Platform
Architect's Tech Stack
Architect's Tech Stack
Aug 17, 2019 · Databases

Industrial Bank IT Architecture Transformation: From Mainframe DB2 to Distributed MySQL Solutions

This article details Industrial Bank's multi‑year IT architecture transformation, describing the challenges of legacy mainframe‑based OLTP, the strategic shift to a distributed MySQL ecosystem, the implementation phases, high‑availability designs, containerization efforts, measurable outcomes, and future directions for cloud‑native and data‑exchange capabilities.

Cloud NativeHigh AvailabilityIT Architecture
0 likes · 22 min read
Industrial Bank IT Architecture Transformation: From Mainframe DB2 to Distributed MySQL Solutions
Aikesheng Open Source Community
Aikesheng Open Source Community
Aug 12, 2019 · Databases

Choosing Between NewSQL Databases and Middleware‑Based Sharding: A Comparative Analysis

This article objectively compares NewSQL distributed databases with middleware‑based sharding solutions, examining their architectures, distributed transaction handling, scalability, performance, high‑availability, and operational considerations, and provides guidance on selecting the appropriate approach based on workload, consistency, and organizational constraints.

CAP theoremHigh AvailabilityNewSQL
0 likes · 19 min read
Choosing Between NewSQL Databases and Middleware‑Based Sharding: A Comparative Analysis
dbaplus Community
dbaplus Community
Jun 1, 2019 · Databases

What Drives TiDB’s Architecture? The Philosophy Behind a NewSQL Database

The article explores TiDB’s evolution philosophy, detailing its core beliefs, early user stories, and the three‑step "Make it work, make it right, make it fast" approach, while covering technical choices such as cloud‑first design, hardware‑agnosticism, formal verification, massive testing, performance tuning, and cost‑effective scaling.

NewSQLTiDBarchitecture
0 likes · 32 min read
What Drives TiDB’s Architecture? The Philosophy Behind a NewSQL Database
Zhuanzhuan Tech
Zhuanzhuan Tech
Feb 15, 2019 · Backend Development

Architecture and Design of ZhaiZhai IM System for a Second‑hand E‑commerce Platform

The article details the design and overall architecture of ZhaiZhai's instant messaging (IM) system, covering product positioning, a four‑layer architecture (user, entry, logic, storage), and analyses of scalability, high availability, reliability, extensibility, and performance, highlighting the use of C++, RPC, MySQL, TiDB, and custom middleware.

C#Instant Messagingdistributed databases
0 likes · 13 min read
Architecture and Design of ZhaiZhai IM System for a Second‑hand E‑commerce Platform
21CTO
21CTO
Jan 28, 2019 · Databases

How Alibaba’s TDDL Evolved from Cobar to Power Billions of Daily Queries

This article traces the evolution of Alibaba’s distributed data layer—from the early Cobar system to the modern TDDL framework and DRDS service—explaining their architectures, limitations, sharding principles, transaction‑boundary strategies, heterogeneous index tables, and the Jingwei data‑replication platform that together enable seamless scaling and high‑performance SQL processing across thousands of databases.

AlibabaDRDSData Replication
0 likes · 29 min read
How Alibaba’s TDDL Evolved from Cobar to Power Billions of Daily Queries
vivo Internet Technology
vivo Internet Technology
Dec 18, 2018 · Databases

2018 3306π 深圳站年会 - Database Technologies and Practices

The 2018 3306π Shenzhen annual conference, co‑hosted by the 3306π community, Zhishu Hall and vivo, attracted over 150 attendees and featured expert talks on MySQL 8.0, open‑source data‑transfer middleware, TDSQL for finance, RadonDB, InnoDB enhancements, large‑scale Redis clusters, and Youzan database operations, with presentation materials available online.

Database ArchitectureMongoDBRedis
0 likes · 3 min read
2018 3306π 深圳站年会 - Database Technologies and Practices
High Availability Architecture
High Availability Architecture
Nov 15, 2018 · R&D Management

Interview with PingCAP CTO Huang Dongxu on Building and Managing an Open‑Source Distributed Database Team

In this interview, PingCAP co‑founder and CTO Huang Dongxu shares how his team recruits talent, cultivates engineers through open‑source contributions, uses OKR instead of KPI for performance, and leverages community events to grow the TiDB distributed database project, while also promoting the upcoming GIAC conference.

Community BuildingOKRTiDB
0 likes · 9 min read
Interview with PingCAP CTO Huang Dongxu on Building and Managing an Open‑Source Distributed Database Team
Efficient Ops
Efficient Ops
Sep 27, 2018 · Databases

How SequoiaDB’s Multi-Model Architecture Redefines Cloud‑Native Distributed Databases

SequoiaDB, a financial‑grade open‑source distributed database, combines a multi‑model engine with a compute‑storage separation architecture to deliver full MySQL, PostgreSQL and SparkSQL compatibility, elastic scaling, HTAP capabilities, and robust multi‑site disaster recovery for cloud‑native enterprise workloads.

Compute-Storage SeparationHTAPMulti-Model
0 likes · 12 min read
How SequoiaDB’s Multi-Model Architecture Redefines Cloud‑Native Distributed Databases
37 Interactive Technology Team
37 Interactive Technology Team
Aug 23, 2018 · R&D Management

Technical Research Group Introduction

The article describes a Technical Research Group initiative within a tech center, offering several focused sub‑groups (frontend integration, distributed databases, Python engineering, AI, productization) led by experts, limited to eight members each, running Sep‑Dec 2018 with weekly training, demos, and final deliverables, requiring commitment and registration by Aug 30.

AIdistributed databasesteam collaboration
0 likes · 6 min read
Technical Research Group Introduction
Youzan Coder
Youzan Coder
Aug 4, 2018 · Databases

Key Takeaways from the 2018 Youzan PaaS Tech Meetup: TiDB, Zankv & Search

The 2018 Youzan PaaS meetup in Hangzhou featured deep dives into TiDB's distributed SQL architecture and performance gains in version 2.1, introduced the open‑source Zankv KV store built on Raft, and shared practical Elasticsearch search‑engine optimizations used at Youzan.

ElasticsearchKV storeTech Meetup
0 likes · 4 min read
Key Takeaways from the 2018 Youzan PaaS Tech Meetup: TiDB, Zankv & Search
Architecture Digest
Architecture Digest
Jun 22, 2018 · Databases

Distributed Databases for OLAP: MPP, Hadoop Ecosystem, and Like‑Mesa (ClickHouse/Palo) Overview

This article examines the evolution and classification of distributed databases for OLAP workloads, comparing traditional RDBMS, MPP solutions such as Teradata and Greenplum, Hadoop‑based ecosystems, and newer architectures like ClickHouse and Palo, while highlighting their architectural traits, strengths, and limitations.

ClickHouseHadoopMPP
0 likes · 17 min read
Distributed Databases for OLAP: MPP, Hadoop Ecosystem, and Like‑Mesa (ClickHouse/Palo) Overview