BestHub
Sign in
Tagged articles
602 articles
Page 6 of 7
Node Underground
Node Underground
Oct 31, 2018 · Cloud Computing

Unlock 32 Cloud Design Patterns to Solve Distributed System Challenges

This article introduces the free classic book “Cloud Design Patterns,” which catalogs 32 design patterns across eight problem domains—availability, data management, design & implementation, messaging, management & monitoring, performance & scalability, resiliency, and security—offering practical solutions and C# examples for modern cloud and distributed systems.

Distributed Systemsresiliencysharding
0 likes · 5 min read
Unlock 32 Cloud Design Patterns to Solve Distributed System Challenges
21CTO
21CTO
Oct 17, 2018 · Databases

Scaling Payment Systems: Sharding, Snowflake IDs, and High‑Availability

This article explains how to design a high‑throughput payment system using database sharding, Snowflake‑style globally unique order IDs, eventual consistency via message queues, high‑availability architectures, data tiering, and coarse‑fine traffic control to handle massive request spikes.

Data Tieringdatabaseeventual consistency
0 likes · 15 min read
Scaling Payment Systems: Sharding, Snowflake IDs, and High‑Availability
Architects' Tech Alliance
Architects' Tech Alliance
Oct 15, 2018 · Databases

Data Sharding in Distributed Systems: Partitioning Strategies, Metadata Management, and Consistency Mechanisms

The article explains how distributed storage systems solve the fundamental problems of data sharding and redundancy by describing three sharding methods (hash, consistent‑hash, and range‑based), the criteria for choosing a shard key, the role of metadata servers, and consistency techniques such as leasing, all illustrated with concrete examples and code snippets.

Distributed Systemsconsistent hashingdatabases
0 likes · 25 min read
Data Sharding in Distributed Systems: Partitioning Strategies, Metadata Management, and Consistency Mechanisms
dbaplus Community
dbaplus Community
Oct 10, 2018 · Databases

Why MyCat’s Pseudo‑Distributed MySQL Solution Fails and What to Do Instead

The article examines MyCat’s middleware‑based pseudo‑distributed MySQL architecture, outlines its storage, scalability, and reliability shortcomings, walks through common solutions like disk expansion, compression, and sharding, and finally offers practical steps and alternative technologies for building truly distributed database systems.

Database ArchitectureMycatdistributed database
0 likes · 24 min read
Why MyCat’s Pseudo‑Distributed MySQL Solution Fails and What to Do Instead
dbaplus Community
dbaplus Community
Sep 24, 2018 · Databases

Master MySQL Performance: Practical Optimizations for Large Tables

This guide explains why MySQL performance drops when a single table grows huge and provides a comprehensive set of optimization steps—including field type choices, index design, query tuning, engine selection, system parameters, hardware scaling, read/write splitting, caching, partitioning, vertical and horizontal sharding, and architecture recommendations—to keep MySQL fast and reliable at scale.

Database TuningSystem Parameterscaching
0 likes · 24 min read
Master MySQL Performance: Practical Optimizations for Large Tables
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Aug 3, 2018 · Databases

Understanding Redis Cluster: Architecture, Slot Sharding, Node Management, and High Availability

Redis Cluster is a distributed system that partitions its keyspace into 16,384 hash slots across up to 16,384 nodes, enabling automatic sharding, slot migration, replication, and high‑availability features such as automatic node discovery, master‑slave election, and online resharding without service interruption.

ClusterSlot Migrationdatabase
0 likes · 5 min read
Understanding Redis Cluster: Architecture, Slot Sharding, Node Management, and High Availability
JD Tech
JD Tech
Aug 3, 2018 · Backend Development

High‑Concurrency Price Protection System: Rate Limiting, Degradation, Caching, Sharding, and Scalable Task Processing

This article describes how JD built a high‑concurrency price‑protection service for the 618 promotion, covering rate‑limiting, degradation, CDN and data caching, database sharding with smooth expansion, and a multi‑stage, fault‑tolerant task‑processing workflow to achieve unlimited scalability.

BackendTask Processingcaching
0 likes · 13 min read
High‑Concurrency Price Protection System: Rate Limiting, Degradation, Caching, Sharding, and Scalable Task Processing
System Architect Go
System Architect Go
Jul 29, 2018 · Databases

What Is Elasticsearch? Core Concepts and Fundamentals

Elasticsearch is an open‑source, scalable, high‑availability distributed full‑text search engine that operates in near real‑time, using clusters of nodes, indexes, documents, shards and replicas to efficiently store and retrieve large volumes of data.

ClusterDistributed SystemsElasticsearch
0 likes · 4 min read
What Is Elasticsearch? Core Concepts and Fundamentals
Architects' Tech Alliance
Architects' Tech Alliance
Jul 27, 2018 · Backend Development

Designing Data Architecture for Microservices: Principles, Patterns, and Database Choices

This article explains how to design data architecture for microservice systems, covering microservice fundamentals, advantages, decoupling, lightweight APIs, continuous delivery, database per service versus shared databases, polyglot persistence, scaling dimensions, sharding strategies, and why MongoDB is a suitable choice.

Data ArchitectureMongoDBScalability
0 likes · 15 min read
Designing Data Architecture for Microservices: Principles, Patterns, and Database Choices
Hujiang Technology
Hujiang Technology
Jul 5, 2018 · Databases

Order Table Splitting Project: Architecture, Implementation, and Performance Improvements

This article describes the background, analysis, solution selection, architecture redesign, execution steps, and results of a large‑scale order table splitting project that separates hot and cold data, applies horizontal sharding, and uses MySQL partitioning to control table size and boost query performance.

Backend DevelopmentData Migrationdatabase partitioning
0 likes · 15 min read
Order Table Splitting Project: Architecture, Implementation, and Performance Improvements
Efficient Ops
Efficient Ops
Jun 10, 2018 · Databases

How MongoDB Enables Active‑Active Multi‑Data‑Center Architectures

This article examines the requirements of active‑active applications across multiple data centers, compares distributed database architectures—including two‑phase commit, multi‑master, and sharded designs—and explains how MongoDB’s sharding and write/read concerns enable high availability, consistency, and rapid failover in such environments.

Active-ActiveMongoDBMulti-Data Center
0 likes · 16 min read
How MongoDB Enables Active‑Active Multi‑Data‑Center Architectures
Meitu Technology
Meitu Technology
Jun 8, 2018 · Blockchain

Technical Overview of Telegram Open Network (TON) Blockchain

Telegram’s open‑source TON blockchain combines a master chain with dynamically sharded work chains, uses hyper‑cube routing for fast or reliable inter‑shard messages, employs PoS‑BFT consensus with validators, nominators and fishermen, supports services like DNS, Proxy, Storage and Pay, and manages a 5‑billion Gram token economy to enable scalable decentralized applications.

BlockchainConsensusTON
0 likes · 14 min read
Technical Overview of Telegram Open Network (TON) Blockchain
ITPUB
ITPUB
May 28, 2018 · Databases

Mastering Database Sharding: When and How to Split Your Data

This article explains why and how relational databases should be sharded, covering vertical and horizontal partitioning techniques, common pitfalls such as distributed transactions and join queries, and practical guidelines for deciding when to split data and which tools to use.

Distributed TransactionsID generationVertical Partitioning
0 likes · 22 min read
Mastering Database Sharding: When and How to Split Your Data
Efficient Ops
Efficient Ops
May 22, 2018 · Databases

Scaling Consumer‑Finance Databases: Architecture, DevOps, and Future Trends

This talk walks through the fundamentals of consumer‑finance services, details the evolving database architecture—including sharding, connection‑pool handling, resource isolation, and high‑performance caching—and shares the team's DevOps transformation and outlook toward NewSQL and AI‑driven operations.

DevOpsconsumer financedatabases
0 likes · 15 min read
Scaling Consumer‑Finance Databases: Architecture, DevOps, and Future Trends
AntTech
AntTech
May 17, 2018 · Backend Development

Challenges and Solutions for Transforming Traditional Payment Systems to Distributed Architecture

The article examines how the rapid growth of mobile and aggregated payments strains traditional IOE‑based payment systems, and outlines a comprehensive distributed transformation strategy that includes vertical service‑oriented splitting, horizontal sharding by data type, and practical approaches to handling distributed transactions, cross‑shard queries, scaling, disaster recovery, and operational monitoring.

horizontal-splittingpaymentsharding
0 likes · 15 min read
Challenges and Solutions for Transforming Traditional Payment Systems to Distributed Architecture
dbaplus Community
dbaplus Community
May 13, 2018 · Backend Development

Mastering Distributed Cache: Programming Techniques, Sharding Strategies, and Migration Plans

This article explains why distributed caching is essential for high‑traffic services, presents three programming approaches (direct code, Spring‑Data‑Redis injection, and annotation‑based), compares three cache‑access patterns, details sharding models, outlines smooth and offline migration steps, and addresses cache penetration, concurrency, avalanche, and transaction support with concrete code examples.

CacheJavamigration
0 likes · 22 min read
Mastering Distributed Cache: Programming Techniques, Sharding Strategies, and Migration Plans
Java Backend Technology
Java Backend Technology
May 8, 2018 · Databases

How MyCat Simplifies Database Sharding and Read/Write Routing

This article explains MyCat's role as a database middleware, tracing the evolution from single‑database setups through distributed deployment, caching, master‑slave, vertical and horizontal sharding, and shows how MyCat automates data‑source and shard selection to reduce code complexity.

Database MiddlewareMaster‑SlaveMycat
0 likes · 11 min read
How MyCat Simplifies Database Sharding and Read/Write Routing
dbaplus Community
dbaplus Community
May 6, 2018 · Databases

NewSQL Explained: Storage Engines, Sharding, and Distributed Transactions

This article examines the core technologies behind NewSQL databases for OLTP workloads, contrasting them with NoSQL and traditional relational systems by exploring storage engines such as B‑Tree and LSM‑Tree, sharding strategies, replication models, and distributed transaction mechanisms like two‑phase commit.

NewSQLReplicationStorage Engines
0 likes · 20 min read
NewSQL Explained: Storage Engines, Sharding, and Distributed Transactions
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Apr 22, 2018 · Databases

Mastering MySQL Sharding: Vertical, Horizontal, and Hybrid Strategies Explained

This article explores MySQL sharding fundamentals, detailing vertical, horizontal, and combined partitioning methods, their advantages and drawbacks, and surveys various open‑source implementations such as MySQL Proxy, HSCALE, Amoeba, HiveDB, and PL/Proxy, while offering practical guidance on configuration, transaction handling, and common pitfalls.

AmoebaProxydatabase partitioning
0 likes · 22 min read
Mastering MySQL Sharding: Vertical, Horizontal, and Hybrid Strategies Explained
Qunar Tech Salon
Qunar Tech Salon
Nov 29, 2017 · Backend Development

Optimizing the Pricing Engine for High‑Volume Flight Search: Hash Sharding, Caching, and Response‑Time Improvements

This article explains how Qunar's international ticket pricing engine was optimized by redesigning hash rules for sharding, enhancing local cache replication, employing multi‑stage result delivery, and applying common distributed‑system patterns to boost computational capacity and reduce response latency for massive flight‑search workloads.

cachingflight searchpricing engine
0 likes · 8 min read
Optimizing the Pricing Engine for High‑Volume Flight Search: Hash Sharding, Caching, and Response‑Time Improvements
Architecture Digest
Architecture Digest
Nov 3, 2017 · Databases

Understanding Database Sharding: Why It Matters and How to Implement It

Database sharding, or splitting databases into multiple instances and tables, is essential for scaling backend systems; this article explains its importance, historical context, core concepts, storage stretching techniques, index and consistency handling, and provides a practical design example for transaction systems.

Backend ArchitectureConsistencyPartitioning
0 likes · 11 min read
Understanding Database Sharding: Why It Matters and How to Implement It
JD Retail Technology
JD Retail Technology
Oct 16, 2017 · Databases

Design and Evolution of JD Elastic Database: Architecture, Sharding, and Automatic Failover

This article details the evolution of JD's Elastic Database, describing the challenges of scaling MySQL, the staged solutions including sharding, JProxy, and the final elastic architecture with services like Topology, JED‑Gate, and JED‑Tablet, and explains its query processing, dynamic resharding, and automatic failover mechanisms.

Elastic ArchitectureQuery Processingdatabases
0 likes · 11 min read
Design and Evolution of JD Elastic Database: Architecture, Sharding, and Automatic Failover
dbaplus Community
dbaplus Community
Oct 3, 2017 · Databases

What Oracle 18c Sharding and MySQL 8.0 Reveal About Modern Database Evolution

The article reviews Oracle's high‑availability and sharding advances in 18c, including RAC Sharding 2.0 and Active Data Guard features, and examines MySQL 8.0's major improvements such as the removal of MyISAM, data‑dictionary optimizations, self‑tuning, enhanced security, and new performance capabilities, while also comparing MySQL with PostgreSQL.

8.0Oraclehigh availability
0 likes · 12 min read
What Oracle 18c Sharding and MySQL 8.0 Reveal About Modern Database Evolution
Meituan Technology Team
Meituan Technology Team
Sep 21, 2017 · Databases

Database Q&A: Book Recommendations, Engine Differences, Optimization, Sharding, and Operational Practices

The article compiles Meituan‑Dianping engineers' Q&A covering SQL book suggestions, relational versus NoSQL engine choices, performance tuning techniques, time‑series database uses, sharding versus partitioning strategies, query handling in distributed systems, proxy limitations, and practical advice on replication and pre‑database setups.

NoSQLSQLTimeSeries
0 likes · 12 min read
Database Q&A: Book Recommendations, Engine Differences, Optimization, Sharding, and Operational Practices
Qunar Tech Salon
Qunar Tech Salon
Sep 20, 2017 · Backend Development

Design and Implementation of a One‑Stop Fund Processing Platform

This article describes the design and implementation of a five‑layer one‑stop fund processing platform, covering architecture, rapid business support, hotspot data handling, storage optimization, and query improvements, including sharding, asynchronous processing, and dynamic data source strategies to ensure scalability and reliability.

Database OptimizationDynamic Data SourceScalability
0 likes · 13 min read
Design and Implementation of a One‑Stop Fund Processing Platform
dbaplus Community
dbaplus Community
Sep 6, 2017 · Databases

How to Build a MongoDB Database-as-a-Service Platform: Architecture, Features, and Best Practices

This article explains the concept of Database-as-a-Service (DBaaS), introduces MongoDB’s core capabilities, outlines the essential components such as lifecycle management, disaster recovery, monitoring, and value‑added services, and provides practical guidance on building a production‑grade MongoDB DBaaS platform.

BackupDBaaSDatabase-as-a-Service
0 likes · 19 min read
How to Build a MongoDB Database-as-a-Service Platform: Architecture, Features, and Best Practices
dbaplus Community
dbaplus Community
Aug 7, 2017 · Databases

Mastering MySQL Architecture: Standards, HA, Sharding, and Redis Integration

This article outlines comprehensive MySQL best practices, covering development and operational standards, high‑availability architecture choices such as Keepalived, MHA and Percona XtraDB Cluster, sharding strategies (vertical and horizontal), and how Redis can be leveraged to offload read pressure.

Database designhigh availabilitymysql
0 likes · 19 min read
Mastering MySQL Architecture: Standards, HA, Sharding, and Redis Integration
dbaplus Community
dbaplus Community
Jul 27, 2017 · Databases

How Sharding-JDBC Transforms Relational Databases for Scalable Cloud‑Native Applications

This article explains the core functions of relational‑database middleware, dives into Sharding-JDBC’s architecture, performance characteristics, and implementation details such as sharding rules, SQL parsing, routing, rewrite, execution, result merging, and distributed primary‑key generation, and outlines its future roadmap.

Database MiddlewareDistributed TransactionsJava
0 likes · 21 min read
How Sharding-JDBC Transforms Relational Databases for Scalable Cloud‑Native Applications
ITPUB
ITPUB
May 27, 2017 · Databases

Building a High‑Performance OAuth Token Service with Tarantool, Raft, and Sharding

This article explains how we designed and implemented a scalable OAuth token storage and refresh system using Tarantool’s in‑memory database, Raft leader election, sharding across multiple data centers, and a custom lightweight queue to handle high‑throughput token updates while maintaining consistency and fault tolerance.

Distributed SystemsOAuthRaft
0 likes · 20 min read
Building a High‑Performance OAuth Token Service with Tarantool, Raft, and Sharding
dbaplus Community
dbaplus Community
May 21, 2017 · Databases

Unlocking PostgreSQL: From BRIN Indexes to Real Sharding and Machine Learning

The article summarizes Digoal's 2017 Gdevops talk, detailing PostgreSQL's advanced features such as block-level BRIN indexes, high‑efficiency range queries, asynchronous messaging, data pumps, real sharding, MADlib machine‑learning integration, FDW data federation, and large‑scale use cases in IoT, finance, and geospatial analytics.

BRINData PumpFDW
0 likes · 19 min read
Unlocking PostgreSQL: From BRIN Indexes to Real Sharding and Machine Learning
ITPUB
ITPUB
May 9, 2017 · Databases

Master MySQL Single-Table Optimization and Scaling Strategies

Learn how to boost MySQL performance for massive tables by optimizing schema design, indexing, query patterns, engine selection, system parameters, hardware upgrades, read/write splitting, caching layers, partitioning, vertical and horizontal sharding, and choosing appropriate client or proxy sharding solutions.

Partitioningmysqloptimization
0 likes · 25 min read
Master MySQL Single-Table Optimization and Scaling Strategies
Architecture Digest
Architecture Digest
May 6, 2017 · Databases

MongoDB Architecture and Practical Usage at the MamaBang Platform

The talk outlines MamaBang's evolution from MySQL to a multi‑zone MongoDB cluster, compares MongoDB with relational databases, discusses data‑model design, sharding, replication, transaction handling, operational challenges, and offers practical advice for teams considering MongoDB adoption.

Database ArchitectureMongoDBdata modeling
0 likes · 19 min read
MongoDB Architecture and Practical Usage at the MamaBang Platform
dbaplus Community
dbaplus Community
Apr 19, 2017 · Databases

How to Use MariaDB Spider for Horizontal & Vertical Sharding

This article explains what MariaDB Spider is, its role as a pluggable storage engine for MySQL/MariaDB sharding, demonstrates vertical and horizontal partitioning with real‑world Tencent game case, provides installation steps, configuration commands, performance considerations, tunable parameters, and load‑balancing architecture.

MariaDBSpiderdatabase partitioning
0 likes · 8 min read
How to Use MariaDB Spider for Horizontal & Vertical Sharding
21CTO
21CTO
Apr 10, 2017 · Operations

Alibaba’s Secret to Scaling GitLab: Distributed Sharding and Performance Boosts

This article details how Alibaba Group transformed its GitLab deployment from a single‑node bottleneck into a horizontally scalable, sharded architecture that handles millions of daily requests with high availability, improved performance, and robust data safety.

GitLabOperationsdistributed-systems
0 likes · 15 min read
Alibaba’s Secret to Scaling GitLab: Distributed Sharding and Performance Boosts
Alibaba Cloud Developer
Alibaba Cloud Developer
Apr 6, 2017 · Backend Development

How Alibaba Scaled GitLab to Support Millions of Users with Sharding and High‑Availability

This article details Alibaba Group's journey of transforming its GitLab deployment from a single‑node setup to a distributed, sharded architecture that handles tens of millions of daily requests, achieves near‑perfect reliability, and incorporates performance, monitoring, and disaster‑recovery innovations.

GitLabPerformance Optimizationhigh availability
0 likes · 15 min read
How Alibaba Scaled GitLab to Support Millions of Users with Sharding and High‑Availability
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Apr 6, 2017 · Operations

Scaling Alibaba Group GitLab: Distributed Architecture, Sharding, and Operational Practices

This article describes how Alibaba Group transformed its GitLab platform from a single‑node deployment to a distributed, sharded architecture with proxy services, performance optimizations, multi‑datacenter backup, and automated operations to support millions of users and dramatically increase request throughput.

GitLabdistributed-systemshigh-availability
0 likes · 14 min read
Scaling Alibaba Group GitLab: Distributed Architecture, Sharding, and Operational Practices
Baidu Intelligent Testing
Baidu Intelligent Testing
Mar 22, 2017 · Operations

Load Balancing: Concepts, Mechanisms, and Enterprise Practices

This article explains the principles of load balancing, distinguishes stateless service and stateful data balancing, describes DNS, hardware and software solutions such as F5, HAProxy, LVS, and GSLB, and illustrates real‑world implementations at Alibaba and Tencent while offering practical guidance on sharding, caching, and fault tolerance.

DNSGSLBHAProxy
0 likes · 18 min read
Load Balancing: Concepts, Mechanisms, and Enterprise Practices
ITPUB
ITPUB
Mar 15, 2017 · Databases

From Table Design to Scalable MySQL: A Complete Optimization Roadmap

This article outlines the five evolutionary stages of a MySQL deployment—table design, deployment, performance tuning, architecture scaling, and maintenance—detailing practical configuration tweaks, kernel and hardware optimizations, replication strategies, caching, sharding, partitioning, and essential monitoring and backup techniques.

BackupDatabase OptimizationReplication
0 likes · 18 min read
From Table Design to Scalable MySQL: A Complete Optimization Roadmap
Dada Group Technology
Dada Group Technology
Jan 23, 2017 · Backend Development

Architecture Design and Key Solutions of JD Daojia Transaction System

The article outlines the complex business logic of JD Daojia's transaction system and presents architectural decisions such as service setization, database sharding, frontend‑backend separation, parallel execution, asynchronous processing, dependency governance, and future enhancements to improve scalability, reliability, and performance.

Microservicesasynchronous processingdependency management
0 likes · 12 min read
Architecture Design and Key Solutions of JD Daojia Transaction System
Architecture Digest
Architecture Digest
Jan 9, 2017 · Databases

Comprehensive Guide to MySQL Single-Table Optimization, Partitioning, Sharding, and Scaling Strategies

This article outlines practical techniques for optimizing large MySQL tables—including column and index tuning, query improvements, engine selection, system parameters, hardware upgrades, caching, partitioning, vertical and horizontal sharding, and discusses client‑side and proxy‑based sharding solutions and compatible databases.

Database OptimizationPartitioningmysql
0 likes · 24 min read
Comprehensive Guide to MySQL Single-Table Optimization, Partitioning, Sharding, and Scaling Strategies
Meituan Technology Team
Meituan Technology Team
Dec 19, 2016 · Databases

MTDDL: Meituan Distributed Data Layer Middleware Overview

MTDDL, Meituan’s in‑house client‑side sharding middleware, was created to address rapid product‑database growth by offering dynamic data‑source routing, read‑write separation, distributed ID generation, configurable database‑and‑table sharding, connection‑pool management, SQL monitoring, and live configuration updates via annotations and extensible strategies.

Dynamic Data SourceJavaSQL Monitoring
0 likes · 12 min read
MTDDL: Meituan Distributed Data Layer Middleware Overview
MaGe Linux Operations
MaGe Linux Operations
Nov 26, 2016 · Databases

Master MongoDB Sharding: Step-by-Step Setup and Verification

This guide walks through the reasons for sharding in MongoDB, explains the sharding architecture, and provides detailed commands to configure config servers, shard servers, and mongos, add shards, enable sharding on databases and collections, insert test data, and verify successful data distribution across shards.

ClusterMongoDBReplication
0 likes · 8 min read
Master MongoDB Sharding: Step-by-Step Setup and Verification
ITPUB
ITPUB
Oct 23, 2016 · Databases

Essential MongoDB Interview Questions & Answers You Need to Master

This comprehensive guide presents the most common MongoDB interview questions, covering NoSQL fundamentals, replication, sharding, transactions, profiling, storage nuances, and operational details, providing concise yet thorough answers to help candidates confidently tackle technical interviews.

MongoDBNoSQLReplication
0 likes · 11 min read
Essential MongoDB Interview Questions & Answers You Need to Master
ITPUB
ITPUB
Oct 8, 2016 · Databases

Mastering Database Sharding, Replication, and High‑Availability Strategies

This article explains core database concepts such as sharding, replication, routing strategies, and high‑availability designs, detailing how to achieve read/write separation, cache integration, and consistency handling in a master‑slave architecture for large‑scale systems.

Read-Write SeparationReplicationdatabase
0 likes · 8 min read
Mastering Database Sharding, Replication, and High‑Availability Strategies
ITPUB
ITPUB
Sep 26, 2016 · Databases

When and How MongoDB Balancer Migrates Chunks in a Sharded Cluster

This article explains the three scenarios that trigger MongoDB chunk migration, describes the Balancer's lock‑based operation, and walks through the six detailed steps—including tag‑based splits, draining shard handling, and load‑balancing thresholds—that ensure data is evenly distributed across shards.

BalancerChunk MigrationMongoDB
0 likes · 8 min read
When and How MongoDB Balancer Migrates Chunks in a Sharded Cluster
Meituan Technology Team
Meituan Technology Team
Sep 9, 2016 · Databases

MTAtlas: Meituan's Database Middleware Architecture and Practices

The article recaps Meituan‑Dianping’s 10th Tech Salon where senior DBA Ping Zhong detailed the Atlas database middleware, explaining its three‑layer architecture, connection‑string simplification, load balancing, read/write separation, automated slave management, monitoring, sharding capabilities, current 87% deployment across services, and upcoming enhancements such as stronger SQL processing and distributed transaction support.

Automationmiddlewaresharding
0 likes · 6 min read
MTAtlas: Meituan's Database Middleware Architecture and Practices
Qunar Tech Salon
Qunar Tech Salon
Sep 7, 2016 · Databases

Principles and Practices of MySQL Database Sharding

The article explains when MySQL sharding is needed, outlines five practical principles for deciding to split databases or tables, provides real‑world examples, and shares operational tips for implementing horizontal partitioning to improve performance, availability, and manageability.

OperationsPartitioningdatabase scaling
0 likes · 8 min read
Principles and Practices of MySQL Database Sharding
High Availability Architecture
High Availability Architecture
Aug 11, 2016 · Backend Development

Mogujie E‑Commerce Transaction Platform Architecture and Service Refactoring

The article details how Mogujie's e‑commerce transaction system evolved from a monolithic PHP application to a service‑oriented architecture through DB vertical sharding, service decomposition, custom sharding component TSharding, and performance optimizations such as asynchronous processing, caching, and distributed transaction handling to support rapid growth and high‑availability requirements.

BackendDistributed TransactionsService Architecture
0 likes · 15 min read
Mogujie E‑Commerce Transaction Platform Architecture and Service Refactoring
Architecture Digest
Architecture Digest
Aug 8, 2016 · Databases

Understanding Elasticsearch Architecture: Clusters, Shards, Discovery, and Scaling

This article provides a comprehensive overview of Elasticsearch 2.x, covering its distributed architecture, core concepts such as clusters, nodes, indices, shards and replicas, the ZenDiscovery master‑election process, scaling mechanisms, recovery, query features, and the underlying system components like Guice, Netty, and thread‑pool designs.

Cluster ManagementElasticsearchNoSQL
0 likes · 20 min read
Understanding Elasticsearch Architecture: Clusters, Shards, Discovery, and Scaling
Qunar Tech Salon
Qunar Tech Salon
Aug 3, 2016 · Backend Development

Optimizing Write‑Heavy High‑Concurrency Cache: Lock Granularity, Horizontal Sharding, and Lock‑Free Strategies

The article analyzes write‑mostly, read‑light cache scenarios such as driver location updates and counter increments, discusses lock bottlenecks, proposes horizontal sharding and per‑record locking, explores lock‑free approaches with data‑integrity signatures, and summarizes practical optimization techniques for high‑concurrency back‑end systems.

Cacheconcurrencylock optimization
0 likes · 8 min read
Optimizing Write‑Heavy High‑Concurrency Cache: Lock Granularity, Horizontal Sharding, and Lock‑Free Strategies
Efficient Ops
Efficient Ops
Jun 19, 2016 · Databases

One‑Click Docker Deployment of a Redis Sharding Cluster

This guide explains how to build Docker images, configure Redis, and orchestrate containers to create a fully automated, one‑click Redis sharding cluster, covering preparation, scripting, configuration, and verification steps.

ClusterDatabase DeploymentDevOps
0 likes · 11 min read
One‑Click Docker Deployment of a Redis Sharding Cluster
Architecture Digest
Architecture Digest
May 21, 2016 · Databases

An Overview of MyCat: Open‑Source Distributed Database Middleware and Its Technical Features

The article introduces MyCat, an open‑source distributed database middleware that provides transparent sharding, multi‑backend support, AI‑driven catlet extensions, and advanced read‑write splitting to enable low‑cost migration of single‑node databases to cloud environments while addressing performance and scalability challenges.

Database MiddlewareMycatSQL Routing
0 likes · 9 min read
An Overview of MyCat: Open‑Source Distributed Database Middleware and Its Technical Features
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
May 9, 2016 · Operations

How eBay Scales to Billions: 7 Proven Practices for Massive Web Systems

This article outlines eBay's seven key scalability best practices—including functional partitioning, horizontal sharding, avoiding distributed transactions, asynchronous decoupling, stream processing, virtualization, and strategic caching—to illustrate how large‑scale web platforms can achieve linear resource growth and high availability.

AsynchronousDistributed SystemsVirtualization
0 likes · 14 min read
How eBay Scales to Billions: 7 Proven Practices for Massive Web Systems
High Availability Architecture
High Availability Architecture
May 3, 2016 · Databases

Designing and Scaling a Social Platform with Redis

This article explains how to build a micro‑blogging social system using Redis, covering core data models, read‑through replication, Sentinel failover, and write‑side sharding techniques that enable the platform to handle hundreds of millions of users and massive traffic.

Social networkhigh availabilityread replication
0 likes · 19 min read
Designing and Scaling a Social Platform with Redis
21CTO
21CTO
Apr 29, 2016 · Backend Development

How LeTV Scaled Its Payment System to 100k Orders per Second with Sharding and HA

This article explains how LeTV's payment platform handled a hundred‑fold surge in traffic by redesigning its architecture with database sharding, a custom order‑ID scheme, asynchronous consistency, high‑availability clustering, data tiering, and a coarse‑fine request pipeline to sustain up to 100,000 orders per second.

databasehigh-availabilityorder ID
0 likes · 15 min read
How LeTV Scaled Its Payment System to 100k Orders per Second with Sharding and HA
Efficient Ops
Efficient Ops
Mar 22, 2016 · Databases

Scaling PB‑Level Data: Mastering Redis, Codis, and MySQL Sharding

In this technical share, the operations director explains how his team tackled PB‑scale data challenges by scaling Redis with Codis, implementing multi‑dimensional MySQL sharding, using vertical and horizontal partitioning, and optimizing storage with TokuDB, offering practical insights for high‑throughput system design.

CodisPB-level Datamysql
0 likes · 15 min read
Scaling PB‑Level Data: Mastering Redis, Codis, and MySQL Sharding
Architecture Digest
Architecture Digest
Mar 16, 2016 · Databases

An Overview of Mycat Distributed Database Middleware: Architecture, Deployment, Sharding, and High Availability

This article introduces Mycat, an open‑source distributed database middleware that implements the MySQL protocol, explains its core concepts such as sharding, read/write separation, high availability, deployment architectures, optimization strategies, and provides practical configuration examples for schema, rule, and server files.

Database Middlewaremysqlsharding
0 likes · 13 min read
An Overview of Mycat Distributed Database Middleware: Architecture, Deployment, Sharding, and High Availability
Architecture Digest
Architecture Digest
Feb 27, 2016 · Databases

Architecture and Design of TDSQL: A Distributed MySQL‑Based SQL System for High‑Consistency Billing

The article analyzes the architecture of TDSQL, a MySQL‑based distributed SQL system designed for Tencent’s billing platform, detailing its transition from an in‑memory NoSQL solution to a high‑consistency, auto‑scaling, fault‑tolerant database with sharding, scheduler, agent, and gateway components.

Replicationdistributed databasehigh availability
0 likes · 17 min read
Architecture and Design of TDSQL: A Distributed MySQL‑Based SQL System for High‑Consistency Billing
21CTO
21CTO
Feb 23, 2016 · Databases

Master Database Load Balancing, Read/Write Splitting, and Sharding Techniques

This article explains how large‑scale internet applications can overcome database bottlenecks by using load‑balancing clusters, implementing read/write separation, and applying vertical or horizontal sharding, while outlining each method's principles, implementation steps, advantages, and drawbacks.

Scalabilitydatabase clusteringdatabase load balancing
0 likes · 11 min read
Master Database Load Balancing, Read/Write Splitting, and Sharding Techniques
MaGe Linux Operations
MaGe Linux Operations
Feb 4, 2016 · Databases

Mastering Database Sharding: Vertical & Horizontal Partitioning Strategies

This article explains the core concepts of database sharding, detailing vertical and horizontal partitioning methods, strategies for combining them, handling shared data, and addressing challenges such as distributed transactions, cross‑node joins, and aggregation queries, with practical insights for scalable system design.

Distributed Transactionscross-node queriesdatabase partitioning
0 likes · 9 min read
Mastering Database Sharding: Vertical & Horizontal Partitioning Strategies
21CTO
21CTO
Jan 29, 2016 · Backend Development

How Pinterest Scaled to Billions of Page Views: Architecture & Sharding Secrets

Pinterest grew from zero to over 100 billion monthly page views by rapidly expanding its infrastructure, adopting simple, mature technologies like MySQL, Redis, and Memcache, and transitioning from clustering to sharding, offering practical lessons on scaling, tool selection, ID design, and migration strategies for massive growth.

Pinterestarchitecturecloud
0 likes · 23 min read
How Pinterest Scaled to Billions of Page Views: Architecture & Sharding Secrets
ITPUB
ITPUB
Jan 27, 2016 · Databases

Why MongoDB Beats Relational Databases—and Where It Falls Short

This article compares MongoDB to traditional relational databases, highlighting advantages such as eventual consistency, document storage, built‑in GridFS and sharding, rich third‑party support, and performance, while also discussing drawbacks like lack of transactions, high disk usage, and limited maintenance tools.

GridFSMongoDBNoSQL
0 likes · 7 min read
Why MongoDB Beats Relational Databases—and Where It Falls Short
ITPUB
ITPUB
Dec 18, 2015 · Databases

Mastering Database Schema Design: From Normalization to Sharding and Scaling

This article explains essential database design principles—including normalization, denormalization, join avoidance, and various sharding techniques—while also covering scaling strategies such as vertical upgrades, horizontal partitioning, and the use of flash storage to boost performance.

Database designDenormalizationSQL
0 likes · 27 min read
Mastering Database Schema Design: From Normalization to Sharding and Scaling
21CTO
21CTO
Dec 14, 2015 · Databases

MongoDB Master Russell Smith’s Essential Best‑Practice Checklist

This article compiles Russell Smith’s comprehensive MongoDB best‑practice guide, covering architecture choices, file limits, write safety, schema design, replication, sharding, security, and performance tuning to help engineers avoid common pitfalls and optimize production deployments.

MongoDBReplicationSecurity
0 likes · 16 min read
MongoDB Master Russell Smith’s Essential Best‑Practice Checklist
21CTO
21CTO
Nov 8, 2015 · Backend Development

Designing a Scalable Short URL Service: Key Decisions and Best Practices

This article explores the essential design considerations for building a short URL service, covering data structures, encoding algorithms, key length choices, capacity planning, sharding strategies, concurrency handling, network architecture, security measures, and a real‑world example.

backend designconcurrencysharding
0 likes · 7 min read
Designing a Scalable Short URL Service: Key Decisions and Best Practices
Architect
Architect
Nov 8, 2015 · Backend Development

Design Considerations for a Short URL Service

Designing a short URL service involves choosing appropriate key‑value storage, simple incremental or base‑36 encoding for keys, estimating data capacity and sharding strategies, handling concurrent reads/writes with thread‑safe structures or Redis, selecting network event loops, and addressing security concerns such as abuse prevention.

BackendSecuritySystem Design
0 likes · 6 min read
Design Considerations for a Short URL Service
Qunar Tech Salon
Qunar Tech Salon
Nov 5, 2015 · Databases

Design and Architecture of TDSQL: A Distributed MySQL‑Based SQL System

The article describes how the limitations of an in‑memory NoSQL HOLD platform led to the creation of TDSQL, a distributed MySQL‑based SQL system featuring ZooKeeper‑coordinated Scheduler, Agent, and Gateway modules, automatic cross‑IDC disaster recovery, transparent horizontal scaling, strong synchronous replication, and future integration with container technologies.

ScalabilityTDSQLdistributed database
0 likes · 19 min read
Design and Architecture of TDSQL: A Distributed MySQL‑Based SQL System
21CTO
21CTO
Sep 16, 2015 · Databases

How TDSQL Achieves Scalable, High‑Availability Distributed SQL on MySQL

This article explains how TDSQL transforms MySQL into a distributed, high‑availability SQL system by addressing NoSQL limitations, introducing a Scheduler‑Agent‑Gateway architecture, automatic scaling, sharding, robust disaster‑recovery mechanisms, and future integration with container technologies.

Auto Scalingdistributed databasehigh availability
0 likes · 19 min read
How TDSQL Achieves Scalable, High‑Availability Distributed SQL on MySQL
21CTO
21CTO
Sep 8, 2015 · Databases

Mastering Scalability: From Simple MySQL to Cloud‑Native Sharding Architectures

This article explains how scalability ties to concurrency and walks through architectural evolution—from a single MySQL instance to vertical partitioning, master‑slave replication, horizontal sharding, and finally cloud‑native SaaS databases—highlighting key challenges and solutions.

cloud databasemysqlsharding
0 likes · 12 min read
Mastering Scalability: From Simple MySQL to Cloud‑Native Sharding Architectures
21CTO
21CTO
Aug 14, 2015 · Databases

Mastering Elasticsearch: Real-World Indexing & Query Performance Tips

This article shares practical Elasticsearch experience covering index and query performance optimization, shard routing strategies, JVM tuning, daily maintenance, and answers to common production questions, providing actionable guidance for building high‑availability search clusters.

ElasticsearchJVMTuning
0 likes · 16 min read
Mastering Elasticsearch: Real-World Indexing & Query Performance Tips
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Aug 6, 2015 · Databases

An Overview of MyCat: Open‑Source Distributed Database Middleware and Its Core Features

MyCat is an open‑source distributed database middleware that transparently shreds tables across multiple backend databases, solves connection overload, provides ER‑based sharding, global partitioning, AI‑driven catlets, and advanced read‑write separation, enabling low‑cost migration of single‑node databases to the cloud.

AI catletDatabase MiddlewareMycat
0 likes · 9 min read
An Overview of MyCat: Open‑Source Distributed Database Middleware and Its Core Features
Efficient Ops
Efficient Ops
Jul 14, 2015 · Databases

Master MySQL Performance: Practical Optimization Strategies & FAQs

This article compiles expert insights from a high‑efficiency operations forum, covering MySQL performance optimization techniques such as read‑write separation, sharding, schema and parameter tuning, hardware and SSD enhancements, as well as a detailed FAQ addressing replication lag, Aurora challenges, and backup tools.

Database TuningHardware OptimizationPerformance Optimization
0 likes · 12 min read
Master MySQL Performance: Practical Optimization Strategies & FAQs
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jul 5, 2015 · Databases

Design and Implementation of TDSQL: A Distributed High‑Consistency MySQL‑Based Storage System

The article describes the evolution, architecture, automatic scaling, sharding, disaster‑recovery mechanisms, and strong synchronous replication strategy of TDSQL, a MySQL‑engine based distributed database built to meet the high‑availability and high‑consistency requirements of Tencent's billing platform.

ReplicationTDSQLdistributed database
0 likes · 18 min read
Design and Implementation of TDSQL: A Distributed High‑Consistency MySQL‑Based Storage System
Qunar Tech Salon
Qunar Tech Salon
Apr 20, 2015 · Databases

Practical MySQL Scaling and Sharding Strategies at 58.com under Big Data Loads

This article presents 58.com’s experience with MySQL under massive data volumes, covering core concepts such as single‑instance, sharding, replication and grouping, common availability and read‑write challenges, detailed sharding implementations for user, post, friend and order tables, and post‑sharding business practices including IN queries, non‑partition key queries, and cross‑database pagination.

Cross‑Shard QueriesPartitioningReplication
0 likes · 10 min read
Practical MySQL Scaling and Sharding Strategies at 58.com under Big Data Loads
Qunar Tech Salon
Qunar Tech Salon
Mar 11, 2015 · Databases

MongoDB 3.0 Release Highlights and New Features

MongoDB 3.0 introduces a pluggable storage engine API with WiredTiger support, expands backup set capacity, adds sharding enhancements, improves security with SCRAM‑SHA‑1 authentication, and upgrades tooling and logging, while retaining MMAPv1 as the default engine.

BackupMongoDBStorage Engines
0 likes · 4 min read
MongoDB 3.0 Release Highlights and New Features
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Mar 6, 2015 · Backend Development

Designing Scalable Stateless Architecture: Sessions, Caching, Sharding & Monitoring

The article explains how to achieve horizontal scalability by making applications stateless, using client‑side cookies for session data, applying various caching layers, splitting services and databases with sharding, adopting asynchronous messaging, storing unstructured data, and integrating monitoring with alerting.

cachingmonitoringsharding
0 likes · 9 min read
Designing Scalable Stateless Architecture: Sessions, Caching, Sharding & Monitoring