BestHub
Sign in
Tagged articles

Sharding

656 articles · Page 4 of 7
HomeTech
HomeTech
Nov 2, 2022 · Backend Development

Technical Architecture and Performance Optimization of the Intelligent Focus Auto‑Placement Platform

This article presents the design, implementation challenges, and optimization strategies of an intelligent auto‑placement platform, covering background analysis, distributed task scheduling with XXL‑Job, sharding with ShardingSphere, caching via Caffeine, message‑queue integration using Kafka, and the resulting performance gains.

Backend ArchitectureShardingdistributed scheduling
0 likes · 16 min read
Technical Architecture and Performance Optimization of the Intelligent Focus Auto‑Placement Platform
Java Architect Essentials
Java Architect Essentials
Nov 1, 2022 · Databases

Designing Routing Keys for Sharding in an Order Platform

The article explains how to select and implement routing keys for database sharding in an order platform, covering time‑based and business‑related keys, user and merchant scenarios, hash‑modulo strategies for single and multi‑database environments, and the overall data flow.

HashingRouting KeySharding
0 likes · 5 min read
Designing Routing Keys for Sharding in an Order Platform
Top Architect
Top Architect
Oct 19, 2022 · Databases

MySQL Replication, High Availability, and Sharding: Concepts and Solutions

This article explains the evolution from single‑node MySQL databases to master‑slave replication, various replication modes, high‑availability strategies, and both vertical and horizontal sharding techniques, while discussing the associated challenges such as distributed transactions, routing, and operational complexity.

Database ScalingHigh AvailabilityMySQL
0 likes · 11 min read
MySQL Replication, High Availability, and Sharding: Concepts and Solutions
Architecture Digest
Architecture Digest
Oct 17, 2022 · Databases

Designing Routing Keys for Sharding in an Order Platform

The article explains how to choose and implement routing keys for database sharding in an order platform, covering time‑based and business‑related keys, user and merchant scenarios, hash‑mod routing strategies, and the complete data flow with diagrams.

Routing KeyShardingdesign
0 likes · 5 min read
Designing Routing Keys for Sharding in an Order Platform
ITPUB
ITPUB
Oct 12, 2022 · Databases

Optimizing Distributed Database Sorting: In-Memory Merge to Disk Buffering

This article examines the challenges of sorting queries in distributed databases, outlines the limitations of in‑memory proxy sorting, and presents a step‑by‑step optimized approach that leverages per‑shard sorting, disk‑based buffering, and priority‑queue merging to reduce memory pressure and I/O overhead.

Shardingdisk bufferingpriority-queue
0 likes · 12 min read
Optimizing Distributed Database Sorting: In-Memory Merge to Disk Buffering
IT Architects Alliance
IT Architects Alliance
Oct 10, 2022 · Databases

Designing Routing Keys for Database Sharding in an Order Platform

The article explains how to choose and implement routing keys for database sharding in an online food ordering system, covering supported scenarios, user‑side and merchant‑side keys, single‑ and multi‑database strategies, and the impact on data distribution and query efficiency.

Distributed DatabasesRouting KeySharding
0 likes · 6 min read
Designing Routing Keys for Database Sharding in an Order Platform
ITPUB
ITPUB
Oct 7, 2022 · Databases

How to Efficiently Paginate Across Sharded Tables: Three Proven Methods

This article explains why sharding tables improves read/write speed, then compares three pagination strategies—global query, no‑skip pagination, and two‑phase query—detailing their SQL rewrites, execution steps, performance trade‑offs, and practical examples.

SQLShardingdistributed
0 likes · 10 min read
How to Efficiently Paginate Across Sharded Tables: Three Proven Methods
IT Architects Alliance
IT Architects Alliance
Sep 15, 2022 · Databases

Designing Indexes and Primary Keys for Distributed Database Architectures

Effective index and primary key design in distributed database architectures requires using globally unique, ordered identifiers instead of auto‑increment keys, embedding shard information in keys, employing auxiliary index tables, and handling global tables to ensure queries target a single shard, thereby preserving scalability and performance.

Distributed DatabasesShardingglobal tables
0 likes · 11 min read
Designing Indexes and Primary Keys for Distributed Database Architectures
ITPUB
ITPUB
Sep 6, 2022 · Databases

From Monolith to Sharded MySQL: A Complete End‑to‑End Sharding Case Study

This article walks through a real‑world large‑scale MySQL sharding project, covering business refactoring, storage architecture design, data migration, incremental upgrades, best‑practice tips, and stability safeguards, while sharing concrete steps, pitfalls, and lessons learned from start to production rollout.

MySQLShardingstability
0 likes · 27 min read
From Monolith to Sharded MySQL: A Complete End‑to‑End Sharding Case Study
IT Architects Alliance
IT Architects Alliance
Sep 4, 2022 · Databases

Mastering MySQL: From Replication to High Availability and Sharding Strategies

This article examines why single-node databases no longer meet modern internet workloads, explores MySQL replication models (master‑slave, asynchronous, semi‑synchronous, group replication), discusses high‑availability solutions such as MHA, MGR and Orchestrator, and outlines vertical and horizontal sharding techniques along with their trade‑offs.

Database ArchitectureHigh AvailabilityMGR
0 likes · 13 min read
Mastering MySQL: From Replication to High Availability and Sharding Strategies
Java High-Performance Architecture
Java High-Performance Architecture
Sep 2, 2022 · Backend Development

Eight Essential Software Architecture Patterns Every Backend Engineer Should Master

This article explains eight core software architecture patterns—from single‑database single‑application to microservices, multi‑level caching, and multi‑datacenter deployments—detailing their designs, typical use cases, advantages, and drawbacks to help engineers choose the right approach for scalable, high‑performance systems.

Shardingcachingscalability
0 likes · 23 min read
Eight Essential Software Architecture Patterns Every Backend Engineer Should Master
WeChat Client Technology Team
WeChat Client Technology Team
Aug 30, 2022 · Databases

How WeChat Optimized Its Desktop Database for Speed, Size, and Reliability

This article analyzes the performance and storage problems of the Windows version of WeChat, explains why message growth causes slowness, large file size, and corruption risk, and presents a multi‑pronged solution involving sharding, indexing, payload compression, and robustness improvements that halve database size and boost I/O performance by about ten percent.

IndexingSQLiteSharding
0 likes · 11 min read
How WeChat Optimized Its Desktop Database for Speed, Size, and Reliability
Su San Talks Tech
Su San Talks Tech
Aug 18, 2022 · Fundamentals

What Hidden Pitfalls Await in Distributed Systems? A Deep Dive into Messaging, Caching, and Sharding

This article explores the fundamental concepts and common pitfalls of distributed systems—including CAP and BASE theories, message‑queue reliability issues, Redis sentinel challenges, sharding strategies, and distributed transaction models—offering practical guidance to avoid costly failures in real‑world deployments.

CAP theoremSharding
0 likes · 24 min read
What Hidden Pitfalls Await in Distributed Systems? A Deep Dive into Messaging, Caching, and Sharding
Wukong Talks Architecture
Wukong Talks Architecture
Aug 11, 2022 · Fundamentals

Common Pitfalls and Core Concepts of Distributed Systems, Message Queues, Caching, Sharding, and Transactions

This article provides a comprehensive overview of distributed system fundamentals—including CAP and BASE theories—while detailing typical pitfalls and mitigation strategies for message queues, distributed caches, database sharding, and distributed transactions, helping engineers decide when and how to adopt distributed architectures.

BASE modelCAP theoremSharding
0 likes · 23 min read
Common Pitfalls and Core Concepts of Distributed Systems, Message Queues, Caching, Sharding, and Transactions
Sohu Tech Products
Sohu Tech Products
Aug 3, 2022 · Backend Development

Design and Evolution of the Price‑Increase Coupon Service for a C2B Recycling Platform

This article details the architectural evolution of a price‑increase coupon system used in a C2B digital‑product recycling business, covering its initial experimental phase, platformization, sharding, intelligent recommendation, Elasticsearch integration, and stability enhancements through NoSQL and read‑replica strategies.

ElasticsearchShardingSystem Design
0 likes · 10 min read
Design and Evolution of the Price‑Increase Coupon Service for a C2B Recycling Platform
Senior Brother's Insights
Senior Brother's Insights
Jul 24, 2022 · Databases

Understanding Redis High Availability: Master‑Slave, Sentinel, and Cluster Explained

This article explains why single‑node Redis suffers from single‑point failures, describes the master‑slave replication model, details the Sentinel automatic failover mechanism, compares various sharding solutions like client‑side sharding, Twemproxy, Codis, and outlines the features and deployment considerations of Redis Cluster.

ClusterDatabaseHigh Availability
0 likes · 19 min read
Understanding Redis High Availability: Master‑Slave, Sentinel, and Cluster Explained
FunTester
FunTester
Jul 21, 2022 · Databases

Scaling Databases with Distributed Sharding and Peak‑Shaving Strategies

The article explains why simply adding hardware cannot keep up with growing database workloads and presents a three‑step approach—business isolation, horizontal sharding, and advanced reporting using PolarDB‑X—to achieve high concurrency, elastic capacity, and efficient caching for modern high‑traffic applications.

Database ScalingPeak ShavingPolarDB-X
0 likes · 7 min read
Scaling Databases with Distributed Sharding and Peak‑Shaving Strategies
Su San Talks Tech
Su San Talks Tech
Jul 21, 2022 · Databases

Mastering Database Sharding: When and How to Split Databases and Tables

This article explains the three aspects of database sharding—database‑only, table‑only, and both—detailing when to apply each, how to choose sharding keys, common algorithms, ID generation strategies, available open‑source tools, and the new challenges introduced by sharding.

ShardingVertical Scalingdatabase partitioning
0 likes · 16 min read
Mastering Database Sharding: When and How to Split Databases and Tables
Programmer DD
Programmer DD
Jul 20, 2022 · Databases

Mastering MySQL Sharding: Strategies, ID Generation, and Seamless Scaling

This article explains why and how to apply database sharding, introduces key terminology, compares global ID generation methods such as auto‑increment, UUID, COMB and Snowflake, outlines sharding algorithms, discusses challenges like distributed transactions, and presents practical expansion and implementation solutions.

Database ScalingMySQLSharding
0 likes · 12 min read
Mastering MySQL Sharding: Strategies, ID Generation, and Seamless Scaling
Zhuanzhuan Tech
Zhuanzhuan Tech
Jul 20, 2022 · Backend Development

Design and Evolution of the Price‑Increase Coupon Service for a C2B Recycling Platform

This article details the design, evolution, and scaling strategies of a price‑increase coupon system for a C2B digital product recycling platform, covering its initial experimental phase, platformization, sharding‑JDBC implementation, intelligent coupon recommendation, Elasticsearch integration, and operational optimizations for high‑throughput stability.

MicroservicesScalingSharding
0 likes · 11 min read
Design and Evolution of the Price‑Increase Coupon Service for a C2B Recycling Platform
MaGe Linux Operations
MaGe Linux Operations
Jul 17, 2022 · Databases

Understanding Redis High Availability: Master‑Slave, Sentinel, and Cluster Explained

This article explains how Redis tackles single‑point failures with master‑slave replication, introduces Sentinel for automatic failover, compares client‑side and proxy sharding solutions like Twemproxy and Codis, and details the native Redis Cluster architecture for true distributed storage and high availability.

ClusterHigh AvailabilityRedis
0 likes · 18 min read
Understanding Redis High Availability: Master‑Slave, Sentinel, and Cluster Explained
Aikesheng Open Source Community
Aikesheng Open Source Community
Jul 14, 2022 · Backend Development

Introducing and Evaluating the DBLE Split Command for Accelerated Data Import

This article explains the DBLE split feature that partitions large mysqldump files according to sharding configuration, provides command syntax and usage examples, and presents a performance test showing that split‑based import can be up to 18 times faster than direct DBLE import while preserving data correctness.

DBLEMySQLPerformance Testing
0 likes · 12 min read
Introducing and Evaluating the DBLE Split Command for Accelerated Data Import
JavaEdge
JavaEdge
Jul 10, 2022 · Databases

How to Partition Massive Datasets: Strategies, Trade‑offs, and Hotspot Prevention

This article explains why large‑scale systems need data partitioning beyond replication, defines partitions and sharding, compares key‑range and hash‑based partitioning methods, discusses load‑balancing and hotspot avoidance, and shows how replication works together with partitioning to improve scalability.

DatabaseHashingLoad Balancing
0 likes · 12 min read
How to Partition Massive Datasets: Strategies, Trade‑offs, and Hotspot Prevention
ITPUB
ITPUB
Jul 8, 2022 · Databases

Uncovering the Flaws: Why No Distributed Database Architecture Is Perfect

This article examines the most common Chinese distributed database architectures, comparing integrated SHARDING designs like OceanBase with separated compute‑storage models such as TiDB and SQL‑proxy based systems, highlighting their inherent trade‑offs, performance challenges, and practical considerations for choosing the right solution.

OceanBaseSQL proxySharding
0 likes · 11 min read
Uncovering the Flaws: Why No Distributed Database Architecture Is Perfect
Selected Java Interview Questions
Selected Java Interview Questions
Jul 5, 2022 · Big Data

Understanding Elasticsearch: Core Concepts, Architecture, Indexing Mechanics and Performance Optimization

This article explains the fundamentals of structured and unstructured data, introduces Lucene's inverted index, describes Elasticsearch's distributed cluster architecture, node roles, sharding and replication mechanisms, indexing workflow with refresh and translog, storage segment model, and provides practical performance‑tuning recommendations.

ClusterElasticsearchLucene
0 likes · 36 min read
Understanding Elasticsearch: Core Concepts, Architecture, Indexing Mechanics and Performance Optimization
Selected Java Interview Questions
Selected Java Interview Questions
Jul 4, 2022 · Backend Development

Introducing MyBatis-Mate: Enterprise‑Level Features for MyBatis‑Plus

This article introduces MyBatis‑Mate, an official MyBatis‑Plus extension that provides enterprise‑grade capabilities such as dictionary binding, field encryption, data masking, dynamic table maintenance, audit logging, sharding, multi‑datasource switching, and customizable data‑scope handling, all illustrated with code examples.

MyBatisShardingdata encryption
0 likes · 13 min read
Introducing MyBatis-Mate: Enterprise‑Level Features for MyBatis‑Plus
Sanyou's Java Diary
Sanyou's Java Diary
Jun 30, 2022 · Databases

Mastering Redis High Availability: Sharding, Consistent Hashing, and Sentinel Explained

This article explains Redis high‑availability strategies, covering basic hash sharding, the advantages of consistent hashing, client‑side versus proxy‑based partitioning, master‑slave replication, and the Sentinel failover mechanism, with diagrams illustrating node addition, removal, and failover decision processes.

DatabaseHigh AvailabilityRedis
0 likes · 10 min read
Mastering Redis High Availability: Sharding, Consistent Hashing, and Sentinel Explained
政采云技术
政采云技术
Jun 30, 2022 · Backend Development

ElasticJob‑Lite Overview and Implementation Details

This article provides a comprehensive overview of ElasticJob‑Lite, a distributed scheduling solution for high‑concurrency environments, covering its architecture, ZooKeeper‑based registration and sharding mechanisms, core listener components, key code examples, and the UI console deployment.

ElasticJobJob ManagementSharding
0 likes · 14 min read
ElasticJob‑Lite Overview and Implementation Details
IT Architects Alliance
IT Architects Alliance
Jun 27, 2022 · Databases

Mastering Cluster Terminology and Database Cluster Architectures

This article explains core cluster concepts, the benefits of building database clusters, classifies common cluster types, and compares scalable architectures such as Oracle RAC, MySQL Cluster, sharding, CAP/BAS​E theory, and cross‑database transaction strategies for high availability and performance.

CAP theoremDatabase ClusterHigh Availability
0 likes · 22 min read
Mastering Cluster Terminology and Database Cluster Architectures
IT Architects Alliance
IT Architects Alliance
Jun 14, 2022 · Backend Development

8 Essential Backend Architecture Patterns Every Engineer Should Master

This article explores eight common backend architecture patterns—from simple single‑database setups to microservices, caching, sharding, elastic scaling, and multi‑region deployments—detailing their design principles, typical use cases, advantages, drawbacks, and practical implementation steps.

Backend ArchitectureDesign PatternsElastic Scaling
0 likes · 23 min read
8 Essential Backend Architecture Patterns Every Engineer Should Master
Tencent Cloud Developer
Tencent Cloud Developer
Jun 7, 2022 · Databases

Mastering MongoDB: From Basics to Advanced Performance Tuning

This comprehensive guide explores MongoDB’s core features—including schema flexibility, high availability, sharding, storage engine internals, indexing, and performance tuning—while providing practical examples, configuration tips, and best‑practice recommendations for developers and architects seeking to efficiently deploy and operate MongoDB in production environments.

DatabaseIndexingMongoDB
0 likes · 40 min read
Mastering MongoDB: From Basics to Advanced Performance Tuning
Top Architect
Top Architect
May 26, 2022 · Backend Development

Eight Common Software Architecture Design Patterns and Their Advantages & Disadvantages

The article introduces eight widely used software architecture design patterns—including single‑database, content distribution, query separation, microservices, multi‑level caching, sharding, elastic scaling, and multi‑datacenter deployment—explaining their typical structures, suitable scenarios, and the key pros and cons of each.

Design PatternsMicroservicesSharding
0 likes · 21 min read
Eight Common Software Architecture Design Patterns and Their Advantages & Disadvantages
Bilibili Tech
Bilibili Tech
May 17, 2022 · Cloud Computing

Bilibili Object Storage Service (BOSS) Design: Building a Large-Scale Distributed Storage System in 13 Days

In just 13 days Bilibili transformed a simple MySQL‑based S3 prototype into the BOSS distributed object storage system by separating metadata and data, adding an RPC abstraction layer, implementing two‑level sharding, switching to RocksDB, and deploying a three‑replica, multi‑zone high‑availability architecture.

RocksDBS3 protocolSharding
0 likes · 15 min read
Bilibili Object Storage Service (BOSS) Design: Building a Large-Scale Distributed Storage System in 13 Days
Hacker Afternoon Tea
Hacker Afternoon Tea
May 7, 2022 · Databases

Notion’s PostgreSQL Sharding: Key Decisions, Migration Process, and Hard Lessons

In early 2021 Notion transformed its monolithic PostgreSQL into a horizontally partitioned fleet by sharding the block table and related data, using workspace IDs as the partition key, migrating through double‑write, backfill, and verification steps, and learning hard lessons about timing, zero‑downtime, and schema design.

AWSDatabase ScalingMigration
0 likes · 18 min read
Notion’s PostgreSQL Sharding: Key Decisions, Migration Process, and Hard Lessons
Xiao Lou's Tech Notes
Xiao Lou's Tech Notes
May 5, 2022 · Databases

How We Scaled a Ride‑Hailing Order System: From Single DB to Sharded MySQL

This article chronicles the step‑by‑step evolution of a ride‑hailing order service, detailing how a single SQLServer database was optimized, split by business domain, migrated to MySQL, and finally sharded with a custom client‑side component, while leveraging read/write separation, caching, MQ, and data‑exchange platforms to sustain massive traffic.

DatabasesMigrationSharding
0 likes · 15 min read
How We Scaled a Ride‑Hailing Order System: From Single DB to Sharded MySQL
Java Backend Technology
Java Backend Technology
May 1, 2022 · Databases

Mastering Database Performance: 8 Proven Optimization Strategies

This article explains why databases become slow, introduces a four‑layer thinking model, and presents eight practical solutions—including reducing data volume, leveraging space for performance, and selecting the right storage system—to help backend engineers resolve 80‑90% of common performance problems.

Data ArchivingNoSQLSharding
0 likes · 19 min read
Mastering Database Performance: 8 Proven Optimization Strategies
dbaplus Community
dbaplus Community
Apr 24, 2022 · Databases

Eight Practical Strategies to Tackle Database Performance Bottlenecks

This article outlines a systematic approach for backend engineers to identify root causes of database slowness and presents eight concrete optimization techniques—ranging from data reduction and space‑for‑performance trade‑offs to appropriate storage system selection—while explaining when each method is most effective and what trade‑offs to consider.

Database PerformanceNoSQLOptimization
0 likes · 18 min read
Eight Practical Strategies to Tackle Database Performance Bottlenecks
dbaplus Community
dbaplus Community
Apr 20, 2022 · Backend Development

How to Build a Robust E‑Commerce Backend: Idempotency, Snapshots, and Sharding

This article explores common e‑commerce backend challenges such as duplicate orders, order snapshots, cart storage, inventory oversell, logistics updates, account balance consistency, read‑write splitting, hot‑cold data separation, and sharding, and provides concrete design patterns and SQL examples to solve them.

IdempotencyShardingTransaction
0 likes · 17 min read
How to Build a Robust E‑Commerce Backend: Idempotency, Snapshots, and Sharding
Top Architect
Top Architect
Apr 20, 2022 · Databases

Understanding Distributed Transactions, Consistency Models, and Sharding in Database Systems

This article explains the fundamentals of distributed transactions, the ACID properties, various consistency models (strong, weak, eventual), sharding strategies (vertical and horizontal), the CAP and BASE theories, and the practical implementations of two‑phase, three‑phase, and TCC commit protocols, highlighting their advantages and drawbacks.

2PC3PCBASE
0 likes · 22 min read
Understanding Distributed Transactions, Consistency Models, and Sharding in Database Systems
Su San Talks Tech
Su San Talks Tech
Apr 17, 2022 · Backend Development

How Elasticsearch Powers Real-Time Search: Core Concepts and Best Practices

This article provides a comprehensive overview of Elasticsearch, explaining its underlying Lucene technology, data modeling, cluster architecture, shard and replica mechanisms, indexing workflow, storage strategies, refresh and translog processes, as well as practical performance and JVM tuning tips for building scalable, near‑real‑time search solutions.

ElasticsearchLuceneSharding
0 likes · 37 min read
How Elasticsearch Powers Real-Time Search: Core Concepts and Best Practices
ITPUB
ITPUB
Apr 14, 2022 · Databases

Eight Proven Strategies to Supercharge Database Performance

This article explains why databases become slow, introduces a four‑layer thinking model, and presents eight practical optimization techniques—including data reduction, caching, sharding, master‑slave replication, and CQRS—along with their benefits, drawbacks, and suitable scenarios.

NoSQLShardingcaching
0 likes · 22 min read
Eight Proven Strategies to Supercharge Database Performance
Code Ape Tech Column
Code Ape Tech Column
Apr 6, 2022 · Databases

Database Bottlenecks and Sharding Strategies

The article explains how I/O and CPU bottlenecks increase active database connections, then details various sharding techniques—including horizontal and vertical database/table partitioning, their concepts, results, scenarios, and analysis—followed by tools, implementation steps, common issues, and best‑practice recommendations.

Shardingperformancescalability
0 likes · 10 min read
Database Bottlenecks and Sharding Strategies
IT Services Circle
IT Services Circle
Apr 5, 2022 · Backend Development

Key Techniques for Building High‑Concurrency Systems: Load Balancing, Microservices, Caching, Sharding, Message Queues, and CDN

This article outlines essential architectural practices for high‑concurrency systems, covering load‑balancing strategies, distributed microservice design, caching mechanisms, database sharding, asynchronous message queues, and CDN usage to achieve scalable and resilient backend services.

Load BalancingMessage QueueMicroservices
0 likes · 11 min read
Key Techniques for Building High‑Concurrency Systems: Load Balancing, Microservices, Caching, Sharding, Message Queues, and CDN
Hacker Afternoon Tea
Hacker Afternoon Tea
Mar 16, 2022 · Databases

Building a Real-Time Dashboard with Distributed PostgreSQL (Citus) – Official Example

This tutorial shows how to use Citus, a distributed PostgreSQL extension, to ingest immutable HTTP event logs, shard them by site_id, create real‑time and pre‑aggregated tables, schedule roll‑up jobs, handle data expiration, estimate distinct counts with HyperLogLog, and store unstructured JSONB counters for a low‑latency analytics dashboard.

CitusHyperLogLogJSONB
0 likes · 16 min read
Building a Real-Time Dashboard with Distributed PostgreSQL (Citus) – Official Example
Top Architect
Top Architect
Mar 16, 2022 · Databases

Comprehensive Guide to Database Sharding: Vertical & Horizontal Partitioning, Global ID Generation, and Distributed Transaction Challenges

This article explains the concepts, methods, advantages, and drawbacks of database sharding, covering vertical and horizontal partitioning, sharding rules, global primary key generation, distributed transaction issues, cross‑node queries, pagination, data migration, and practical case studies, with code examples and diagrams.

Global ID GenerationShardingdatabase partitioning
0 likes · 24 min read
Comprehensive Guide to Database Sharding: Vertical & Horizontal Partitioning, Global ID Generation, and Distributed Transaction Challenges
Hacker Afternoon Tea
Hacker Afternoon Tea
Mar 14, 2022 · Databases

Building a Multi‑Tenant SaaS with Citus: An Official Distributed PostgreSQL Example

This guide walks through creating a multi‑tenant ad‑analytics SaaS using Citus, covering schema design, sharding by company_id, data ingestion, reference tables, online schema changes, tenant‑specific JSONB fields, hardware scaling, large‑tenant isolation, and migration steps with concrete SQL examples and commands.

CitusDistributed SQLJSONB
0 likes · 27 min read
Building a Multi‑Tenant SaaS with Citus: An Official Distributed PostgreSQL Example
Selected Java Interview Questions
Selected Java Interview Questions
Mar 9, 2022 · Big Data

Elasticsearch Overview: Core Concepts, Architecture, and Performance Optimization

This article provides a comprehensive overview of Elasticsearch, covering its data types, Lucene-based inverted index, cluster architecture, sharding and replication mechanisms, mapping definitions, basic usage, health monitoring, storage internals, and practical performance tuning tips for large‑scale search deployments.

ClusterElasticsearchLucene
0 likes · 36 min read
Elasticsearch Overview: Core Concepts, Architecture, and Performance Optimization
Hacker Afternoon Tea
Hacker Afternoon Tea
Mar 6, 2022 · Databases

Understanding Citus: Distributed PostgreSQL Architecture and Core Concepts

Citus extends PostgreSQL into a shared‑nothing distributed system where a coordinator node routes queries to worker nodes, supporting distributed, reference, and local tables, shard placement, replication modes, co‑location, parallel execution, and configurable connection‑pool settings to scale storage and CPU across a cluster.

CitusPostgreSQLQuery Execution
0 likes · 12 min read
Understanding Citus: Distributed PostgreSQL Architecture and Core Concepts
21CTO
21CTO
Feb 27, 2022 · Databases

Designing Scalable Login Schemas for Billions of Users

This article explains how to design a flexible, extensible database schema and login flow for a system with a billion users, covering multi‑credential handling, sharding strategies, hash‑based routing, and practical considerations such as password updates and caching.

Shardinghigh concurrencylogin system
0 likes · 9 min read
Designing Scalable Login Schemas for Billions of Users
Hacker Afternoon Tea
Hacker Afternoon Tea
Feb 25, 2022 · Databases

How Citus Turns PostgreSQL into a Distributed Database

Citus is an open‑source PostgreSQL extension that adds sharding, distributed tables and parallel query execution, enabling horizontal and vertical scaling for multi‑tenant SaaS, real‑time analytics, and massive workloads, while outlining acquisition options, practical use cases, and scenarios where it is unsuitable.

AzureCitusPostgreSQL
0 likes · 7 min read
How Citus Turns PostgreSQL into a Distributed Database
Top Architect
Top Architect
Feb 22, 2022 · Databases

Database Sharding: Concepts, Global ID Strategies, Partitioning Schemes, and Expansion Solutions

This article explains database sharding fundamentals, including terminology, when to adopt sharding, various global ID generation methods such as auto‑increment, UUID, COMB, and Snowflake, different partitioning strategies, challenges like distributed transactions, and practical expansion and migration solutions.

PartitioningShardingid generation
0 likes · 14 min read
Database Sharding: Concepts, Global ID Strategies, Partitioning Schemes, and Expansion Solutions
Java Architect Essentials
Java Architect Essentials
Feb 15, 2022 · Databases

mybatis-mate: An Enterprise‑Level MyBatis‑Plus Extension for Sharding, Data Auditing, Encryption, and More

This article introduces mybatis-mate, an official MyBatis‑Plus extension that provides enterprise‑grade features such as sharding, multi‑datasource support, data auditing, field encryption, sensitive‑data masking, automatic DDL maintenance, dynamic datasource switching, distributed transaction logging, and fine‑grained data permission control, with detailed usage examples and configuration snippets for Spring Boot projects.

Data AuditingDatabaseMyBatis
0 likes · 15 min read
mybatis-mate: An Enterprise‑Level MyBatis‑Plus Extension for Sharding, Data Auditing, Encryption, and More
Architect's Journey
Architect's Journey
Feb 9, 2022 · Databases

Choosing the Right Database Architecture: A Practical Guide

The article walks through the challenges of growing data volumes, compares master‑slave, vertical, horizontal, and sharding‑plus‑partitioning architectures, explains their pros and cons, and provides concrete guidance on selecting and implementing a suitable database solution, including middleware options and real‑world case studies.

Database ArchitectureMiddlewareSharding
0 likes · 21 min read
Choosing the Right Database Architecture: A Practical Guide
Su San Talks Tech
Su San Talks Tech
Feb 7, 2022 · Databases

Essential MySQL Interview Q&A: Locks, Indexes, Replication, and Optimization

A comprehensive collection of MySQL interview questions and answers covering storage engines, lock types, gap locks, deadlock avoidance, isolation levels, index types, covering indexes, the left‑most prefix rule, SQL tuning, master‑slave replication, latency handling, sharding challenges, and global ID generation.

DatabaseIndexingInterview
0 likes · 15 min read
Essential MySQL Interview Q&A: Locks, Indexes, Replication, and Optimization
IT Architects Alliance
IT Architects Alliance
Jan 15, 2022 · Backend Development

How to Build a Million‑Message‑Per‑Second RabbitMQ Cluster: Lessons from Google and Real‑World Experiments

This article explains the fundamentals of RabbitMQ, compares normal and mirrored cluster modes, details Google’s large‑scale test setup, and walks through advanced plugins such as sharding, consistent‑hash exchange, federation, and high‑availability strategies for achieving million‑level message throughput.

ClusteringHigh AvailabilityMessage Queue
0 likes · 24 min read
How to Build a Million‑Message‑Per‑Second RabbitMQ Cluster: Lessons from Google and Real‑World Experiments
IT Architects Alliance
IT Architects Alliance
Jan 14, 2022 · Operations

Scaling RabbitMQ to Million‑Message Throughput: Architecture, Plugins, and High‑Availability Practices

This article explains how to horizontally scale RabbitMQ clusters, use sharding and federation plugins, configure mirror queues and other high‑availability features, and apply practical patterns such as confirms, retries, and delayed delivery to achieve million‑level message throughput in production environments.

ClusteringFederationMessage Queue
0 likes · 23 min read
Scaling RabbitMQ to Million‑Message Throughput: Architecture, Plugins, and High‑Availability Practices
Architecture Digest
Architecture Digest
Jan 13, 2022 · Backend Development

Scaling RabbitMQ to Million‑Message Throughput: Architecture, Sharding, Federation, and High‑Availability Practices

This article explains how to horizontally scale RabbitMQ clusters to handle millions of messages per second by leveraging cluster modes, mirror queues, sharding plugins, consistent‑hash exchanges, federation, and high‑availability configurations, while also covering practical scenarios such as retries, delayed tasks, and Spring AMQP integration.

ClusteringFederationHigh Availability
0 likes · 22 min read
Scaling RabbitMQ to Million‑Message Throughput: Architecture, Sharding, Federation, and High‑Availability Practices
NiuNiu MaTe
NiuNiu MaTe
Dec 15, 2021 · Databases

Master MySQL Performance: Practical Tuning, Indexes, and Scaling Strategies

This comprehensive guide walks through MySQL performance fundamentals, real‑world testing results, slow‑query detection, index impact, pagination pitfalls, count optimizations, sharding techniques, and step‑by‑step migration plans for large tables, equipping engineers with actionable tuning insights.

Database ScalingMySQLSharding
0 likes · 13 min read
Master MySQL Performance: Practical Tuning, Indexes, and Scaling Strategies
Tencent Architect
Tencent Architect
Dec 14, 2021 · Databases

Master MongoDB: From Basics to Advanced Performance and Scaling

This comprehensive guide covers MongoDB's core concepts—including schema‑free design, high availability, sharding, storage engine internals, indexing, and performance tuning—while providing practical code examples, configuration steps, and best‑practice tips for developers and architects looking to master the database in production environments.

Database DesignIndexingMongoDB
0 likes · 45 min read
Master MongoDB: From Basics to Advanced Performance and Scaling
Top Architect
Top Architect
Dec 12, 2021 · Databases

Elasticsearch Cluster and Data Layer Architecture Overview

This article explains Elasticsearch’s cluster and data layer architecture, covering nodes, indices, shards, replicas, mixed and tiered deployment models, storage options, and the trade‑offs of different distributed system designs for scalable systems.

Cluster ArchitectureElasticsearchReplica
0 likes · 14 min read
Elasticsearch Cluster and Data Layer Architecture Overview
Tencent Cloud Developer
Tencent Cloud Developer
Dec 10, 2021 · Databases

MongoDB Architecture and Performance Optimizations for Tencent Cloud K‑Song Feed Service

The article details how Tencent Cloud’s K‑Song feed service, serving over 150 million daily users, was engineered with a read‑expansion model, cached results, auxiliary index tables, hashed sharding, write‑concern tuning, disabled chain replication, and WiredTiger and backup optimizations, achieving sub‑10 ms write latency and significantly lower CPU and slow‑query rates.

MongoDBShardingTencent Cloud
0 likes · 17 min read
MongoDB Architecture and Performance Optimizations for Tencent Cloud K‑Song Feed Service
IT Architects Alliance
IT Architects Alliance
Dec 9, 2021 · Backend Development

How to Build a Billion‑User Scalable User Center: Architecture, APIs, Token Fallback, and Security

This article presents a comprehensive, practical design for an ultra‑large‑scale user center, covering microservice architecture, API separation, token generation with graceful degradation, data‑sharding strategies, password encryption, asynchronous processing, and detailed monitoring to ensure high availability, performance, and security.

MicroservicesMonitoringSharding
0 likes · 16 min read
How to Build a Billion‑User Scalable User Center: Architecture, APIs, Token Fallback, and Security
Java Interview Crash Guide
Java Interview Crash Guide
Dec 7, 2021 · Databases

Why Traditional Pagination Fails After Sharding and How to Solve It

When a table grows beyond ten million rows, sharding it across multiple databases improves performance, but the usual LIMIT offset, pagesize pagination breaks, leading to missing or incorrect records; this article examines why simple merge approaches fail and evaluates global, secondary query, and no‑skip paging strategies, highlighting their trade‑offs.

DatabaseMySQLSQL
0 likes · 12 min read
Why Traditional Pagination Fails After Sharding and How to Solve It
dbaplus Community
dbaplus Community
Dec 6, 2021 · Backend Development

Mastering Elasticsearch Index Design: From Sharding to Mapping

This comprehensive guide explains Elasticsearch index design, covering shard and replica planning, settings optimization, dynamic and static mappings, template management, lifecycle automation, and practical best‑practice recommendations for high‑performance, stable search clusters.

Lifecycle ManagementShardingindex design
0 likes · 26 min read
Mastering Elasticsearch Index Design: From Sharding to Mapping
Programmer DD
Programmer DD
Nov 28, 2021 · Backend Development

Master MyBatis with Mybatis-Mate: Sharding, Encryption, Auditing and More

This article introduces Mybatis-Mate, an enterprise‑level MyBatis extension that provides sharding, data audit, sensitive‑word filtering, field encryption, dictionary binding, data permission, dynamic DDL generation and other features, and shows how to integrate and use them with practical code examples.

Data AuditingMyBatisSharding
0 likes · 14 min read
Master MyBatis with Mybatis-Mate: Sharding, Encryption, Auditing and More
政采云技术
政采云技术
Nov 18, 2021 · Databases

Elasticsearch Series Part 1: Introduction to System Concepts and Read/Write Flow

This article introduces Elasticsearch as a distributed, high‑performance search engine, explains its cluster architecture, node roles, shard and replica mechanisms, write and refresh processes, and outlines search handling techniques such as pagination, scroll and search‑after with practical curl examples.

Cluster ArchitectureElasticsearchSearch API
0 likes · 11 min read
Elasticsearch Series Part 1: Introduction to System Concepts and Read/Write Flow
Top Architect
Top Architect
Nov 13, 2021 · Backend Development

Introducing MyBatis-Mate: Enterprise‑Level Features for MyBatis‑Plus

This article introduces MyBatis‑Mate, an official MyBatis‑Plus extension that provides enterprise‑grade capabilities such as sharding, data auditing, field encryption, dictionary binding, sensitive data masking, automatic DDL maintenance, dynamic data‑source switching, performance logging, and fine‑grained data‑scope control, all illustrated with practical code examples.

MyBatisORMPerformance Logging
0 likes · 15 min read
Introducing MyBatis-Mate: Enterprise‑Level Features for MyBatis‑Plus
Java Architect Essentials
Java Architect Essentials
Nov 8, 2021 · Operations

Scaling RabbitMQ to Million‑Message Throughput: Architecture, Sharding, Federation, and High Availability

This article explains how to horizontally scale RabbitMQ clusters to achieve million‑message per second throughput, covering Google’s large‑scale test setup, sharding and consistent‑hash plugins, federation, high‑availability mirroring, reliability mechanisms, and practical deployment tips for production environments.

High AvailabilityShardingrabbitmq
0 likes · 23 min read
Scaling RabbitMQ to Million‑Message Throughput: Architecture, Sharding, Federation, and High Availability
dbaplus Community
dbaplus Community
Nov 7, 2021 · Databases

Why Distributed Databases Matter: From Early DBMS to Modern NewSQL

This article traces the evolution of database systems—from the first network and hierarchical models through relational databases, NoSQL sharding, and finally modern distributed SQL—explaining why distributed databases emerged, how they handle data distribution, consistency, SQL-to‑KV mapping, and transaction challenges.

Data ReplicationDistributed DatabasesNewSQL
0 likes · 16 min read
Why Distributed Databases Matter: From Early DBMS to Modern NewSQL
Top Architect
Top Architect
Nov 6, 2021 · Databases

Understanding Database Sharding: Partitioning Strategies and When to Use Them

This article explains the concepts, characteristics, and practical scenarios of database sharding—including vertical and horizontal table partitioning as well as vertical and horizontal database partitioning—helping developers decide when and how to apply each strategy to improve scalability and performance.

Horizontal PartitioningMySQLSharding
0 likes · 10 min read
Understanding Database Sharding: Partitioning Strategies and When to Use Them
Java Captain
Java Captain
Nov 6, 2021 · Databases

Introducing mybatis-mate: Enterprise‑Level MyBatis Extension for Sharding, Data Encryption, Auditing, and More

The article presents mybatis-mate, an enterprise‑grade MyBatis module that provides sharding, data auditing, sensitive‑word filtering, field encryption, dictionary write‑back, data permission, automatic DDL maintenance, dynamic multi‑datasource switching, and distributed transaction logging, offering developers a more agile and elegant way to handle data.

Data AuditingDatabaseORM
0 likes · 15 min read
Introducing mybatis-mate: Enterprise‑Level MyBatis Extension for Sharding, Data Encryption, Auditing, and More
ITPUB
ITPUB
Nov 5, 2021 · Databases

Why Distributed Databases Face Consistency Challenges and How to Address Them

The article explains how distributed database systems appear as a single logical database but operate over a network of nodes, detailing failures, stale reads, consistency models, architecture anomalies, sharding, replication, and various read/write scenarios that illustrate the complexity of achieving strong consistency.

CAP theoremDistributed DatabasesSharding
0 likes · 16 min read
Why Distributed Databases Face Consistency Challenges and How to Address Them
Top Architect
Top Architect
Oct 28, 2021 · Databases

ShardingSphere-JDBC MySQL Master‑Slave Replication, Redo Log, Binlog and Sharding Implementation Guide

This article provides a step‑by‑step tutorial on configuring MySQL master‑slave replication with Docker, explains redo log and binlog mechanisms, demonstrates two‑phase commit, and shows how to use ShardingSphere‑Jdbc for read/write splitting and sharding with detailed Spring Boot examples and code snippets.

MySQLShardingShardingSphere
0 likes · 21 min read
ShardingSphere-JDBC MySQL Master‑Slave Replication, Redo Log, Binlog and Sharding Implementation Guide
High Availability Architecture
High Availability Architecture
Oct 26, 2021 · Databases

Practical Guide to Horizontal Database Sharding: Design Principles, Common Schemes, and Expansion Strategies

This article explains the background, design criteria, and practical implementations of horizontal database sharding—including range, hash, gene, routing‑table, and consistent‑hash methods—while discussing common pitfalls, data‑skew mitigation, and both doubling and consistent‑hash expansion techniques for MySQL clusters.

Database ScalingHorizontal PartitioningMySQL
0 likes · 24 min read
Practical Guide to Horizontal Database Sharding: Design Principles, Common Schemes, and Expansion Strategies
dbaplus Community
dbaplus Community
Oct 21, 2021 · Databases

How We Scaled an E‑commerce Order System with Sharding, Consistent Hashing, and Zero‑Downtime Migration

This article details how a rapidly growing e‑commerce platform migrated from a single MySQL instance to a 16‑shard architecture using Sharding‑Jdbc, introduced consistent‑hashing to mitigate data skew, leveraged ES+HBase for multi‑dimensional queries, and implemented zero‑downtime migration strategies such as dual‑write and Canal replication.

Database ScalingElasticsearchHBase
0 likes · 21 min read
How We Scaled an E‑commerce Order System with Sharding, Consistent Hashing, and Zero‑Downtime Migration
ITPUB
ITPUB
Oct 12, 2021 · Databases

How to Handle Pagination After MySQL Sharding: Pitfalls and Solutions

When a MySQL table is sharded into multiple databases or tables, the usual LIMIT offset, pagesize pagination breaks, and this article examines why simple merge fails, then presents three practical approaches—global limit, secondary queries, and jump‑page restriction—highlighting their trade‑offs and limitations.

DatabaseMySQLSQL
0 likes · 13 min read
How to Handle Pagination After MySQL Sharding: Pitfalls and Solutions
Xiao Lou's Tech Notes
Xiao Lou's Tech Notes
Oct 12, 2021 · Databases

Optimizing ORDER BY/LIMIT in Sharded Databases with Cobar’s Algorithm

This article explains Cobar’s sharding middleware and presents an optimization technique for handling ORDER BY and LIMIT queries across multiple databases, detailing the original approach, its inefficiencies with deep pagination, the step‑by‑step improved algorithm, performance analysis, limitations, and practical applicability.

CobarDatabasesLIMIT
0 likes · 8 min read
Optimizing ORDER BY/LIMIT in Sharded Databases with Cobar’s Algorithm