The article revisits the rise and fall of database sharding, explains why it became problematic, and evaluates newer cloud‑native, distributed‑SQL, and serverless databases as modern replacements, offering a practical four‑step guide to help engineers choose the right solution for their workload and team.
This article details the TiDB upgrade journey from version 5.3.3 to 7.5.x, covering architecture, new v7 features, migration strategies, encountered problems with full‑table scans and inaccurate aggregation plans, the solutions applied, and the measurable performance and stability gains achieved after the upgrade.
RedHub is a next‑generation database proxy built by Xiaohongshu that unifies fragmented access methods, leverages PolarDB‑X for distributed SQL execution, and delivers high‑performance, highly available, and easily observable database connectivity, enabling seamless migration and advanced features for massive‑scale workloads.
Google Cloud Spanner now offers a policy‑driven hierarchical storage tier that moves infrequently accessed data to cheap HDDs, reducing costs by up to 80% while keeping SQL queries seamless across SSD and HDD layers and preserving backup consistency.
This article presents a comprehensive technical overview of Bilibili's Presto cluster architecture, the challenges of query performance on Hadoop, and the systematic optimizations—including Alluxio integration, local cache mechanisms, multi‑active coordinators, label‑based scheduling, and real‑time penalties—that together improve availability, stability, and latency for large‑scale analytics workloads.
This article provides a comprehensive, step‑by‑step guide to StarRocks join optimization, covering join types, logical rewrite rules, predicate push‑down, join reorder algorithms, cost modeling, distributed join strategies, and runtime filters, while offering practical tips for achieving high‑performance query execution.
ByteDance’s internal Presto platform, supporting nearly one million daily queries across ad‑hoc, BI visualization, and near‑real‑time analytics, achieves high performance and stability through SparkSQL compatibility, multi‑Coordinator architecture, dynamic routing, adaptive query cancellation, History Server, materialized views, and a dedicated Hudi connector.
This article details the billing group's challenges with single‑node MySQL, the evaluation of alternative databases such as TiDB and CockroachDB, performance testing, migration strategies, operational best practices, and the final decision to adopt TiDB for scalable, high‑availability data services.
At Didi, Presto has been the default ad‑hoc and Hive‑SQL engine for over three years, serving 6,000 users, processing 2‑3 PB daily and 30‑35 trillion rows, with mixed and dedicated clusters, migration to PrestoSQL 340, extensive Hive compatibility, label‑based isolation, a native Druid connector, usability and stability enhancements, and JVM‑level performance optimizations, while planning further resource‑saving upgrades.
The article explains the evolution of database architecture toward distributed SQL, outlining its seven core features such as scalability, consistency, elasticity, geo‑replication, SQL support, data locality, and multi‑cloud capability, while also describing essential database functions and practical considerations for cloud‑native deployments.
Distributed SQL databases combine the reliability of traditional relational systems with cloud-native scalability, offering seven core traits—scalability, consistency, elasticity, geo-replication, SQL support, data locality, and multi‑cloud operation—while still meeting essential database functions such as manageability, optimization, security, and integration.
Distributed SQL databases combine the familiar relational SQL API with cloud‑native, horizontally scalable architectures, offering strong consistency, distributed ACID transactions, automatic sharding, fault‑tolerant replication, and low‑latency geo‑distribution, making them an agile, resilient choice for modern application development.
This article walks through the entire process of installing and configuring a TiDB cluster using Ansible, covering component overview, environment preparation, detailed deployment commands, common pitfalls, and verification steps to help readers avoid common mistakes.
This article presents a comprehensive overview of Apache Doris, covering its positioning as a distributed MPP analytical database, core architecture with FE and BE nodes, key technologies such as vectorized execution and materialized views, integration with Kafka and Elasticsearch, additional features, roadmap, and detailed case studies from Baidu Statistics and Meituan, illustrating its practical deployment and performance characteristics.
