When a MySQL server contains many databases but you only need to recover one database or a single table, you can extract the relevant CREATE and INSERT statements from a full mysqldump using sed or grep, then import them, avoiding a costly full‑instance restore.
This article outlines the practical experience of upgrading MySQL from version 5.7 to 8.0, detailing version requirements, the specific upgrade tasks, step‑by‑step procedures, and important considerations such as deprecated sql_mode settings, character set handling, and lower_case_table_names consistency.
This guide provides a concise review of fundamental database concepts—including definitions of databases, RDBMS, SQL, and tables—and walks through essential SQL query techniques, data manipulation commands, schema definition statements, and control language basics, offering practical examples for data analysts.
MySQL 8.0.14 introduces a read/write consistency feature for Group Replication, explaining why MGR can still be inconsistent, detailing the group_replication_consistency parameter with its five levels, their advantages, disadvantages, and appropriate application scenarios, plus example session settings.
This article explains why MySQL acquires row locks that persist until a transaction commits, using analogies with multithreading, detailed transaction scenarios, the role of intention locks, and how isolation levels affect lock behavior, all illustrated with code examples and diagrams.
This article provides concise explanations of common MySQL interview topics, covering the three normal forms, auto‑increment behavior, version retrieval, ACID properties, char vs varchar, float vs double, join types, index implementation, isolation levels, storage engines, lock mechanisms, troubleshooting commands, and performance‑tuning tips.
This article provides a detailed analysis of Redis's two persistence mechanisms—RDB snapshots and AOF logging—covering their core concepts, implementation details, trigger conditions, data safety, performance impact, and recovery speed to help engineers choose the appropriate method for their workloads.
The article explains the concepts, advantages, and drawbacks of optimistic and pessimistic locking, provides real‑world examples such as lost updates and inconsistent reads, and offers practical guidelines and implementation techniques for selecting the appropriate concurrency control strategy in database‑driven applications.
This article examines MySQL's insert locking behavior, including unique‑key checks, S Next‑Key locks, insert‑intention locks, gap locks, and the resulting deadlock scenarios, and provides practical recommendations for avoiding such lock conflicts in production environments.
The article examines MySQL 5.6’s crash‑safe slave replication, explaining how earlier versions’ unsafe relay‑log handling could corrupt position data, describing the atomic update of mysql.slave_relay_log_info via table‑based relay‑log info and transaction coordination, and covering configuration options, recovery behavior, GTID implications, performance trade‑offs, and implementation guidance.
The article explains how MySQL's InnoDB engine triggers a semaphore crash after a thread waits over 600 seconds, details the lock locations in dict0dict.c and btr0sea.c, examines the role of Adaptive Hash Index and buffer pool pressure, and introduces a small utility (mysqldba) to help DBAs diagnose and resolve such issues.
This article explains the special JOIN LATERAL operator, compares it with INNER JOIN and correlated subqueries, shows how SQL Server implements it via CROSS APPLY, and demonstrates its support in Apache Flink using Calcite and user‑defined table functions with concrete code examples.
This article explains the purpose and types of SQL JOIN operators, demonstrates their syntax and semantics with examples, compares traditional database joins to Apache Flink's streaming two‑stream join implementation, and discusses optimization techniques such as state management, shuffle handling, and join reordering.
This article examines the limitations of traditional relational databases and explains how NoSQL solutions—key‑value stores, document databases, columnar databases, and full‑text search engines—address issues like schema rigidity, high I/O, and weak search, helping you choose the right data store.
This article explores Java enums in depth, covering their basic definition, typical usage patterns such as iteration and switch statements, implementing singletons, integrating with databases via MyBatis type handlers, and addressing common misconceptions about memory consumption, illustrating each concept with clear code examples.
Apache ShardingSphere provides an integrated distributed transaction solution combining traditional ACID‑compliant two‑phase commit, flexible Saga‑based transactions, and automatic transaction management, detailing their architectures, features, trade‑offs, and usage guidelines for developers handling multi‑database microservice environments.
This article examines a MySQL 5.6 InnoDB deadlock scenario caused by concurrent batch INSERTs, detailing the table schema, test cases, lock acquisition phases, log analysis, lock compatibility matrix, and discusses why typical SQL‑level fixes are limited, suggesting index redesign or data sharding as mitigation.
The article shows how a single front‑end developer can create the “Moly Subscription Assistant” WeChat mini‑program in five days using Tencent Cloud serverless development, covering OpenID authentication, cloud‑function CRUD for subscriptions, scheduled currency‑rate updates, and a fully managed backend without any traditional servers.
This article introduces DBLE, an enterprise‑grade open‑source distributed middleware, and provides a step‑by‑step Docker‑Compose quick‑start tutorial covering download links, prerequisite installations, container launch, connection details, cleanup commands, and how to customize the configuration with custom scripts.
This article explains Redis as an in‑memory data store used for caching, database, and messaging, walks through its evolution from simple HTTP caching to dedicated servers, and details server‑side features like persistence, Sentinel, replication, clustering, as well as client‑side capabilities such as rich data types, transactions, Lua scripting, pipelining, and distributed locks.
This article analyzes a MySQL deadlock scenario where concurrent inserts and unique‑key conflicts lead to circular lock waits, explains the underlying lock behavior, walks through the full deadlock log, and proposes using INSERT ON DUPLICATE KEY UPDATE to prevent the issue.
This guide presents comprehensive Redis best practices covering key naming, value design, command selection, client configuration, memory‑efficient data structures, and practical Java code for safely deleting large keys, helping developers build high‑performance, reliable Redis deployments.
This article examines a real MySQL deadlock case caused by concurrent UPDATE‑then‑INSERT logic, explains the underlying InnoDB lock phases, analyzes the deadlock log step by step, and proposes a safer single‑statement solution using INSERT ON DUPLICATE KEY.
A SAP month‑end CO module query suffered severe slowdown despite standard index hints, prompting a deep dive into execution plans, statistics, and a little‑known num_index_keys hint that dramatically improves IN‑list iterator access and reduces filter overhead.
This comprehensive guide explains the main factors that slow down MySQL queries—including inefficient SQL, concurrency limits, CPU and disk I/O bottlenecks, network issues, large tables, and transaction overhead—while offering concrete configuration tweaks, storage‑engine choices, indexing strategies, and sharding techniques to dramatically improve performance.
This article explains MySQL’s storage engines, compares B‑Tree and B+Tree indexes, details their structures and search processes, and outlines key principles for designing efficient indexes to avoid slow queries in relational databases.
This article walks through the evolution of Redis clustering—from early Replication+Sentinel setups, through Proxy‑based solutions, to modern Redis Cluster—detailing their architectures, advantages, drawbacks, and provides practical interview tips and high‑impact answers for candidates.
Pika 3.0, the open‑source C++ Redis‑compatible storage built on RocksDB, introduces a new Blackwidow engine, enhanced binlog, and optimized server layer, delivering higher interface performance, reduced disk usage, extended key length, full ZSET compatibility, and improved overall efficiency.
The article first outlines HBase’s overall architecture and core components, then details the end‑to‑end read path—from client request routing to RegionServer processing, data organization and filtering—and finally presents practical client‑ and server‑side optimizations such as heterogeneous storage, HDFS short‑circuit, hedged reads, high‑availability reads, and warm‑up failure fixes, illustrated with Youzan’s production cluster.
The article explains seven SQL join techniques—including INNER, LEFT, RIGHT, FULL OUTER, and their exclusive variants—illustrated with diagrams and accompanied by complete SELECT statements that demonstrate how to combine rows from two tables based on matching keys.
This article walks through a step‑by‑step InnoDB deadlock case where three sessions inserting rows with the same unique key cause a lock‑compatibility conflict, explains the INSERT lock phases, shows the actual deadlock log, and reveals why the deadlock occurs.
This article walks through MySQL InnoDB lock mechanisms, demonstrates how concurrent INSERTs on a unique key generate intention and gap locks, and uses detailed engine status logs to explain why those locks can cause deadlocks.
Redis, a high‑performance NoSQL database, offers multiple clustering approaches—including client‑side sharding, proxy‑based solutions like Twemproxy and Codis, and the native Redis Cluster—each with distinct trade‑offs in scalability, availability, operational complexity, and performance, guiding engineers to select the optimal architecture for their workloads.
This article demonstrates how MySQL partition tables dramatically improve query speed for large datasets, compares partition-key, secondary-index, and full‑scan queries, outlines the practical performance gains, and details the numerous limitations and trade‑offs that influence when to adopt partitioning versus sharding.
This article presents a comprehensive case study of how JD's Service Market improved the performance of its core "Available Plugin List" service by analyzing self‑optimizations, resolving external resource conflicts, designing a unified caching model, and implementing asynchronous cache construction using binlog and MQ, ultimately achieving a six‑fold traffic surge handling during peak events.
This article reviews the progression of Redis high‑availability solutions—from simple replication with Sentinel, through proxy‑based setups, to native Redis Cluster—explains their advantages and drawbacks, and provides practical interview Q&A tips for candidates.
Amid accelerating enterprise cloud adoption, Tencent Cloud has leveraged high‑performance, cost‑effective products such as CynosDB, TDSQL, CTSDB, and MongoDB, combined with open‑source collaborations, to capture a dominant share of the Chinese cloud database market in 2018‑2019.
This article explains Redis’s key features and common use cases, highlights the risks of single‑node deployments, compares two master‑slave replication architectures, and outlines their pros and cons, and details how Redis Sentinel provides automated monitoring, failover, and configuration to achieve high availability.
This article walks through the design of a highly available Redis deployment, explains common failure scenarios, compares single‑node, master‑slave, and multi‑Sentinel architectures, and shows how adding a virtual IP and three Sentinel instances can provide robust HA while keeping client usage simple.
This article provides a comprehensive guide to MySQL indexes, covering fundamental concepts, various index types, creation and design principles, practical optimization techniques, and the underlying data structures, illustrated with example tables, SQL statements, EXPLAIN analyses, and visual diagrams.
The article explains the concepts, advantages, disadvantages, and practical selection criteria of optimistic and pessimistic locking in concurrent systems, illustrating the ideas with version‑control examples and offering implementation tips for both database and web applications.
The guide walks through creating a sample InnoDB table, reproducing a delete‑vs‑insert deadlock, and dissecting the SHOW ENGINE INNODB STATUS output to explain lock modes such as X, S, GAP and INSERT‑INTENTION, showing how one transaction’s IX lock and another’s X lock on the same index create a classic deadlock and why understanding these modes is crucial for diagnosis.
The article lists nineteen practical MySQL optimization methods—including using EXPLAIN, limiting IN clause size, avoiding SELECT *, using LIMIT 1, reducing unnecessary sorting, preferring UNION ALL, avoiding ORDER BY RAND(), distinguishing IN/EXISTS, applying proper pagination, segment queries, avoiding NULL checks, using full‑text indexes, preventing expression‑based WHERE clauses, respecting left‑most prefix, forcing indexes, handling range queries, and optimizing JOINs—to improve query performance and resource usage.
This article explains the RESP protocol used by Redis, details its five data types, demonstrates pipeline handling with raw sockets, examines the parsing and command‑packing logic of the redis‑py client, analyzes the pipeline implementation and limitations of redis‑py‑cluster, and speculates on upcoming RESP3 features.
TDH 5.2.3 introduces a series of stability and performance upgrades—including transaction and compaction optimizations, enhanced error handling, SQL length protection, improved Oracle‑compatible UDFs, default resource pool support, Guardian caching, TxSQL monitoring, and workflow and OLAP engine fixes—aimed at delivering a more reliable big‑data platform.
This article presents NetEase Hangzhou Research Institute's experience in building a data infrastructure, covering database innovations such as InnoSQL, NTSDB, and InnoRocks, as well as the integration of big‑data components like HDFS, Spark, Impala, and Kudu to enable efficient storage, processing, and real‑time analytics.
This guide walks you through diagnosing MySQL service startup failures on Windows, initializing the data directory, retrieving the auto‑generated root password, and resetting it so you can successfully log in and use MySQL again.
This article explains the concept of idempotence, provides real‑world examples such as duplicate form submissions and payment requests, and details practical backend techniques—including query handling, unique indexes, token mechanisms, pessimistic and optimistic locks, distributed locks, and API design—to guarantee that repeated operations produce consistent results without side effects.
This article presents a comprehensive methodology for performance testing and optimization of a new corporate banking system, covering evaluation metrics, monitoring tools, test environment setup, common bottlenecks, detailed troubleshooting steps, and real‑world case studies to achieve higher throughput, lower latency, and better scalability.
This article presents 19 practical MySQL optimization tips, ranging from using EXPLAIN and proper indexing to rewriting IN/EXISTS queries, avoiding costly ORDER BY RAND(), improving pagination, leveraging full‑text indexes, and applying join and execution‑plan strategies for faster, more efficient database performance.
This guide shows how to resolve the “MySQL service is starting or stopping” issue on Windows by identifying and force‑killing lingering mysqld processes via admin command prompt, then safely restarting the service and copying database files without errors.
The talk explains how Tencent’s serverless Mini Program Cloud Development platform eliminates the brain, cost, and coordination pains of backend creation by providing native, one‑click cloud functions, a MongoDB‑compatible database, and CDN‑accelerated storage, enabling single engineers to build scalable, reliable Mini Program services quickly and affordably.
This article explains the five Redis data types—String, List, Hash, Set, and Zset—their characteristics, typical use cases, and how to combine them effectively, illustrated with a real‑world hot‑top cache design for a high‑traffic group‑buying system.
This article examines a MySQL data‑update mishap caused by misplaced quotation marks, showing how such syntax errors turn intended string assignments into zero values, and explains the underlying expression evaluation that leads to all rows being updated to 0.
This article explains the mathematical and programming concept of idempotency, provides real‑world examples such as duplicate form submissions and payment requests, and details practical techniques—including query/select operations, unique indexes, token mechanisms, pessimistic and optimistic locks, distributed locks, and API design—to ensure idempotent behavior in backend systems.
MongoDB 4.0 introduces multi‑document ACID transactions with snapshot isolation, supporting replica sets and WiredTiger, and this article explains ACID concepts, outlines limitations, demonstrates session commands, and compares transaction behavior—including conflict detection, repeatable reads, and phantom reads—to MySQL’s implementation.
Tencent Album reached 100 million users by adopting Mini‑Program Cloud Development, using Tencent Cloud Base’s functions, database, and storage to replace a traditional backend, enabling rapid features like lightweight QR codes and a comment/like system in days rather than weeks.
This article outlines MongoDB's key features, describes a real‑world outage caused by misconfigured connection limits, details the root‑cause analysis and temporary remediation, and presents a comprehensive set of configuration, sharding, and hardware optimizations that dramatically improved the system's reliability and throughput.
This guide compares Python MySQL libraries, focuses on using PyMySQL, and provides step‑by‑step instructions with screenshots for installation, importing, connecting, querying, inserting, batch inserting, and updating data in MySQL from Python.
Alibaba’s weekly roundup highlights its re‑election to the Java Global Management Committee, the upcoming open‑source X‑Deep Learning framework, a global mathematics competition, the launch of the DAMO Academy website, massive IPv6 deployment, and two major technical conferences slated for December.
This article introduces SQLiteLint, a runtime analysis tool that automatically checks SQLite usage in mobile apps for index problems, redundant indexes, SELECT *, AUTOINCREMENT, missing prepared statements, and without‑rowid opportunities, enabling developers to catch performance issues before release.
Using the cloud‑development model, the author built a mini‑program that lets users publish posts with optional images, browse a list of posts, view details, and add comments, leveraging cloud functions for CRUD operations, cloud database for storage, and cloud storage for images, while noting the rapid prototyping advantage and the modest 2 GB database and 5 GB storage limits.
This article walks through the complete backend development of a gas purchase‑sale‑stock management system, covering entity and database design, Maven multi‑module project setup, Spring and web.xml configuration, environment‑specific property handling with a portable‑config Maven plugin, and a sample login controller implementation using Java, Spring MVC, and ExtJS.
An Oracle Database developer describes the massive, flag‑laden C codebase, the endless testing cycles, and why even tiny bug fixes can require weeks of work, highlighting the extreme complexity and maintenance challenges of large enterprise databases.
This article explains every Django Model Meta attribute—including abstract, app_label, db_table, db_tablespace, get_latest_by, managed, order_with_respect_to, ordering, permissions, proxy, unique_together, verbose_name, and verbose_name_plural—detailing their purpose, usage, and code examples for precise database and admin control.
This article explains the main factors that cause Redis latency—including network bottlenecks, Redis’s single‑threaded design, deployment choices, OS settings, and slow commands—and provides concrete commands and best‑practice solutions to diagnose and reduce the delay.
When paginating millions of rows in MySQL, avoid large OFFSET scans by using delayed joins or bookmark techniques that first fetch primary‑key values via covering indexes, then retrieve the needed rows, dramatically reducing I/O and query latency.
This article explains how MySQL 8.0 improves the optimizer by introducing configurable cost model constants and a histogram feature, showing how to query and update system tables, use ANALYZE TABLE to create and manage histograms, and explore the underlying code structures and future tuning possibilities.
Over ten years Alibaba's database team transformed from commercial Oracle‑based systems to open‑source AliSQL and finally to the self‑developed X‑DB, introducing distributed middleware, cloud resources, full‑link testing, intelligent optimization and storage‑compute separation to support the massive Double 11 traffic peaks.
This article chronicles Alibaba's decade‑long journey of database innovations—from commercial and open‑source systems to a self‑developed distributed engine—highlighting the technical breakthroughs, performance optimizations, and intelligent features that powered successive Double 11 shopping festivals.
In this talk, Tencent Cloud senior engineer Zou Peng outlines cloud‑native best practices for Redis 4.0 clusters, detailing a smart‑proxy architecture with gossip‑based management, lazy‑scan big‑key handling, automatic fail‑over, the high‑performance CKV engine, and practical guidance on scaling, sharding, monitoring, and cost‑effective high‑availability deployment.
Redis 5 introduces four new sorted‑set commands—ZPOPMAX, ZPOPMIN, BZPOPMAX, and BZPOPMIN—allowing you to pop elements with the highest or lowest scores, optionally in a blocking fashion, with examples demonstrating their syntax, behavior, and usage patterns.
This article explains MySQL's XA distributed transaction mechanism, covering its 2‑phase commit process, the roles of resource and transaction managers, internal vs. external XA, essential SQL syntax, practical code examples, common pitfalls, performance considerations, and reference resources.
This article presents a curated collection of Alibaba Group’s open‑source projects, spanning frontend design systems, Java libraries, database engines, distributed file and messaging systems, as well as tutorials, highlighting each project's purpose, key features, and GitHub repository links for developers seeking robust, production‑grade solutions.
This article explains how to design a high‑throughput payment system using database sharding, Snowflake‑style globally unique order IDs, eventual consistency via message queues, high‑availability architectures, data tiering, and coarse‑fine traffic control to handle massive request spikes.
This tutorial explains why and how to use MySQL window functions, covering their concepts, syntax, various function families, practical examples such as ranking, distribution, lead/lag, first/last, and aggregations within dynamic windows, plus detailed SQL snippets and visual illustrations.
To achieve millisecond‑level counting on billion‑scale data, the Xianyu team replaced slow MySQL count queries with an offline batch that snapshots relational tables and computes totals, then uses KV‑store incremental statistics for online updates, delivering sub‑10 ms responses with near‑100 % success.
This article explains MySQL's index structures, how indexes accelerate queries but slow down writes, the differences between B‑tree and hash indexes, clustered versus non‑clustered indexes, the left‑most prefix rule, and provides a comprehensive overview of MySQL locking mechanisms and best practices.
This article explores PostgreSQL’s NoSQL capabilities by comparing JSON and JSONB data types, demonstrating their storage differences, read/write performance tests on millions of rows, index strategies, and the new full‑text search support for JSON/JSONB introduced in version 10.
This article presents NetEase's extensive use of HBase within its big‑data platform, covering the system’s role, real‑world application scenarios, common RIT issues, HBCK repair methods, and a systematic approach to monitoring and troubleshooting performance problems.
The 2018 Gdevops Global Agile Operations Summit in Beijing gathered experts who shared practical insights on AIOps, DevOps, cloud‑native databases, MongoDB, TiDB on Kubernetes, SQL optimization, and operational best practices, providing a comprehensive snapshot of modern enterprise operations trends.
This article explains the fundamentals of database transactions, the ACID properties, and how they are implemented, then delves into distributed transaction challenges and solutions such as two‑phase and three‑phase commit, XA, Saga patterns, choreography vs. orchestration, and message‑based transaction mechanisms.
This article uses a humorous story of two threads battling over inventory updates to illustrate the principles, advantages, and drawbacks of pessimistic and optimistic locking in distributed systems, helping readers understand when to apply each concurrency control method.
This comprehensive guide walks you through mastering MySQL by covering server configuration choices, storage engine selection, data type recommendations, index strategies, backup methods, logging options, and practical advice on triggers, views, stored procedures, and character set handling, all aimed at boosting performance and avoiding common mistakes.
This tutorial explains how to install Flask‑SQLAlchemy, configure a Flask app to connect to MySQL, define ORM models, perform queries, handle pagination, update records, and execute join queries, providing code examples and best‑practice tips for backend development.
This guide introduces Laravel's Eloquent ORM, explains its core concepts, and provides step‑by‑step code examples for retrieving, querying, and sorting records, helping developers harness the power of object‑relational mapping in PHP applications.
This article analyzes the shortcomings of traditional relational databases in big‑data scenarios and introduces five major NoSQL categories—columnar, key‑value, document, full‑text search, and graph databases—detailing their principles, advantages, disadvantages, common implementations, and appropriate use cases to guide storage technology selection.
Aries, an internally built MySQL incremental log distribution platform, leverages GTID‑based binlog dumping to achieve stable, consistent, and real‑time data synchronization across heterogeneous systems, supporting use cases such as Elasticsearch sync, cache updates, archiving, and live statistics.
This article summarizes the major functional and performance enhancements introduced in MySQL 8.0 InnoDB, including a unified data dictionary, atomic DDL, fast column addition, encryption, improved Memcached plugin, parallel redo log writes, and future roadmap items.
This article explains why distributed locks are essential for maintaining data consistency in distributed systems, outlines their key requirements, and compares three common implementation approaches—database‑based, Redis‑based, and ZooKeeper‑based—complete with code examples and practical considerations.
This article explains how Laravel’s Illuminate Database Query Builder class encapsulates connection, grammar, and result processing components, provides a unified query interface, and is instantiated via the table() method while adhering to interface‑driven design principles for consistent database operations.
This article explains the concept, design considerations, and step‑by‑step implementation of a lightweight database connection pool in Java, covering its core components, thread‑safe management, configuration handling, and a test demonstration of its functionality.
WeChat Mini Program Cloud Development offers a serverless backend—cloud functions, database, and file storage—exclusively for Mini Programs, providing simple login, generous free tiers, and easy JavaScript integration, while developers must handle promises for async calls and supplement its limited permission model with custom logic.
This article compiles the most frequently asked Java interview questions—from basic introductions and multithreading concepts to JVM internals, Spring framework details, middleware, database fundamentals, and Redis—providing a comprehensive study guide for job seekers.
This article introduces WeChat Mini Program Cloud Development, explains its serverless architecture, compares it with PaaS and BaaS solutions, outlines suitable scenarios, highlights advantages such as built‑in login and free storage, warns of common misconceptions, and shares practical tips and a GitHub demo project.
This article explains the fundamentals of database transactions, the ACID properties, and how they are implemented, then delves into distributed transaction challenges and solutions such as two‑phase commit, three‑phase commit, XA, and Saga patterns, highlighting their trade‑offs and practical usage.
This article explains fundamental MySQL concepts including primary, candidate, super and foreign keys, transaction ACID properties, view creation, differences among DROP, DELETE and TRUNCATE, index structures and types, join variations, normalization forms, optimization techniques, replication mechanisms, engine distinctions, and logging formats.
This article examines five common Redis deployment patterns—single instance, master‑slave replication, Sentinel, Cluster, and custom high‑availability solutions—detailing their architectures, advantages, drawbacks, and practical configuration tips to help engineers choose the most suitable setup for their workloads.
On August 4 2018, Didi Open Source and the Open Source Database Forum hosted a salon where five industry experts presented the latest advances in open‑source databases—covering Redis multi‑data‑center deployment, MySQL InnoDB Cluster, streaming‑processing architecture, PostGIS GIS solutions, and Redis 5.0 features—followed by a Q&A, a prize draw, and a showcase of Didi’s growing open‑source portfolio.
Discover a collection of ten practical Eloquent ORM techniques—including increment/decrement shortcuts, conditional method chaining, boot method customizations, advanced relationship queries, and the when() helper—that empower Laravel developers to write cleaner, more efficient database code and avoid common pitfalls.
