This article explains common Redis performance pitfalls—including per‑command network latency, expensive commands like SUNION and KEYS, mass key expiration spikes, and big‑key deletions—and provides practical techniques such as MSET batching, randomizing expirations, and using UNLINK to keep your backend fast.
At the 2024 XCOPS Intelligent Operations Management Annual Meeting in Guangzhou, Vivo’s Deng Song will discuss building a robust database operations platform, addressing availability threats, efficiency levers, 0‑to‑1 development strategies, and considerations of reliability, cost, and data privacy amid emerging AI and large‑model technologies.
This article explains Redis databases, the structure of the keyspace, how to set key expiration, and the various memory reclamation and eviction policies, providing Java developers with the essential knowledge needed for advanced Redis interview questions.
This tutorial walks through creating a Python GUI application using Tkinter to convert long URLs into short ones, installing required libraries, setting up MySQL tables to store mappings, and providing complete example code that handles validation, database interaction, and user interface events.
This article explains the timing of Spring's @Transactional commit relative to lock release, analyzes why committing after unlock can cause overselling, shows how to trace the transaction lifecycle in the source code, and offers practical solutions to ensure atomicity in high‑concurrency scenarios.
This article provides a comprehensive walkthrough of MongoDB's configuration file, detailing system log options, process management, network parameters, security settings, storage engine configurations, slow query profiling, replication, sharding, and mongos parameters, along with explanations of each option and recommended defaults.
When a major operations incident strikes, the safest approach is to prioritize simple, low‑risk actions and accept limited responsibility, as illustrated by real DBA lessons from Oracle RAC failures and a data‑center power‑loss disaster.
A real‑world MySQL case study shows how using INSERT INTO SELECT for large‑scale data migration without proper indexing caused full‑table scans, lock contention, and data loss, highlighting the need for careful query planning and performance testing.
GaussDB provides a fine‑grained resource control solution that lets administrators define CPU, memory, I/O, connection, concurrency, and storage limits at user, session, and statement levels, using resource pools, control groups, and GUC parameters to ensure multi‑tenant isolation, SLA compliance, and optimal cluster utilization.
This article explains how to set up and use Seata's AT mode with Spring Boot, Spring Cloud, and Alibaba components, providing detailed configuration, code examples, database scripts, and testing procedures to achieve reliable distributed transaction management in microservice architectures.
Oracle’s latest release, Database 23ai, upgrades its 23c platform with AI-driven vector search, RAG capabilities, and enhanced JSON and graph querying, positioning the database as a unified, secure, and scalable solution for handling structured, semi‑structured, and unstructured data across cloud and on‑premises environments.
This article outlines eight key reasons why SQL and relational databases remain the dominant data management solution half a century after their invention, covering processing power, proven reliability, community support, simplicity, widespread adoption, open‑source growth, practical query power, and their role alongside NoSQL technologies.
This article analyzes a MySQL 5.7.20 crash that occurs during INSERT operations on BLOB columns with INSERT … ON DUPLICATE syntax, explains the underlying bug in the copy_blob_value function, shows how to reproduce and locate it with gdb, and provides the fix introduced in MySQL 5.7.22.
This guide explains how to answer MySQL accidental deletion interview questions and outlines practical recovery methods—including backup restoration, binlog usage, third‑party tools—and essential preventive practices such as regular backups, transaction handling, and permission management.
This comprehensive tutorial walks you through MongoDB replica set concepts, member roles, primary election, configuration commands, as well as sharding fundamentals, shard key selection, cluster deployment, balancer management, and practical code examples for building a production‑grade database cluster.
This article explains where MySQL stores auto‑increment values, why gaps appear after failed inserts, duplicate‑key errors, rollbacks or batch inserts, and how different innodb_autoinc_lock_mode settings and MySQL 8.0 improvements can mitigate the issue.
This guide compiles essential MySQL interview topics—including definitions, differences from Oracle and SQL Server, index types and usage, B‑tree vs B+‑tree structures, deadlock handling, and view concepts—providing a systematic overview for developers preparing for database interviews.
This article explains Redis Cluster's sharding architecture, demonstrates how to configure multiple Redis nodes on different ports, shows commands for creating and testing the cluster, and illustrates failover behavior, highlighting its scalability and high‑availability advantages over Sentinel mode for large‑scale data workloads.
The article examines why encrypted sensitive fields such as passwords, phone numbers, and bank details need special handling, categorises three families of fuzzy‑search solutions for encrypted data, evaluates their security, performance and storage costs, and recommends a balanced conventional method for production use.
This article provides a comprehensive introduction to Redis, covering its core features, supported data types, common caching use cases in Spring Boot, typical cache‑related problems such as consistency, avalanche, penetration and breakdown, as well as performance reasons, eviction policies, persistence mechanisms, master‑slave replication, and Sentinel high‑availability architecture.
This article reviews the 14-part series on MySQL's transaction module, covering initialization, transaction types, two‑phase commit, binlog handling, savepoints, and full rollback, and provides links to each detailed post, including discussions on BEGIN statements, read‑only transactions, and the internal mechanisms of InnoDB.
This article walks through replacing MyBatis with MyBatis‑Plus in a legacy Java project, demonstrates the LocalDateTime conversion error caused by MySQL‑connector‑java version incompatibility, shows how upgrading the driver resolves the issue, and shares a cautionary tale about unintended bugs after component upgrades.
This article warns developers about several Redis commands—such as KEYS, FLUSHDB/FLUSHALL, SAVE/BGSAVE, and DEBUG SLEEP—that can cause performance degradation, data loss, or security issues in production environments, and encourages careful usage to avoid serious operational risks.
This article provides a step‑by‑step tutorial on installing Flowable‑UI, designing BPMN diagrams, setting up a Spring Boot backend project, configuring the database tables, and using Flowable engine APIs with complete code examples and deployment instructions.
This article explains why using OFFSET and LIMIT for pagination becomes inefficient on large tables, illustrates the performance impact with examples, and proposes a cursor‑based pagination alternative that leverages indexed primary keys to achieve faster, scalable queries.
This article explains the logical execution order of SQL statements—including FROM‑JOIN, WHERE, GROUP BY, HAVING, SELECT, DISTINCT, ORDER BY and LIMIT—illustrates each step with examples and diagrams, and clarifies common misconceptions about clause sequencing.
The article surveys recent AI and tech developments, from Sam Altman's claim that GPT‑6 will become a universal tool and Baidu's new intelligent computing OS, to Peking University and ByteDance's VAR model outperforming diffusion models, plus updates on Boston Dynamics' Atlas robot, Linux kernel Kconfig, AMD Ryzen Pro CPUs, and SQLite 3.45.3.
This article summarizes a Didi second‑round interview covering Redis persistence mechanisms, data structures, memory overflow and leak concepts, thread safety, process vs thread differences, deadlock prevention, TCP/UDP distinctions, and a couple of hand‑written algorithm problems, providing detailed explanations and code examples.
This article explains how to use PHP's mysqli_num_rows function to retrieve the number of rows in a MySQL result set, providing a complete example that connects to the database, executes a SELECT query, checks for errors, obtains the row count, and displays it.
This article explains how MySQL 8.0.32 rolls back a transaction by first attempting a binlog rollback (which does nothing for a plain ROLLBACK), then performing InnoDB undo‑log processing, committing the internal InnoDB changes, and finally clearing temporary binlog data from the transaction cache.
WCDB 2 introduces multi-language support (C++, Java, Kotlin), a rewritten SQL builder, fast backup and recovery with sub‑second times, incremental WAL‑based backup, automatic data migration, Zstandard compression, on‑the‑fly column addition, and performance enhancements such as an FTS5 optimizer and interruptible transactions, delivering a robust high‑performance mobile database solution.
This article explains MySQL events as built‑in schedulers, outlines their advantages, shows how to enable the event scheduler, create, view, modify, and drop events, and provides concrete examples for generating real‑time sales data and periodic statistics.
This article provides an in‑depth overview of MySQL string functions, covering concatenation, length, position, replacement, conversion, encryption, comparison, generation, and their syntax and usage examples, helping developers manipulate textual data efficiently in database operations.
This article introduces various Python-based data backup techniques, covering standard library modules such as shutil, zipfile, and tarfile, as well as database dump tools like pg_dump and mysqldump, and cloud storage options using awscli or boto3, with example code snippets for each method.
This article explains MySQL InnoDB full-text search, covering inverted index structures, creation and usage of full-text indexes, query modes such as natural language, boolean, and query expansion, and provides practical SQL examples and considerations for effective text searching.
This article explains Redis Sentinel’s role in providing monitoring, notifications, automatic failover, and configuration updates to achieve high availability, detailing its heartbeat mechanism, master‑down detection, leader election, failover selection criteria, and the trade‑offs of using this solution.
This article traces PostgreSQL’s evolution from an academic project to a versatile data‑management framework, highlights its extensive extensions, performance benchmarks, and the shifting landscape of OLTP/OLAP, showing how its open‑source extensibility is reshaping the entire database world.
When a user reported errors, I discovered a MySQL table flooded with millions of bad rows from a new group, causing slow queries and crashes; I detail the step‑by‑step investigation, failed attempts with DELETE and lock‑free changes, and the final successful rebuild using temporary tables, DROP, TRUNCATE, and index reconstruction.
This article explores eight common MySQL performance pitfalls—from inefficient LIMIT usage and implicit type conversion to subquery joins, mixed ordering, EXISTS clauses, condition pushdown, early result limiting, and intermediate result set optimization—offering concrete rewrites and execution plan analyses to dramatically speed up queries.
The article shows how to efficiently load 300,000 MySQL rows in Java by comparing MyBatis and plain-JDBC batch inserts, demonstrating that batching 1,000‑5,000 records per transaction with proper transaction control, connection pooling, and MySQL tuning reduces insertion time from hours to seconds.
This article presents a series of MySQL performance‑enhancing techniques—including smarter LIMIT usage, avoiding implicit type conversion, rewriting UPDATE/DELETE with JOINs, mixed‑order sorting tricks, replacing EXISTS with JOINs, condition push‑down, early result limiting, and intermediate result push‑down—to dramatically reduce query execution time.
This article explains ten advanced SQL techniques—including common table expressions, recursive CTEs, temporary functions, CASE‑WHEN pivots, EXCEPT vs NOT IN, self‑joins, ranking functions, delta calculations, cumulative sums, and date‑time manipulation—providing clear explanations and complete query examples to help readers ace data‑science interview questions.
This tutorial walks through connecting to an SQLite database with PHP, creating a 'users' table using SQL, and verifying the table’s structure through PRAGMA queries, providing complete code examples for each step to help developers understand SQLite integration in web projects.
This article explains Redis's three persistence mechanisms—RDB snapshots, AOF append‑only logs, and their hybrid mode—detailing trigger conditions, configuration options, advantages, disadvantages, and practical guidance for selecting the appropriate method in production environments.
The article examines Redis's shift to a source‑available license, traces its history, analyzes the impact on cloud providers and open‑source communities, and evaluates emerging forks and alternatives such as Valkey, KeyDB, and Redict as potential replacements.
The Linux Foundation announced Valkey, a BSD‑licensed open‑source fork of Redis that continues development on Redis 7.2.4, gains backing from major cloud providers, and outlines a roadmap featuring enhanced clustering, multithreading, new commands, and vector search support.
This guide explains how to install Docker, pull the official MySQL image, run a MySQL container with persistent storage, connect to it, perform basic SQL operations, and finally stop and remove the container, demonstrating a complete end‑to‑end deployment using Docker.
This article examines a MySQL slow‑query incident caused by the optimizer using the primary clustered index instead of an appropriate secondary index, explains the underlying index structures, and presents solutions such as FORCE INDEX and migrating complex queries to Elasticsearch for long‑term performance improvement.
When Redis memory reaches its configured maxmemory limit, it triggers a set of eviction policies—such as noeviction, allkeys‑lru, volatile‑lfu, and others—to decide which keys to discard, and this article explains how to view, configure, and understand each strategy.
This article presents nine practical Python automation scenarios—including file management, web scraping, text processing, email handling, Excel manipulation, database interaction, social media posting, system task scheduling, and image editing—each accompanied by clear script examples and explanations to help readers streamline repetitive tasks efficiently.
This article explains the MySQL 8.0.22 READ ONLY option for individual databases, demonstrates how to enable and verify the read‑only state with ALTER DATABASE and SHOW CREATE DATABASE commands, shows the impact on DDL/DML operations, lists usage restrictions, and notes exceptional cases and backup considerations.
This course provides a comprehensive tutorial on configuring PHP environments and mastering the ThinkPHP 8.x framework, covering installation, coding standards, routing, controllers, database operations, model management, middleware, caching, validation, and deployment techniques for robust backend web development.
Redis announced it will replace its BSD‑3‑Clause license with a source‑available dual licensing model—SSPLv1 and RSALv2—starting with Redis 7.4, keeping the community edition free for developers while requiring cloud providers to secure commercial agreements, yet leaving existing enterprise users and client‑library developers under unchanged, permissive terms.
This guide walks you through installing the Go SQLite3 driver, opening a database connection, creating tables, inserting records, querying data, and provides a complete runnable example, helping developers integrate lightweight SQLite storage into Go applications efficiently.
This article provides a detailed tutorial on the PyMySQL library, covering installation, connection setup, cursor operations, executing queries, transaction handling, advanced features like batch processing and connection pooling, as well as best practices for error handling and performance optimization in Python‑MySQL applications.
The Apache Doris 2.1.0 release introduces over 100% query performance improvements on TPC‑DS, up to 230% gains on ARM platforms, new Variant and IP data types, async materialized views, auto‑increment columns, auto‑partitioning, group commit, hardened workload groups, TopSQL monitoring, a built‑in job scheduler, and several behavior changes, all aimed at delivering faster, more flexible and more reliable OLAP processing.
This article explains why using IN and NOT IN in SQL can lead to poor performance and incorrect results, demonstrates common pitfalls with examples, and shows how to replace them with EXISTS, NOT EXISTS, or JOIN constructs for reliable and faster queries.
The article examines how shifting industry trends, cloud adoption, and the rise of domestic databases force Oracle DBAs to choose between staying the course, expanding their skill set, or pivoting entirely, offering practical guidance for each path.
This article dissects Redis's memory architecture, explains each memory component, walks through object encoding rules, buffer handling, fragmentation, and child‑process memory, then presents two production incidents with step‑by‑step analysis and concrete optimization actions to prevent future memory alarms.
This article explains why the SQL keywords IN and NOT IN often lead to poor performance and subtle bugs, demonstrates real‑world examples with large tables and NULL values, and recommends using EXISTS, NOT EXISTS, or JOINs as more reliable alternatives.
This article explains how to construct effective SQL prompts by combining personal SQL expertise with large language model capabilities, introduces the open‑source sql‑translator tool for bidirectional SQL‑natural language conversion, and discusses practical productization scenarios.
This article analyzes a MySQL replica that repeatedly ran out of memory due to large triggers and a high table_open_cache_instances setting, demonstrates how to reproduce the issue with test scripts, and provides a practical fix by reducing the parameter to mitigate OOM.
This weekly newsletter from the Aikexing open‑source community shares the latest SQLE product releases, summaries of recent MySQL and OceanBase technical articles, a curated selection of database‑related reads, and upcoming community events and activities for developers and enthusiasts.
This article explains why MySQL uses locks, categorizes lock types from global to row level, details their implementation and commands, and shows how intention, metadata, and auto‑increment locks work while offering strategies to prevent deadlocks and lock contention.
This course introduces MySQL 8's latest features, deep dives into its network communication mechanisms, and teaches advanced performance optimization techniques such as connection pooling, compression, and SSL encryption through hands‑on projects to enhance database efficiency and security.
This article explains what a distributed ID is, outlines its essential requirements such as global uniqueness, high performance, high availability, and ease of use, and then reviews common generation strategies—including database auto‑increment, segment mode, NoSQL approaches, UUID, Snowflake, and several open‑source frameworks—providing code examples and practical trade‑offs.
This article walks through a MySQL 5.6 scenario with course, student, and score tables, demonstrates why a naïve sub‑query is extremely slow, and shows step‑by‑step how adding single‑column, composite, and covering indexes, as well as rewriting the query to joins, can reduce execution time from hours to milliseconds.
This tutorial explains how to build essential logistics tracking and delivery management features for an e‑commerce system using PHP, covering database schema design, code for inserting, updating, and querying tracking and delivery records, and providing complete example snippets.
This article recounts how a production database deadlock was uncovered during testing, explains the use of the EasyBI monitoring tool to collect and visualize error and claim statistics, and shares the step‑by‑step configuration, analysis, and lessons learned for preventing similar issues in future systems.
This article provides an overview of China’s Xinchuang (information technology innovation) ecosystem, explaining the concepts and classifications of operating systems, middleware, databases, and firmware, presenting market share statistics, and highlighting the key components that shape the industry’s autonomous and secure IT landscape.
This article explains the fundamentals of Dependency Injection, its three injection methods, practical application scenarios, advantages and challenges, and demonstrates how Go's database/sql package leverages DI with clear code examples for building flexible, testable backend systems.
This article explains MySQL 8.3’s new ability to tag GTIDs, describes the original and extended GTID formats, demonstrates how to enable and use tagged GTIDs with mysql-shell, and shows how tagged and non-tagged transactions appear in replication logs.
This article explains how InnoDB stores data pages and builds B+‑tree indexes, illustrates the structure of clustered, secondary and composite indexes, and enumerates typical scenarios—such as left‑most prefix violations, LIKE patterns, and function use—that cause index loss and full‑table scans.
This guide explains Vanna, an open‑source Python RAG framework for Text2SQL, covering its core concepts, RAG‑based architecture, step‑by‑step model training, code examples for customization, and how to deploy a conversational database chatbot with a Flask web UI.
This article explains Redis high‑availability through master‑slave replication, covering the architecture, read‑write separation benefits, the three‑stage initial sync process, incremental synchronization, and practical considerations for scaling and fault tolerance in production environments.
This guide shows how to install ThinkORM for PHP 8, then demonstrates inserting, querying, and updating JSON‑type columns both with raw queries and model classes, covering whole‑JSON operations, conditional searches, and handling JSON arrays in a ThinkPHP environment.
This article provides a comprehensive guide to using PyMySQL in Python, covering installation, connection setup, CRUD operations, transaction handling, advanced features like parameterized queries and connection pooling, as well as best practices for security, performance, and monitoring.
This article explains why using OFFSET and LIMIT for pagination becomes a performance bottleneck on massive tables, illustrates the cost of full‑table scans, and introduces a cursor‑based pagination technique that leverages primary‑key ordering for efficient data retrieval.
MongoDB’s locking system uses a hierarchical resource model with four lock modes, RAII‑style acquisition classes, ticket‑based throttling, and a bucketed lock manager that employs bit‑mask conflict checks and priority flags to grant exclusive locks promptly and prevent starvation.
This article walks readers through building a complete vaccine management desktop application using Python's Tkinter for the graphical interface and MySQL for data storage, covering UI design, database connection, user registration, login, CRUD operations for vaccine records, and query functionalities, all illustrated with full source code examples.
Linear, the SaaS project‑management tool, suffered a catastrophic data loss when a TRUNCATE CASCADE command unintentionally wiped production tables, prompting a detailed post‑mortem that outlines the timeline, root cause, recovery steps, impact, and a set of concrete preventive measures.
This article explains how to select appropriate sharding keys based on business requirements and data access patterns, describes vertical and horizontal partitioning methods, and presents common techniques such as equal‑value, index, and gene methods along with key generation strategies like auto‑increment, UUID, Snowflake algorithm, and open‑source middleware.
This article explains how to use PHP's mysqli_query function to perform MySQL operations such as SELECT, INSERT, UPDATE, and DELETE, providing a step‑by‑step example that creates a connection, runs a SELECT query, processes results, and handles errors and cleanup.
This article explains MySQL deadlocks, describing how they occur in InnoDB due to resource contention, outlines common causes such as race conditions, poor indexing, long transactions, lock upgrades, and provides practical prevention strategies including deadlock detection, short transactions, query optimization, lock timeouts, monitoring tools, lock ordering, and appropriate lock levels.
This article explains why using OFFSET and LIMIT for pagination on large tables leads to costly full‑table scans and poor performance, and introduces keyset (cursor) pagination as a faster, index‑driven alternative while discussing its requirements and trade‑offs.
This article summarizes essential MySQL concepts—including basic terminology, data types, SQL commands, indexes, views, storage engines, backup methods, and performance tuning techniques—to help developers understand and effectively apply this powerful open‑source relational database in real‑world projects.
This article demonstrates how to use Spring Data R2DBC with Spring Boot 3 to perform reactive 1‑to‑1 and 1‑to‑many database operations, covering environment setup, entity definitions, repository queries, custom converters, and unit testing for full‑stack backend development.
This article explains how to locate, trace, and resolve a syntax error that occurs when a stored procedure migrated from Oracle to OceanBase fails, detailing the use of trace IDs, SQL reconstruction, cursor analysis, and the necessary adjustments to primary‑key handling.
This article introduces Python's DB-API for database interaction, lists supported databases, demonstrates basic MySQL operations with PyMySQL and SQLAlchemy, explains preventing SQL injection, and shows how to implement connection pooling using DBUtils with examples of threaded usage and utility functions.
This article explains the concept of MySQL connection pools in PHP, demonstrates how to create, use, and correctly close both individual connections and pooled connections using mysqli functions and a custom pool class, and highlights the importance of releasing resources to maintain application performance.
This article outlines the step‑by‑step process for implementing a product promotion push feature in a PHP‑based e‑commerce platform, covering target user identification, promotion table design, message templating, script development, database queries, cron scheduling, and result monitoring to boost user engagement and sales.
This article introduces KeyDB, a high‑performance multithreaded fork of Redis, explaining its architecture, thread model, connection management, fastlock mechanism, and active‑replica features, while providing code examples and performance comparisons, and highlighting their impact on throughput and latency.
This guide explains Redis's three clustering modes—master‑slave, Sentinel, and Cluster—detailing their architectures, failover mechanisms, PSYNC replication, configuration files, Spring Boot integration, and step‑by‑step testing to achieve high availability and scalability.
Oracle announced preview support for JavaScript‑based stored procedures in MySQL, showing how to write, call, and debug them using GraalVM, while industry reactions highlight both excitement and concerns about mixing languages in database logic.
This article outlines a step‑by‑step guide for building a PHP‑based product promotion push system for e‑commerce platforms, covering recipient identification, database schema design, message templating, script development, scheduling with crontab, and result monitoring to boost user engagement and sales.
This article explains how MySQL InnoDB handles update, delete, and select statements within read and read‑only transactions, detailing when a read transaction becomes read‑write, the allocation of transaction IDs, rollback segments, and the role of lock types for ordinary and temporary tables.
This tutorial explains how to use PyCharm’s integrated database tool to create, configure, test, and manage a MySQL connection, including driver installation, schema selection, SQL execution, and removal of connections, with detailed visual instructions.
This article experimentally compares the efficiency of using IN clauses versus JOIN operations in MySQL by testing small, medium, and large datasets, measuring query costs, execution times, and highlighting the scalability limits of IN statements.
This guide explains MySQL’s most useful date and time functions—including CURDATE(), NOW(), DATE_FORMAT(), DATEDIFF(), DATE_ADD(), DATE_SUB(), and DATE()—with clear syntax examples and sample results, helping developers manipulate temporal data efficiently in their databases.
The article reflects on the rise and fall of Lotus Notes, illustrating how this once‑dominant email, database, and workflow platform once unified company operations, why it was eventually eclipsed by web‑based apps and Microsoft tools, and what its lingering legacy reveals about technology evolution.
