MySQL 8.3 introduces a new iterator‑aware JSON output for EXPLAIN and EXPLAIN ANALYZE, selectable via the explain_json_format_version variable, which aligns JSON with the tree format, provides richer execution statistics, and can be accessed programmatically through EXPLAIN INTO across all recent MySQL releases.
The NineData presentation at the 2024 GOPS Global Operations Conference in Shanghai detailed multi‑cloud, multi‑source database architecture trends, showcased their intelligent data management platform, explained data replication principles, DevOps challenges and AI‑enhanced solutions, and highlighted real‑world customer success stories across industries.
At the 2024 Baidu Cloud Summit, the speaker detailed recent breakthroughs across Baidu’s cloud‑native database suite—including PegaDB KV, GaiaDB relational, VDB vector, and the integrated DBSC, EDAP, and DBStack platforms—highlighting performance, cost, scalability, and AI‑ready features that address enterprise data challenges.
The article reports on the 33rd ISSTA 2024 conference in Vienna, summarizing its acceptance statistics, highlighting the Impact Paper Award and Distinguished Papers, detailing keynotes on large‑language‑model‑driven software quality, and providing extensive reviews of selected research works ranging from fuzzing and program repair to database query simplification and AI‑oriented code generation.
This article explains when to use NOT NULL versus NULL in relational database schemas, covering required fields, optional columns, unknown‑state representation, foreign keys, performance impact, versioning, data analysis, migration, default values and JSON types, with concrete SQL examples and practical guidance.
This article explains how InnoDB’s buffer pool works, covering its purpose, configuration parameters, internal structures such as free, flush, and LRU lists, multi‑instance handling, adaptive hash indexing, and strategies for page eviction and performance optimization.
This article compares ClickHouse and MySQL by examining benchmark results, MPP architecture, columnar storage, compression techniques, vectorized execution, and index designs, showing why ClickHouse delivers dramatically higher query performance on massive data sets.
The DataFun Summit page presents a collection of technical papers covering graph database parallel queries, next‑generation vector databases, real‑time data warehouse architectures, and best practices in finance and e‑commerce, while also providing instructions for obtaining the e‑book via a public account.
Oracle’s 2024 global user survey uncovers preferred databases, key factors for database selection, the advantages of Oracle Cloud Infrastructure, and emerging AI use cases, providing a comprehensive view of current enterprise priorities and future expectations in data management and cloud services.
The 2024 Inclusion·Bund Conference forum brought together leading academics and industry experts to examine how data value is shifting in the AI era, covering large‑model storage challenges, the rise of synthetic data, AI‑enhanced databases, and Ant Group’s next‑generation intelligent data architecture.
This article explains how to track online users using Redis sorted sets by describing the core ZSET commands (zadd, zrangeByScore, zremrangeByScore, zrem), showing code examples for adding, querying, and cleaning up user sessions, and discussing fingerprint-based identification methods.
The 2022 JetBrains Python Developer Survey, conducted with over 23,000 respondents from more than 200 countries, reveals that 93% now use Python 3 (with Python 3.10 most popular), 7% still use Python 2, and highlights trends in frameworks, databases, big‑data tools, IDEs, operating systems, documentation tools, and primary usage contexts.
This article examines various methods for synchronizing MySQL data with Elasticsearch, including synchronous and asynchronous dual‑write, Logstash pipelines, binlog real‑time replication, Canal, and Alibaba Cloud DTS, comparing their architectures, advantages, disadvantages, and suitable application scenarios.
This guide outlines comprehensive best practices for database server operations, covering hardware selection, OS and kernel tuning, storage choices, MySQL configuration, performance monitoring, backup strategies, security measures, high availability, automation, and systematic maintenance procedures to ensure optimal reliability and efficiency.
This article traces the evolution of databases from early theoretical research through commercial, open‑source, and cloud eras, highlights China's rapid rise in the field, and explains why databases remain the indispensable foundation of modern software.
The author reflects on a decade‑plus journey through China’s DTCC database conferences, describing personal growth from novice to speaker and organizer, sharing insights on Redis Cluster, distributed database selection, openGauss, time‑series databases, and the evolving themes that chart the industry's progress.
This article compiles over a thousand common C/C++ interview questions spanning language fundamentals, data structures, algorithms, system programming, networking, databases, design patterns, RPC, and audio‑video development, providing a thorough study guide for backend and systems engineers.
This article surveys two decades of database system architecture innovations—including columnar stores, cloud databases, data lakes, NewSQL, hardware accelerators, and blockchain databases—highlighting their motivations, trade‑offs, and the shifting landscape that shapes modern DBMS design.
This technical report details the background, architecture, construction, core issues, migration plans, and future roadmap of moving 58's HBase clusters to a cloud‑native environment, highlighting cost reduction, operational automation, and performance optimizations.
Based on responses from over 65,000 developers across 185 countries, the 2024 Stack Overflow Survey highlights the most popular programming languages, databases, frameworks, IDEs, AI tool usage, and salary trends, revealing regional participation, education backgrounds, and emerging preferences such as Rust and Erlang.
This article explains what NewSQL databases are, outlines their core characteristics, reviews major products such as Spanner, CockroachDB, TiDB, OceanBase and TDSQL, and discusses typical use cases ranging from financial services to HTAP workloads.
Explore nine major database technologies—from traditional relational MySQL to NoSQL Redis, columnar HBase and ClickHouse, document-oriented MongoDB, search engine Elasticsearch, graph Neo4j, time‑series Prometheus, and vector Milvus—plus practical best‑practice guides, real‑world polyglot persistence scenarios, and recommended resources for mastering modern data storage.
This article provides an in‑depth overview of nine major database categories—including relational, key‑value, columnar, document, graph, time‑series, and vector databases—detailing their strengths, weaknesses, best practices, and typical application scenarios, and explains how polyglot persistence combines multiple databases for optimal performance and scalability.
The article explains the Log-Structured Merge-Tree (LSM) architecture, its core components, advantages and disadvantages, and demonstrates how it is employed in big‑data platforms such as HBase and Apache Druid to achieve high‑throughput writes and scalable query processing.
This article explains how Redis handles memory exhaustion by configuring maxmemory and maxmemory-policy, detailing each eviction strategy (noeviction, volatile‑lru, volatile‑lfu, volatile‑ttl, volatile‑random, allkeys‑lru, allkeys‑lfu, allkeys‑random), their implementation details, and the underlying approximate LRU algorithm.
This article presents a detailed syllabus covering advanced programming techniques, database optimization, essential project knowledge, and in‑depth tutorials on backend frameworks such as Flask and Django, outlining over 70 lecture topics ranging from class fundamentals to deployment, security, and full‑stack project implementation.
The article explains how Redis achieves high QPS by using an in‑memory, single‑threaded event loop for simple commands, leverages I/O multiplexing (epoll/select/kqueue) and optional multi‑threaded I/O for heavy operations, and outlines its evolution from a pure reactor model to a hybrid multi‑threaded architecture.
Despite powering billions of devices, critical components like the TZ time‑zone database and SQLite are maintained by just a handful of volunteers, and the article reveals how this fragile reliance could cause massive disruptions if those small teams were to disappear.
This article shares a practical case study on how a coupon‑distribution system evolved from a single‑table design to a sharded, multi‑database architecture with query optimization, ElasticSearch integration, and read/write splitting to handle growing data volume, complex queries, and increasing request traffic.
The article defines large database transactions, explains their performance and replication risks, offers practical guidelines to avoid them, demonstrates a MySQL example that creates and repeatedly inserts data to illustrate growing execution time, and discusses challenges and solutions for handling massive tables in high‑traffic environments.
Redis announces a dual‑license model (RSALv2 and SSPL) starting with version 7.4, sparking community backlash, prompting concerns about open‑source status, potential distro removals, and driving users toward alternative in‑memory databases and possible forks.
This article explains how Go’s standard database/sql package uses a driver registration mechanism to integrate third‑party MySQL drivers, detailing the global driver map, registration function, init process, and a complete example showing how to define, register, and use a custom MySQL driver.
This article explains what cloud‑native databases are, outlines their key characteristics such as containerization, microservice architecture, elastic scaling, and automation, lists major cloud‑native database offerings, and describes common application scenarios for modern cloud environments.
Redis announced that starting with version 7.4 it will adopt a dual‑source licensing model (RSALv2 and SSPL), moving away from its permissive BSD‑3 license, sparking widespread community backlash, discussions about cloud provider restrictions, and prompting users to consider alternative databases or forks.
Donald Chamberlin, co‑author of SQL, explains why he now supports the NoSQL movement, describing how modern web applications demand scalability that traditional relational databases struggle to provide, and discusses emerging query languages like SQL++ (PartiQL) that bridge the gap between relational and document models.
The 2022 JetBrains Python Developer Survey, conducted with over 23,000 respondents from more than 200 countries, reveals that 93% now use Python 3, highlights the dominance of Flask, Django and FastAPI in web development, shows growing adoption of big‑data tools, and details IDE, OS, and documentation preferences among Python developers.
Redis 7.4 will be released under a dual‑license model (RSALv2 and SSPLv1), ending its long‑standing BSD‑3 clause terms, sparking controversy among open‑source communities, cloud providers, and users while prompting discussions of alternatives like KeyDB, Garnet, and Dragonfly.
The talk explores how the rapid growth of multimodal data and large language models is reshaping data processing, highlighting three key trends—online‑offline integration, vector‑relational database convergence, and the fusion of data processing with AI computation—while presenting practical solutions and future visions for unified data‑AI ecosystems.
The article examines why many organizations avoid upgrading databases despite end‑of‑life warnings, highlighting cultural resistance, skill gaps, security and performance risks, and offers practical strategies for planning and executing safe database upgrades.
The article examines how AI, global competition, remote work, and cross‑cultural demands reshape programmers' careers, highlights the rise of independent developers, and provides a concise reference of essential development tools spanning editors, build systems, testing frameworks, debugging utilities, version control, and database management.
This article explores sixteen practical Redis patterns—including caching, distributed sessions, locks, global IDs, counters, rate limiting, bitmaps, shopping carts, timelines, message queues, lotteries, likes, tags, filtering, follow relationships, and ranking—demonstrating how each can boost performance and simplify backend architecture.
The Linux Foundation is backing Valkey, a BSD‑licensed fork of Redis, to preserve an open‑source, community‑driven in‑memory NoSQL database after Redis shifted to stricter RSALv2 and SSPLv1 licenses, drawing support from major cloud providers and sparking debate among industry leaders.
According to the 2023 Stack Overflow Developer Survey of over 90,000 respondents, JavaScript remains the top language, Python overtakes SQL, PostgreSQL surpasses MySQL as the leading database, Node.js and React dominate web technologies, and AI tools like ChatGPT are widely adopted, with insights on salaries and usage trends.
Redis announced that starting with version 7.4 it will abandon the BSD 3‑Clause license in favor of a dual SSPLv1/RSALv2 model, making the source code source‑available while keeping the community edition free, and clarifying the impact on cloud providers, partners, and end‑users.
Redis officially announced that starting with version 7.4 it will abandon the BSD 3‑Clause license and adopt a dual SSPLv1/RSALv2 source‑available model, while keeping the community edition free for developers and assuring no changes for existing users or client libraries.
This article explains what a technology stack is, why choosing the right combination of front‑end, back‑end, database, cloud and deployment tools is crucial for performance, user experience and brand perception, and reviews the most popular web development stacks for 2024.
The article argues that focusing solely on benchmark speed misleads database choice, emphasizing that true performance must be measured by end‑to‑end user experience, ecosystem, maintainability, and future evolution rather than raw query latency alone.
This article offers a comprehensive guide for students aiming to secure test development internships at major tech companies, covering interview strategies, sample questions on testing concepts, database CRUD commands, MySQL vs Redis differences, HTTP/HTTPS, TCP reliability, Linux commands, data structures, and code examples for linked‑list deletion and binary search.
The article reviews the rapid emergence of high‑performance domestic databases such as OceanBase, TiDB, MaxCompute and TDEngine, outlines their development history, compares strengths and weaknesses, discusses suitable scenarios for TiDB, and forecasts future trends for China’s database ecosystem, while providing a curated list of further readings.
The article presents a cloud‑native distributed Data Warebase that unifies relational, NoSQL, search and analytical capabilities into a single horizontally‑scalable system, reducing data‑access barriers and improving developer productivity while addressing consistency, latency, cost and operational complexity.
This article explains MySQL 8.0.32 InnoDB's two‑phase commit process, detailing the flush, sync, and commit sub‑stages, the concept of group commit, and how queues and mutexes coordinate transaction logging to reduce redundant disk writes.
This article explains MySQL master‑slave replication, covering its three modes (asynchronous, semi‑synchronous, and fully synchronous), the underlying binary‑log mechanism, key replication threads, configuration steps, and includes a promotional notice for an upcoming live career‑development session.
After a weekend support ticket led to a reckless UPDATE that erased all orders in a production PostgreSQL database, the author details the rapid recovery steps, analyzes the human errors behind the disaster, draws lessons from Chernobyl, and outlines concrete post‑mortem improvements to prevent future data loss.
This guide explains how to design a high‑concurrency, high‑throughput internet architecture that ensures database high availability with double‑master sync and virtual IPs, and how to horizontally shard and smoothly expand the cluster in seconds using configuration changes, reloads, and cleanup steps.
This article provides a comprehensive overview of distributed architecture, covering its definition, core benefits such as performance, availability, scalability, and fault tolerance, and detailing major categories like microservices, distributed databases, storage systems, computing, communication, load balancing, security, and transactions.
This article walks through the step‑by‑step process of turning a single‑server prototype into a highly available, horizontally‑scaled system that can serve over a million users, covering server configuration, database selection, load balancing, caching, CDN, stateless networking, multi‑data‑center deployment, message queues, monitoring, and sharding strategies.
This article explains the Log-Structured Merge Tree (LSM-Tree) architecture, describing its immutable storage design, the roles of WAL, MemTable, ImmuTable, and SSTable, and detailing the write workflow, compaction process, and the associated read, space, and write amplification challenges.
The global database market is accelerating beyond $1 trillion, driven by cloud adoption, AI workloads, and the rise of vector and NoSQL databases, while traditional relational vendors slow, creating a unique growth dynamic for enterprises seeking the right data solutions.
This article explains why Redis traditionally operates with a single thread, how its memory‑centric design, simple data structures and I/O multiplexing keep it fast, and why newer Redis versions introduced multithreading for network I/O and lazy deletion of large keys.
The 2023 Chinese government database procurement standard defines unified requirements for government agencies, covering scope, procurement principles, mandatory indicators, response and acceptance forms, and detailed technical criteria for centralized and distributed databases, offering clear guidance for vendors on functional, reliability, security, compatibility, service, and safety expectations.
This article presents a detailed technical case study on expanding and optimizing a system's storage capacity, covering business background, current architecture, implementation plans, technology selection, data synchronization strategies, phased rollout steps, results, and remaining challenges, with concrete metrics and diagrams.
Celebrating Michael Stonebraker’s 80th birthday, this article chronicles his pioneering work from Ingres to PostgreSQL, his influence on open‑source databases, the rise of cloud‑compatible DBMS, and his bold vision of a database‑centric operating system reshaping the future of data management.
This article explains how to use MySQL's EXPLAIN statement to view execution plans, demonstrates creating sample order and customer tables, walks through each column of the EXPLAIN output, and shows how indexes affect query performance, providing a practical reference for database optimization.
This article details how Zyb’s multi‑cloud database platform integrates diverse database types, a unified proxy layer, intelligent lifecycle management, automated task orchestration, monitoring, resource allocation, backup, and fault‑handling to achieve efficient, reliable, and secure database operations across cloud environments.
This guide introduces RedisSearch, walks through installation, explains its rich feature set, details core concepts like data models and indexing, shows command‑line operations for creating indexes and querying, and provides a complete PHP example for integrating RedisSearch into applications.
The article examines the rapid growth of domestic databases in China’s banking sector, identifies eight critical pain points—from product stability and resource consumption to tooling gaps and migration difficulties—and offers detailed countermeasures covering version upgrade planning, resource optimization, functional testing, skill development, monitoring, ecosystem building, data migration, and backup‑recovery improvements.
This article explains the fundamentals of MySQL master‑slave replication, identifies why replication lag occurs—including single‑threaded processing, lock contention, network issues, and outdated versions—and offers concrete strategies such as hardware upgrades, configuration tweaks, and architectural changes to minimize the delay.
This article walks through a step‑by‑step investigation of why a MySQL 8.0 instance cannot be accessed remotely after adding configuration variables, identifies the skip_networking setting as the root cause, and explains how to correct the configuration for proper TCP/IP connections.
The interview with Wu Li, a research engineer at Shanghai Yanhuang Data, explores how columnar storage, JIT compilation, and push-mode processing are reshaping modern database performance, highlighting hardware constraints, software optimizations, and product‑centric goals in the era of big data analytics.
In this technical interview, Wu Li, a research engineer at Shanghai Yanhuang Data, explains how hardware constraints drive database evolution, why columnar storage and SIMD acceleration are crucial for OLAP, and how JIT compilation and push‑mode processing improve query performance and product experience.
The article presents an interview with Wu Li, a senior R&D engineer at Shanghai Yanhuang Data, discussing how columnar storage, JIT compilation, and push‑mode execution are reshaping database performance in the era of big‑data analytics and evolving hardware constraints.
The article presents an interview with Wu Li, a senior engineer at Shanghai Yanhuang Data, discussing how columnar storage, JIT compilation, and push‑mode processing are reshaping database performance and product strategy in the era of large‑scale data analytics.
Transaction isolation prevents concurrency issues such as dirty writes, dirty reads, non‑repeatable reads, and phantom reads in MySQL, and the article explains these problems, the ACID properties of transactions, and the four isolation levels—read uncommitted, read committed, repeatable read, and serializable.
This article presents a comprehensive backend design for an Instagram‑like service, covering functional and non‑functional requirements, data models, storage choices, top‑level and detailed component designs, timeline generation methods, and an evaluation of scalability, latency, availability, persistence, consistency, and reliability.
This article explains why time‑series databases are ideal for massive telemetry data, describes the high‑cardinality problem that degrades performance, and shows how openGemini’s newly introduced columnar engine—combined with sorting and clustering indexes—effectively mitigates those issues while delivering impressive write and query speeds.
This comprehensive guide covers essential programming fundamentals—including Python memory management, metaclasses, decorators, multithreading, data structures, algorithmic techniques, database concepts such as ACID, indexing, and transaction isolation, Redis operations, Linux memory handling, networking protocols, Docker/Kubernetes commands, and core testing methodologies—providing clear explanations and practical code examples.
This article explains how Redis evolved from a simple cache to a high‑performance distributed data store, covering its architecture, persistence models, scalability, high‑availability features, complex data structures, and the trade‑offs of using it as a primary database versus a traditional relational system.
This article explains what MySQL master‑slave replication lag is, walks through the replication workflow, identifies the main technical reasons for delay such as single‑threaded replay and lock contention, and provides concrete configuration and architectural solutions to reduce or eliminate the lag.
This document outlines the business scope, value, overall and real‑time data layer architecture, design advantages, data model, extensibility, and future challenges of the order system, emphasizing decoupling, high availability, scalability, and cost control.
This article explains why Redis, despite being described as single‑threaded, achieves extremely high performance by using a single thread for network I/O and command execution, avoiding multithreading overhead, and leveraging efficient in‑memory data structures together with an event‑driven multiplexing I/O model.
This guide explains why case‑sensitivity issues arise in databases, how naming conventions can prevent them, and compares the behavior of Snowflake, Databend, MySQL, and PostgreSQL for database, table, column names and string literals, complete with practical examples and a concise checklist.
The 2022 JetBrains Python Developer Survey of over 23,000 respondents reveals that 93% now use Python 3, highlights the dominance of Flask, Django and FastAPI, shows growing adoption of big‑data tools and databases, and details IDE, OS, and documentation preferences among Python developers.
PHP remains a resilient, versatile server‑side language whose active community, regular updates, strong security, seamless database integration, and efficient server‑side scripting deliver fast, dynamic, and interactive web applications, making it a pivotal technology in modern web development.
This article provides a concise yet comprehensive overview of relational, key‑value, document, search‑engine, time‑series, vector, spatial, graph, columnar, and multimodel databases, explaining their data models, typical queries, core advantages, and popular implementations to help developers choose the right storage solution for any project.
This article explains how Redis uses the maxmemory setting to trigger memory eviction, details the various eviction policies (including LRU and LFU), shows how to query and modify these settings with config commands, and briefly mentions promotional offers for a ChatGPT community.
This article walks through a real‑world e‑commerce scenario where billions of daily browsing events generate over 100K TPS writes, evaluates storage options on reliability, cost, read/write performance and implementation difficulty, and ultimately recommends Tair after detailed analysis of List, Sorted‑Set and Hash structures, code examples, and concurrency controls.
Tencent Cloud, in collaboration with Nanjing University, ETH Zurich, and Simon Fraser University, presented two VLDB‑2023 papers introducing PolySI, a black‑box checker for snapshot isolation, and Tesseract, an online, transactional schema‑evolution technique, both demonstrating superior performance and practical impact on modern cloud databases.
The article examines the driving forces behind database innovation, emphasizing the role of inherent shortcomings, AI integration, and the emergence of third‑generation distributed databases that aim for minimal usability, controllable latency high availability, and 100% data correctness.
Through a detailed analysis of Oracle and PostgreSQL benchmarks, this article reveals why reducing database connection pool size—often to far fewer than the number of concurrent users—significantly cuts wait times and response latency, and provides a practical formula for sizing pools based on CPU cores and disk resources.
This article explains how to design a classification‑information system that handles 100 billion rows, ten‑thousand dynamic attributes, and hundreds of thousands of QPS by using vertical partitioning, unified metadata services, and an external search layer for scalable storage and retrieval.
This article explains how Redis 7.0.11’s multithreading mode is enabled through two configuration options, describes when the mode is activated or deactivated based on client write‑backlog, and outlines the read and write processing flow in multithreaded and single‑threaded stages.
This article explains key database terminology, traces the history of database technologies, compares relational, NoSQL, NewSQL, OLTP/OLAP, columnar, time‑series and graph databases, and demonstrates practical data‑structure designs such as zipper tables, bit operations, bitmaps, bloom filters, and ring queues for software development.
This article introduces and compares major database categories—including relational, key‑value, document, columnar, graph, and time‑series databases—explaining their structures, typical use cases, and advantages, helping readers understand when to choose each type for various applications.
This article demystifies vector databases by first explaining the concept with a five‑year‑old analogy, then expanding to technical details for developers, covering how embeddings work, the differences from relational databases, ANN search, indexing, similarity metrics, and why vector stores outperform raw NumPy arrays for large‑scale similarity retrieval.
This article explores a range of performance‑optimization techniques—including indexing, caching, compression, prefetching, peak‑shaving, and batch processing—explaining their trade‑offs, practical implementations, and how they can be combined to improve software system efficiency.
The article explains why relying solely on SQL optimization often fails to resolve deep database performance problems, illustrating with real Oracle and domestic PostgreSQL‑compatible cases where I/O configuration, shared buffers, and system‑level metrics were essential to achieve stability.
This article outlines the essential steps for validating data after migration, discusses common issues and their solutions, and recommends tools and a Python script for comparing source and target data to ensure integrity, accuracy, and consistency.
This article explains MySQL’s server and storage‑engine architecture, walks through the step‑by‑step execution of a SELECT statement, describes how indexes are organized, defines slow queries, shows how to detect and analyze them, and provides practical optimization examples and additional MySQL pitfalls.
This article provides interview‑style SQL examples that cover creating a sales table, computing year‑over‑year and month‑over‑month growth rates, and using various window‑function techniques to identify numbers that appear consecutively at least three times.
This article provides an extensive tutorial covering the Linux kernel architecture, Bash shell scripting, Vim editor usage, GCC compilation process, GDB debugging techniques, Apache HTTP server setup, MySQL/MariaDB/PostgreSQL database basics, and introductory guides to PHP, Python, and Perl programming.
