This article provides a comprehensive overview of database read‑write splitting, detailing its benefits, core technical implementations, practical best‑practice guidelines, and a comparison of popular open‑source and commercial products that enable efficient read‑write traffic distribution.
Even non-programmers notice MySQL’s growing pains—large tables, oversized databases, and read-heavy workloads—prompting a shift toward distributed databases, where sharding, read/write separation, and cloud-native solutions like TiDB or Aurora replace traditional middleware, marking the end of single-node MySQL dominance.
The article explains the limitations of standalone MySQL, outlines common scaling problems such as oversized tables and high read traffic, and compares middleware‑based sharding solutions with modern distributed databases, highlighting why the latter are becoming the preferred choice for growing applications.
This tutorial explains why message queues are essential, compares popular MQ products, details RocketMQ's core components, and provides step‑by‑step instructions—including environment setup, broker configuration, firewall rules, and monitoring—to deploy a fault‑tolerant RocketMQ cluster on CentOS 7.
This article provides a comprehensive overview of China’s Xinchuang (information technology innovation) industry, explaining its core components—hardware, operating systems, middleware, databases, and firmware—while highlighting market share trends, classification schemes, and the strategic importance of each layer for national information security.
The Ant Security Lab presented AntDTX, a trusted device middleware, and its joint anti‑fraud collaboration with Vivo, discussing industry security trends, technical architecture, deployment results, and future directions for protecting mobile users against sophisticated telecom fraud.
This article analyzes the difficulties of initializing stable environments, the poor usability and low reliability of feature environments, proposes concrete solutions such as unified test environments, streamlined creation workflows, middleware adjustments, testing and documentation, and shares practical reflections from real deployments.
After a write to the MySQL master, reads from a slave can return old or missing data due to replication lag, and this article explains the underlying asynchronous replication mechanisms, the involved threads, and presents practical solutions such as forcing master reads, delay detection, semi‑sync mode, GTID waiting, and middleware implementations like Sharding‑JDBC, MyCat, and MaxScale.
This tutorial walks through building a full‑stack backend for a frontend publishing platform using Koa2, @koa/router, and MongoDB, covering project initialization, route modularization, controller and service layers, middleware for response handling, environment‑specific configuration, and complete CRUD operations verified with Postman and Mongo shell.
This article details the challenges of scaling RabbitMQ, the evaluation of RocketMQ versus Pulsar, the design of a new messaging middleware platform with high availability, performance, and rich features, and the step‑by‑step migration strategy that enabled seamless, low‑cost transition for massive business traffic.
This weekly digest curates top community technical articles and release notes, highlighting PostgreSQL vs MySQL comparisons, architecture diagram tips, a six‑hour pagination incident, MySQL core‑dump handling, new DBLE features, DTLE performance boosts, and SQLE multi‑source audit enhancements.
This article explains MySQL’s binlog, how it enables master‑slave replication, and explores three practical business uses—data heterogeneity, cache synchronization, and task dispatch—showing how a middleware that pretends to be a slave can leverage binlog events to improve system architecture and performance.
To address RabbitMQ’s scalability, reliability, and feature limitations, Vivo’s middleware team evaluated RocketMQ and Pulsar, selected RocketMQ, and built a next‑generation message middleware platform with an AMQP‑proxy gateway, metadata services, and high‑availability mechanisms, enabling seamless, high‑throughput migration and richer messaging capabilities.
This article details the challenges of scaling RabbitMQ, the evaluation of RocketMQ versus Pulsar, the architectural design of a new high‑availability message middleware platform, and the step‑by‑step smooth migration strategy that enables higher throughput, richer features, and lower operational costs.
This article explains the fundamentals of message queues, compares Kafka, RabbitMQ, and RocketMQ in terms of architecture, key concepts, advantages, and drawbacks, and provides practical guidance on selecting the most suitable queue for different application scenarios such as high‑throughput logging, financial transactions, or small‑scale services.
This article provides a detailed walkthrough of Scrapy, covering its event‑driven architecture, component interactions, XPath parsing fundamentals, installation steps, project creation, sample spider code, item pipelines, middleware customization, and essential configuration settings for effective web crawling in Python.
This article traces the historical development of computer architecture from the ENIAC era through mainframes, the rise of distributed systems, and modern scaling techniques such as clustering, replication, middleware, read‑write separation, caching, and service decomposition, illustrating each stage with clear examples and diagrams.
Ctrip’s hotel order platform evolved from a single SQL Server instance to a multi‑IDC, sharded architecture, and this article details the middleware‑driven migration, unified caching, data‑chain redesign, consistency safeguards, and operational practices that enabled seamless, high‑performance order processing at millions of transactions per day.
This article compares Redis dual‑active designs—hot‑standby, various dual‑write models, and bidirectional synchronization—showing hot‑standby’s high cost, dual‑write’s latency or consistency trade‑offs, and arguing that a middleware‑driven bidirectional sync, using replication protocols and fixed‑prefix keys to avoid loops, offers the most practical solution.
This article explains the background, design principles, architecture, serialization handling, asynchronous‑to‑synchronous conversion, trigger timing, ease of use, implementation details, and usage documentation of a lightweight, non‑intrusive JSF local debugging tool that leverages Redis publish/subscribe to enable seamless local integration testing for developers.
An in‑depth guide compares the four major message‑queue middleware—Kafka, RabbitMQ, RocketMQ and ActiveMQ—detailing their architectures, modes, evaluation criteria, strengths, weaknesses, and selection considerations to help engineers and interviewees answer critical MQ interview questions and make informed technology choices.
This article examines the challenges faced by a transaction middleware platform, introduces a finite‑state‑machine (FSM) solution for order state flows, and compares traditional serial processing with future‑based staged concurrency and event‑driven concurrency models, highlighting their benefits and trade‑offs.
This article explains what message middleware (or message queues) is, the problems it solves such as decoupling, ordering, routing, asynchronous processing and peak shaving, and details its components, patterns, advantages, common protocols, and popular implementations.
This article explains how to create custom middleware for the Go Negroni framework, walks through a complete example with code, and details the internal functions such as UseHandler, Wrap, Use, build, and how Negroni ultimately runs the HTTP server.
This article recounts a hiring manager’s interview with a candidate lacking high‑concurrency experience, then outlines the candidate’s self‑driven three‑stage practice—single‑machine optimization, load‑balanced testing, and middleware integration—providing concrete steps for engineers to acquire high‑concurrency expertise.
Kratos v2 is a lightweight, highly pluggable Go microservice framework that replaces the monolithic v1 design with a toolbox of interchangeable components—such as transport, middleware, logging, configuration, and service discovery—organized in a DDD‑inspired layout and extensible via protobuf‑defined plugins.
This article introduces microservice concepts, explains GoKit's architecture and onion model, and walks through building a simple calculation service in Go, progressively adding logging, metrics, and middleware using the decorator pattern to achieve a clean, decoupled three‑layer design.
This article provides a comprehensive analysis of Go's net/http library and the Gin framework, detailing request handling flow, router implementation, middleware chaining, and context management, while presenting key source code excerpts to illustrate how HTTP services are built and extended in Go.
The article discusses how abstraction and decoupling through Java interfaces—such as service layers, RPC APIs, and middleware adapters—can improve code maintainability, enable flexible implementation swaps, and clarify responsibilities, while also warning against over‑engineering in most business scenarios.
This guide compares Kafka, Pulsar, RocketMQ, RabbitMQ, and NSQ across architecture, consumption models, delay and dead‑letter support, persistence, ordering, multi‑tenant isolation, and performance, recommending Kafka for high‑throughput log processing, Pulsar for transactional delayed messaging and disaster recovery, and NSQ for Go‑centric custom solutions.
The article walks through the challenges of growing data volumes, compares master‑slave, vertical, horizontal, and sharding‑plus‑partitioning architectures, explains their pros and cons, and provides concrete guidance on selecting and implementing a suitable database solution, including middleware options and real‑world case studies.
This article explains the concept of middleware, demonstrates how to implement it in Go using the net/http Handler interface and the Negroni library, and provides complete code examples for logging and authentication middleware chains.
This article explains how to deploy Traefik's Log4Shell plugin—a middleware that mitigates the Log4J (CVE‑2021‑44228) vulnerability—by configuring it via Pilot token, static files, Kubernetes CRDs, Ingress annotations, or Docker labels, with example code snippets for each method.
After years of working in middleware teams at both startups and Alibaba Cloud, the author shares insights on what middleware development entails, the differences from business development, essential skills, typical roles, and practical steps for engineers aspiring to transition into this specialized backend field.
The article compares B2B and B2C business models, highlights differences in demand certainty and service‑quality tolerance, and proposes a four‑layer, cloud‑native technical architecture—including container, middleware, business, and low‑code platform layers—to guide B2B system and vision construction.
This article chronicles a developer’s personal and technical evolution—from refactoring a lottery service with Druid, exploring Cobar sharding, diving deep into MetaQ’s messaging model, to designing custom task‑scheduling systems—highlighting lessons learned, architectural insights, and the enduring value of connecting the dots in software engineering.
This article traces Seata’s development from its 2014 origins as Alibaba’s TXC middleware, through its 2016 cloud service launch and 2019 open‑source release, detailing its architecture, module composition, core roles, and the four transaction modes (AT, TCC, Saga, XA) with practical comparisons.
This article explores Koa’s core AOP‑based architecture, demonstrates minimal implementations using koa‑compose and Node.js http, and proposes a microservice‑oriented framework that extends Koa to support HTTP, Thrift, WebSocket and other services, complete with abstract server designs and example code.
This article compares common distributed transaction approaches—including Master‑Slave, Master‑Master, two‑phase and three‑phase commit, and Paxos—explains their mechanisms, trade‑offs, and real‑world implementations such as Alibaba’s TCC, GTS, LCN, and TXC, helping architects select the most suitable solution for high‑availability data consistency.
This article describes the motivation, architecture, technology choices, and operational practices of building a lightweight Node.js middleware layer that acts as an API gateway for a data platform, covering its positioning, NestJS selection, Kubernetes deployment, health probes, and logging strategies.
This article introduces SOFABoot, an Ant Financial open‑source framework built on Spring Boot that adds readiness health checks, class and log isolation, unified middleware integration, and modular development capabilities, and provides the project’s source repository for developers.
This article provides a comprehensive overview of Redux, covering its design philosophy, core components, API implementation, React bindings, and practical code examples to help developers understand and apply state management effectively in modern front‑end applications.
This article surveys the historical development of command‑and‑control software for unmanned aerial vehicles, compares early, first‑ and second‑generation drone architectures, and examines modern open‑control platforms, distributed UAV frameworks, behavior‑based controllers, and future trends in UAV software design.
This weekly bulletin from the DBLE community presents curated technical news, video courses, event announcements, detailed DBLE and DTLE development updates, bug fixes, and upcoming plans, providing valuable insights for developers working with MySQL middleware and open‑source database solutions.
Linkis, an open‑source computing middleware from WeBank, has entered the Apache Software Foundation Incubator, offering REST/WebSocket/JDBC interfaces to a wide range of engines such as Spark, Hive, Presto and Flink, and providing powerful governance, orchestration, and resource‑management capabilities for big‑data platforms.
Gaode migrated its high‑traffic rendering gateway from Java to Go to halve machine usage, validate middleware stability, and prepare for cloud‑native transformation, overcoming correctness and availability challenges by creating a real‑time traffic‑comparison tool, sandbox stress tests, and a staged gray‑release, ultimately achieving about 50% cost reduction.
This article explains the principles of master‑slave read/write separation, the MySQL binlog‑based replication process, its side effects, practical ways to mitigate replication lag, and how middleware or proxy layers can simplify database access in high‑concurrency environments.
RabbitMQ is an open‑source AMQP broker that enables asynchronous, reliable messaging through exchanges, queues, and bindings, and can be quickly deployed with Docker; SpringBoot integration uses the amqp starter, configuration properties, AmqpAdmin for programmatic setup, RabbitTemplate for sending, and @RabbitListener for consuming messages, even converting JSON payloads to POJOs.
By introducing function composition, async/await support, and the koa‑compose middleware pattern, this article shows how functional programming techniques can replace tangled nested conditionals with reusable, readable pipelines that track execution status, improving business logic readability, maintainability, and extensibility.
This article describes how Ctrip's senior backend engineer designed and implemented horizontal database sharding, a service‑level proxy, dual‑read/write mechanisms, and a staged migration process to overcome order‑database bottlenecks, improve scalability, and ensure high availability for the rapidly growing international train‑ticket business.
This article explains the fundamentals of message queues, compares JMS with popular implementations such as RabbitMQ and Kafka, describes their architectures, usage patterns, and how they improve system performance, scalability, and decoupling in backend applications.
This article explains what middleware is, why it’s used in Go projects, and demonstrates various implementations—including logging, authentication, method checks, and chaining—through clear code examples for both the standard net/http package and the Gin framework, helping developers enhance their backend services.
This article provides a comprehensive overview of message middleware concepts, the role and benefits of message queues, and an in‑depth look at RabbitMQ architecture, components, reliability mechanisms, advanced features, and internal storage and flow‑control mechanisms.
The article compares the architectures of NSQ (YouZan branch), Kafka, and RocketMQ—detailing their coordination mechanisms, storage models, consistency guarantees, and operational trade‑offs—while recommending Kafka for log‑big‑data workloads, RocketMQ for massive topic counts, and NSQ for extensibility and lightweight deployment.
This article explains the ThinkPHP runWithRequest method, its call to the initialize routine, and details the initialization steps including environment loading, configuration parsing, language pack loading, debug mode setup, middleware loading, and service registration and bootstrapping, with full code examples.
This article explains how ThinkPHP 6 loads global middleware, details the internal methods such as loadMiddleware, import, add, and buildMiddleware, and then describes the framework's multi‑application detection and parsing logic, including relevant code examples.
This comprehensive guide introduces Scrapy's architecture, explains its core components and data flow, teaches XPath fundamentals, walks through installation, project creation, spider coding, item and pipeline definitions, middleware customization, pagination handling, and essential settings for effective Python web crawling.
The article reviews the evolution of internet middleware presented at Alibaba Cloud’s Yunqi conference, detailing how massive user scale drove its growth, the shift toward cloud‑native and serverless technologies, and the practical benefits and challenges of adopting platforms like EDAS, Kubernetes, service mesh, and SkyWalking.
This guide explains how to combine Scrapy and Selenium to scrape dynamically rendered web pages, covering installation, project setup, middleware configuration, Selenium driver handling, and code examples that demonstrate a complete end‑to‑end crawling workflow.
This article examines four common message middleware delivery models—Point-to-Point, Publish/Subscribe, Partition, and Transfer—explaining their core characteristics, differences, usage scenarios, and performance considerations, with practical examples from ActiveMQ, Kafka, RocketMQ, and NSQ in modern systems.
The article provides an in‑depth overview of Uber’s self‑service API gateway, describing its role in microservice architectures, the configurable components such as protocol manager, middleware, handlers and clients, the YAML/Thrift‑based configuration and code‑generation pipeline, and the advanced features and challenges involved in building a production‑grade gateway.
This article outlines the fundamental and specialized technical skills required for developing middleware in general and database middleware in particular, covering multithreading, network programming, design patterns, asynchronous programming, algorithms, testing, performance tuning, as well as SQL, transaction handling, protocol implementation, and replication.
This article walks through Vite's CLI startup process, explains how the bin script links to the vite executable, details the devServer's five core modules and fifteen middleware components, and shows the createServer flow that powers Vite's fast, hot‑reloading development experience.
This article introduces the DBLE MySQL‑compatible distributed middleware, details its new pure read/write splitting feature in version 3.20.10.0, and provides a comprehensive table showing which SQL statements trigger implicit commits and their support status.
This article presents a curated set of advanced interview questions covering databases, middleware, concurrency, distributed systems, and practical engineering topics, offering both interviewers and candidates a deep dive into essential backend concepts and best‑practice solutions.
This article introduces Go's Gin framework, compares its performance with other Go web frameworks, and walks through core features such as routing, middleware, data binding, and the underlying engine, providing code examples and visual diagrams for developers seeking efficient backend solutions.
This comprehensive tutorial walks you through choosing Koa, setting up a project, refactoring routing, handling parameters, configuring middleware for error handling, CORS, logging, validation, and organizing config, controller, service, and model layers for a robust Node.js backend.
This article outlines what middleware development is, the essential technical and personal qualities required, and provides a step‑by‑step learning roadmap for aspiring Java developers aiming to join or build middleware teams in modern backend environments.
This article explains Sentinel’s internal flow‑control workflow by dissecting the entryWithPriority method, the construction of the ProcessorSlot chain, the role of each slot such as NodeSelectorSlot, ClusterBuilderSlot, StatisticSlot, and how the SPI‑based SlotChainBuilder enables extensible, high‑performance request limiting in Java middleware.
This article walks through creating a simple native Node.js HTTP server, applying the Strategy pattern to decouple routes, enforcing the DRY principle with Promises, and then dives deep into Koa’s core source—including its constructor, use, listen, compose, and router modules—to reveal how the framework orchestrates middleware and request handling.
A former intern recounts three internships across Beijing, Shenzhen, and Hangzhou, detailing how he joined the dubbogo community, implemented the Triple protocol for dubbo-go 3.0 by hand‑crafting HTTP/2, tackled compatibility challenges, and reflected on the future of cloud‑native middleware.
This article details Minsheng Bank's data middle platform built since 2018, explaining its cloud‑native architecture, the underlying microservice and container design, the operational pain points it addresses, and the suite of DevOps tools, management solutions, and component strategies that enable scalable, secure, and efficient financial data services.
This article describes how to programmatically configure Log4j2's LoggerContext to separate middleware logs into dedicated files, encapsulate the setup in a shared jar, expose a logger retrieval API, and integrate it into middleware components, reducing business log interference and storage costs.
This article summarizes the DBLE network module, describing its key classes such as NIOAcceptor, NIOReactor, and SocketWR, explaining how client connections are accepted and processed, and highlighting the importance of low‑level network I/O knowledge for middleware development.
This guide explains how to resolve CORS withCredentials errors in ThinkPHP 5.1 by configuring Axios on the frontend, setting appropriate Access‑Control headers on the backend, creating a CrossDomain middleware, and handling preflight OPTIONS requests for methods like DELETE and PUT.
This article explains how to achieve extensibility in business systems by addressing database scalability through horizontal and vertical sharding, middleware layers, flexible schema designs, and by applying SOA principles to application, interface, and rule‑engine layers for adaptable, high‑performance architectures.
This beginner‑friendly guide walks readers through installing Scrapy, creating a project and spider, running and debugging crawlers, implementing parsing with CSS/XPath, and overcoming common hurdles such as JavaScript rendering, user‑agent spoofing, and proxy rotation via configurable middlewares, enabling quick start of web‑crawling projects.
The article introduces Baidu's self‑developed test middleware, explains its data‑plane and control‑plane architecture inspired by Istio, describes the challenges of building test environments, and details the system’s components, working modes, and diverse testing use cases such as functional, system, integration, sandbox, and chaos engineering.
The article expands the San DevTools technical analysis by detailing how to build Chrome DevTools extensions—defining a devtools page, creating panels, and debugging them—while also covering supporting technologies such as Yarn‑workspace monorepos, TypeScript path aliases, a lightweight middleware server, message‑batching bridges, and custom SVG icon components.
The article analyzes the difficulties of testing a large‑scale transaction middle platform—such as data diversity, volume, consistency, and lack of standards—and presents a rule‑driven, layered automation framework using Drools, jOOQ, and data‑objectification to dramatically improve testing efficiency and reliability.
iQIYI’s middleware team introduced a unified microservice standard architecture—combining a single SDK, centralized infrastructure (Nacos registry, Kong gateway, Apollo config, Prometheus‑SkyWalking monitoring, ChaosBlade), the QDAS platform, and extensible open‑source practices—to eliminate redundant builds, ensure high availability, streamline governance, and pave the way for cloud‑native service‑mesh evolution.
The article chronicles a YouZan DevOps engineer’s five‑year evolution from Alibaba‑based middleware duties to business‑operation leadership, highlighting the relentless pursuit of system stability through the 1‑minute detection, 5‑minute localization, 10‑minute resolution mantra, complex multi‑datacenter integrations, continuous learning, and a mindset of proactive problem‑solving.
This article explains what Laravel middleware is, how to create custom middleware with Artisan, the structure of the handle method, the difference between global and route middleware, how to register middleware in the Kernel, and various ways to assign middleware to routes or controllers, including parameter passing.
This article outlines a comprehensive process for identifying root causes of performance bottlenecks in production business systems, covering hardware, database, middleware, JVM settings, code inefficiencies, and monitoring tools, and provides practical optimization techniques for each layer.
This guide walks through the prerequisites, installation via Composer, key generation, and detailed configuration of Laravel's authentication system, including environment setup, file settings, controller examples, route definitions, middleware validation, and testing procedures for a functional backend.
This guide explains RESTful concepts, compares Casbin keyMatch functions, demonstrates Postman testing of CRUD endpoints, and shows how to integrate authentication middleware in ThinkPHP5.1, providing complete code snippets and configuration details for secure API development.
This guide walks through installing Express and express‑generator, creating a new Express project with EJS templates, adding custom routes and route parameters, and using the next() function for middleware‑style control transfer, illustrating each step with concrete code snippets and command‑line examples.
This article walks through using FastAPI middleware for request timing, redirection, host whitelisting, and CORS, demonstrates background tasks and custom response codes, and explains various deployment options including Uvicorn, Gunicorn, Docker, and Nginx, providing complete code examples.
The fifth episode of the MySQL 冲冲冲 livestream explores the trade‑offs between sharding and middleware architectures, discusses distributed transaction challenges, compares DBLE with MyCat and other solutions, and provides practical guidance for developers and DBAs handling high‑throughput MySQL workloads.
This article explains how to design and implement elegant RESTful APIs using ThinkJS, covering routing conventions, controller generation, custom router configuration, CRUD action mapping, token‑based authentication, permission validation with Logic layers, inheritance for reusable checks, and database operations with chainable queries.
This article explains the fundamental architecture of message middleware, its key roles such as peak shaving, asynchronous processing and decoupling, the two consumption models (publish‑subscribe and point‑to‑point), and introduces core Kafka concepts with practical Java code examples.
This article explains middleware as foundational software for distributed systems, outlines its evolution from early transaction monitors to modern Java and .NET stacks, categorizes its various types, and analyzes global and Chinese market sizes while profiling leading domestic vendors.
This article explains how to set up a Laravel route and controller that leverages the Pipeline class to pass a request through three custom pipe classes—LeftWords, RightWords, and BothSidesWords—modifying the input and storing the result as a new user record.
This article explains middleware fundamentals, its evolution in distributed systems, classifies its major types, analyzes global and Chinese market growth, and profiles key domestic vendors such as Dongfangtong, Baoland, Puyuan, Kingdee, Zhongchuang, Alibaba, and Tencent.
The article details JD's high‑performance Hotkey middleware, explaining its real‑time hot‑data detection architecture, the challenges faced during massive traffic spikes, and a series of systematic optimizations—including JDK upgrades, thread‑pool tuning, Disruptor replacement, and serialization changes—that enabled the system to scale from 20k to 350k queries per second while maintaining millisecond‑level latency.
Sharding splits a single database into multiple servers to improve performance, covering vertical and horizontal partitioning, middleware options, and key challenges such as distributed transactions, cross‑node joins, ID generation, pagination, routing transparency, and choosing between frameworks or custom solutions.
This article examines middleware as a front‑end design pattern, presents simple compose implementations, analyzes real‑world cases like Bridge and Fetch, compares middleware with the decorator pattern, and proposes API design guidelines to balance flexibility and maintainability.
This article traces the birth of middleware, the creation and multi‑generation evolution of SOFAStack at Ant Group, its adoption by banks and insurers, and its shift toward cloud‑native and trustworthy‑native architectures that power large‑scale financial services.
This article explains the background, goals, and step‑by‑step methodology for refactoring a mature mobile platform app into an App Factory that supports rapid, modular development of innovative independent apps through systematic decoupling, middleware management, and automated engineering pipelines.
This guide walks through installing MySQL nodes, Java, and MyCat 1.6.5, configuring schemas, data nodes, sharding rules, adjusting ports, adding users, and verifying the MyCat service, providing complete code snippets and troubleshooting tips for a functional distributed database middleware setup.
