This article explains the role of a middle tier in web systems, describes middleware concepts, outlines the advantages of using Node.js as a middle layer, and provides a step‑by‑step Koa‑based implementation with code examples and deployment considerations.
This article completes a FastAPI series by detailing middleware usage, request redirection, trusted host and CORS settings, background task handling, custom HTTP status responses, and multiple deployment options—including Uvicorn, Gunicorn, Docker, and Nginx—accompanied by full code examples.
This article introduces the challenges that message middleware must address, examines how Apache RocketMQ tackles these issues through its architecture, deployment models, and feature set, and provides a concise overview of its core components, reliability mechanisms, and operational characteristics.
This article examines Taobao’s pivotal architectural transformation from a monolithic codebase to a large‑scale distributed system, detailing the challenges of personnel, business complexity, Oracle bottlenecks, and hardware limits, and describing the comprehensive solutions involving code and interface vertical splitting, custom middleware, database sharding, and new infrastructure.
This article provides a detailed walkthrough of webpack-dev-middleware version 3.7.2, explaining its purpose, key features, and the core implementation of its index.js and middleware.js files, including code snippets and how it integrates with Express to serve compiled assets from memory during development.
This weekly DBLE community newsletter, authored by reporter Yongzheng, compiles curated MySQL and DBLE resources, outlines recent open‑source developments, bug fixes, community Q&A, and upcoming plans for both DBLE and TXLE middleware projects.
This article explains the fundamentals of operations and game operations, outlines server management strategies for hundreds of machines, compares RAID levels, evaluates load balancers (LVS, Nginx, HAProxy), discusses proxy servers (Squid, Varnish, Nginx), and clarifies middleware, JDK, Tomcat ports, and CDN concepts.
This weekly newsletter summarizes the March DB‑Engines database ranking, explains its methodology, shares curated MySQL articles and tools, and reports the latest development, bug‑fix, and roadmap updates for the open‑source middleware projects DBLE, DTLE, and TXLE.
This weekly roundup from the DBLE open‑source community presents the latest MySQL‑related articles, bug‑fixes, open‑source middleware progress, upcoming release plans for DBLE, DTLE, and TXLE, and invites community feedback on development and usage.
Redux is a predictable JavaScript state container that centralizes a single immutable store, updates it via dispatched actions processed by pure reducers, combines multiple reducers, supports middleware and DevTools, and can be built from scratch by implementing a createStore function with subscribe, getState, and dispatch.
This weekly community briefing summarizes the February DB‑Engines ranking trends, announces MySQL 5.6's upcoming end‑of‑life, and highlights recent development, bug‑fix, and release activities for the open‑source middleware projects DBLE, DTLE, and TXLE, along with several technical deep‑dive links.
This article chronicles the design, evolution, and performance evaluation of Bond, a distributed‑lock SDK used internally at Youzan, covering its multi‑phase roadmap, storage choices, timeout‑retry strategies, lock‑TTL recommendations, and practical pitfalls for reliable operations.
This article details Yanxuan's evolution from a chaotic, multi‑queue setup to a unified, cloud‑native message center built on RocketMQ and Kafka, describing current services, scheduling mechanisms, publish‑subscribe implementation, and future plans for platformization and Kubernetes‑based resource management.
This article introduces seven open‑source middleware projects hosted on Gitee, detailing their features, use cases, and URLs, offering developers practical options for high‑performance, distributed, and reliable messaging, proxy, and push‑notification services in modern backend architectures.
This guide explains how to use Xiaomi's open‑source Gaea middleware to achieve automatic MySQL read/write separation, covering Go environment setup, Gaea compilation, configuration files, Docker deployment, testing procedures, and integration with SpringBoot.
This weekly digest summarizes the latest MySQL community news, including a Microsoft Access security flaw, phpMyAdmin 4.9.4/5.0.1 releases, DBLE and TXLE middleware weekly reports, and a call for community feedback on DBLE, DTLE, and TXLE usage.
This guide explains how to organize request handling with Laravel controllers, covering basic controller creation, namespace handling, single‑action controllers, middleware assignment, resource controllers with custom routes, dependency injection techniques, and route caching for production performance.
This guide explains how Laravel middleware filters HTTP requests, shows how to create custom middleware with artisan, demonstrates pre‑ and post‑processing, registers global and route middleware, configures middleware groups, priority ordering, parameter passing, and terminable middleware for advanced request handling.
This article provides a comprehensive guide to Laravel routing, covering basic route definitions, route files, HTTP verbs, CSRF protection, redirects, view routes, parameters with constraints, named routes, route groups, model binding, fallback routes, rate limiting, and form method spoofing, all illustrated with clear code examples.
This guide introduces the Scrapy framework, explains its architecture—including engine, scheduler, downloader, spiders, pipelines, and middlewares—covers installation, project setup, item definition, spider coding, pipeline handling, pagination, and provides practical code examples for extracting data from Douban books.
Since 2017, Tencent Online Education has migrated its siloed, self‑developed services to a unified cloud‑native architecture—standardizing micro‑services, selecting open‑source middleware, and enhancing DevOps with Kubernetes, CI/CD, and data migration—thereby boosting development efficiency, scalability, cost savings, and fostering a collaborative engineering culture.
This article explains how DBLE's hint mechanism can be used to specify database routing, classify different hint types, and demonstrate practical operations such as invoking stored procedures and executing custom SQL statements on selected nodes.
This article explains the role of message‑queue middleware in distributed systems, covering its communication patterns, ten key advantages such as decoupling and scalability, and practical use cases like asynchronous processing, traffic shaping, log handling, and e‑commerce architectures.
The article argues that while middleware can simplify handling cross‑cutting concerns in HTTP APIs, overusing it leads to tangled, untestable code, and proposes refactoring middleware logic into pure functions with explicit inputs and outputs to improve clarity and maintainability.
This article traces the evolution of Youzu's data platform ingestion, comparing early HTTP/script methods with modern DTS and real‑time ETL solutions, evaluating middleware choices, detailing core system architectures, and outlining future improvements for reliable, scalable data access.
This article describes how to implement a traffic management system using service isolation to address challenges in full-link pressure testing, parallel feature testing, and online gray release.
This weekly newsletter summarizes the latest DBLE, DTLE, and TXLE open‑source middleware updates, including bug fixes, new features, community Q&A, documentation releases, upcoming releases, and links to related videos and articles for developers.
In this presentation, Alibaba Cloud’s chief middleware architect Li Xiaoping outlines the evolution of internet middleware at Alibaba, explains the value and applications of cloud‑native middleware, and shares insights on future trends and challenges in the field.
The article presents a bytecode‑generation technique that creates dynamic wrapper classes to invoke arbitrary Java methods with near‑native speed, avoiding reflection’s overhead, and details the CallerWrap base, generator, and thread‑safe cache implementation that together enable high‑performance middleware calls.
This article introduces JDTX, a novel distributed transaction middleware that combines ACID guarantees, high performance, and 1PC architecture, explains its design principles, compares two‑phase commit with flexible transactions, details its MVCC and WAL implementation, and outlines integration with Apache ShardingSphere and future roadmap.
Traefik 2.0 finally arrives with major upgrades such as native TCP and SNI routing, unified HTTP/TCP entrypoints, a powerful middleware system, a revamped dashboard, built‑in canary releases via weighted load‑balancing, traffic mirroring, and comprehensive migration tools for moving from 1.x to 2.0.
The iKesheng community’s weekly roundup shares upcoming events like the DBLE Beijing meet‑up, free Mycat diagnosis services, detailed DBLE and DTLE weekly reports, and technical articles on global lock detection, slave data search, and hash algorithm choices, offering valuable insights for database professionals.
This article examines why GraphQL naturally emerges for complex front‑end data needs, details its language design, architecture, resolver middleware, mocking strategies, and various deployment patterns such as API‑gateway and BFF, offering practical guidance for building scalable GraphQL services.
This weekly digest summarizes the latest MySQL 8.0.17 enhancements, Redis 6's new RESP3 protocol, free Mycat diagnostics, DBLE and DTLE weekly reports, original technical articles on MySQL fragmentation, dynamic permissions and TempTable engine, plus details of the upcoming Shanghai 3306π meetup.
Gaea is an open‑source MySQL middleware created by Xiaomi that replaces MyCAT, offering read‑write splitting, sharding, namespace‑based multi‑tenant configuration, Go‑driven architecture, hot‑reload via etcd, comprehensive monitoring, and a visual management console, with its source hosted on GitHub.
This article introduces gobox, a self‑developed lightweight Go framework that treats each module as a box, explains its HTTP request handling architecture, key components such as System, Router, SimpleRouter, ActionContext, Controller, demonstrates graceful‑restart support with gracehttp, and provides a complete runnable example with sample curl outputs.
This article explains the challenges of handling Double‑11 traffic spikes, introduces adaptive load‑balancing concepts, analyzes the 5th Middleware Performance Challenge scenario, and outlines algorithm design considerations and evaluation steps for building a robust, self‑adjusting load‑balancing solution.
This article provides a comprehensive analysis of DBLE's XA transaction implementation, covering XA protocol basics, DBLE's architecture, code structure, execution flow, error handling, transaction logging, recovery mechanisms, and practical considerations for distributed transactions in database middleware.
In this interview, Lu Zhi, the technical lead of Ant Financial's SOFA middleware, discusses the evolution from SOFA4 to SOFA5, the strategic importance of Service Mesh and Serverless, the development of the Seata distributed‑transaction framework, and the team’s open‑source governance and community‑building approaches.
Fish‑Redux separates UI from business logic by using a dispatch function that routes actions from a view’s handler to the component’s effect, then to the page store’s reducer, passes through any applied middleware, updates the state, and finally notifies listeners to re‑render the UI.
The article explains the fundamental concepts of distributed systems, distinguishing them from service‑oriented architectures and middleware, emphasizing the importance of high cohesion, low coupling, and proper decomposition to build scalable, reliable software across multiple processes.
The DTLE 2.19.03.0 release introduces cross‑data‑center transfer, cloud synchronization, data aggregation, DDL filtering, schema name conversion, and numerous bug fixes, providing a reliable MySQL‑focused middleware for diverse data replication and migration scenarios.
This article reviews a decade‑long evolution of backend engineering—from early LAMP stacks to modern micro‑services, middleware, cloud, big data, AI, and containerization—explaining why new developers need to understand each layer's role in today’s complex internet systems.
This article explains the fundamentals of database read‑write separation, compares master‑slave and master‑backup concepts, discusses replication lag issues, and presents code‑level and middleware approaches for routing reads and writes efficiently.
This article presents a comprehensive overview of backend architecture evolution, covering system design fundamentals, middleware, microservices, databases, big data, AI, Docker, and Kubernetes, to help new backend developers understand the role of modern internet technologies and make informed design choices.
This talk reveals why middleware operations in financial institutions feel especially painful, examines the specific cost, autonomy, and reliability challenges, and outlines a step‑by‑step evolution toward tool‑driven platforms, hybrid‑cloud deployment, and AIOps that reduce manual toil and improve system resilience.
A detailed post walks through a mysterious 10‑second timeout on fast primary‑key SQLs in a sharding middleware, showing how log analysis, thread blocking, and an inefficient string‑replacement implementation caused the slowdown and how refactoring to StringBuilder restored performance.
This article chronicles Lu Zhi’s nine‑year evolution from a fresh graduate at Alibaba to the open‑source lead of the SOFA middleware team, highlighting his early internships, open‑source experiments, the challenges of scaling a financial‑grade distributed system, and practical advice for aspiring contributors.
This article explains how to propagate request‑level context in a Node.js HTTP service by building a call‑tree with async_hooks, avoiding monkey‑patching, handling lifecycle quirks, preventing memory leaks, and using reference‑counted cleanup to ensure reliable context queries.
This article walks you through creating a lightweight Koa 2 framework by explaining its core modules—application, request, response, and context—showing how to implement the HTTP server wrapper, the onion‑style middleware composition, and robust error handling with code examples for each step.
This article explains why modern applications dealing with massive user, order, and transaction data must move beyond single‑table designs, compares partitioning, sharding (分库分表), and NoSQL/NewSQL solutions, and provides practical guidance on choosing middleware, sharding columns, and hybrid architectures such as es + HBase.
This article introduces SOFARPC, Ant Financial's financial‑grade Java RPC framework, covering its overall architecture, extension mechanism, link tracing, connection management, synchronous and asynchronous invocation models, thread model, fault‑tolerance, generic invocation, data passthrough, graceful shutdown, routing implementation, and annotation support for building robust microservice systems.
This article compiles a comprehensive set of Ant Financial interview questions covering Java fundamentals, data structures, concurrency, JVM internals, Spring framework, Tomcat, Docker, Dubbo, MySQL sharding, and messaging middleware, providing candidates with a detailed study guide for multiple interview rounds.
The article examines MyCat’s middleware‑based pseudo‑distributed MySQL architecture, outlines its storage, scalability, and reliability shortcomings, walks through common solutions like disk expansion, compression, and sharding, and finally offers practical steps and alternative technologies for building truly distributed database systems.
The Youzan search system uses middleware‑driven Elasticsearch optimizations—segment merging, larger buffers, routing, and rollover—to cut index files and document scans, splits large indices into business‑specific or hot‑cold sub‑indices, and adds asynchronous cross‑datacenter replication with soft‑delete versioning for high‑availability and scalable performance.
Koa2 is a lightweight, async‑await‑based Node.js web framework that evolved from Express to eliminate callback hell, offering an elegant onion‑style middleware system, unified ctx object, and extensibility through routers, static serving, SSR, and database integrations, making it ideal for modern web services.
This guide explains why Laravel reports a missing IpLimit middleware class, shows how to correctly create and register the middleware, implement admin checks, and configure routes with single or multiple middleware assignments, complete with code examples.
Pirate Middleware introduces a JSON‑based DSL that orchestrates generic service calls across Meituan’s myriad business lines, replacing heavyweight custom adapters with a decoupled, parallel‑or‑sequential execution engine, thereby shifting data preparation to business teams, cutting development effort, and enhancing reuse, monitoring, and overall platform efficiency.
This article reviews the essential concepts of message‑queue middleware, covering why they are needed, their drawbacks, how to choose among popular solutions, and practical techniques for ensuring high availability, avoiding duplicate consumption, guaranteeing reliable delivery, and preserving message order.
To support Meituan’s rapid growth, this article examines the design and evolution of several industry-leading message-queue solutions—including Alibaba’s Notify and RocketMQ, Tencent’s Tube and Hippo, and Ctrip’s Herms—highlighting their reliability, scalability, and decoupling features, and extracting key insights for building robust MQ systems.
This article reviews essential concepts of message queue middleware, covering why to use queues, their drawbacks, selection criteria, high‑availability strategies, deduplication, reliable transmission, ordering guarantees, and practical advice for interview preparation.
Ant Group engineers Yang Bing and Huang Ting discuss the evolution of their SOFA middleware platform—from early service‑oriented architecture to a full‑stack DevOps ecosystem—highlighting microservice governance, Service Mesh integration with Kubernetes/Istio, open‑source strategies, and the cultural emphasis on reliable, commercially‑savvy engineering talent.
This tutorial walks beginners through setting up a Python Scrapy project, writing a spider to fetch forum thread titles and contents, using XPath for parsing, and enhancing the crawler with pipelines, middleware, and common settings for robust web scraping.
In this interview, Ant Financial’s middleware leaders Yang Bing and Huang Ting discuss the evolution of the SOFA framework, the adoption of Service Mesh, open‑source strategies, cloud‑native transformation, and practical advice for engineers navigating large‑scale financial technology platforms.
This article explores the philosophical limits of design patterns and then dives into three core backend architectural patterns—Middleware, MVC, and Dependency Injection—illustrating their purpose, implementation in Node.js frameworks like Express and Koa, and their impact on code modularity and scalability.
JD.com’s review and share platform combines multi‑dimensional rating, text, image and video content with a modular middleware, MySQL/MongoDB/HBase storage, Solr search, Redis caching and a management backend, detailing its architecture, daily operations, component‑based design, scalability challenges and future enhancements.
This article explains why and how relational databases should be sharded, covering vertical and horizontal partitioning techniques, common pitfalls such as distributed transactions and join queries, and practical guidelines for deciding when to split data and which tools to use.
Senior Alibaba engineer Xiao Xie recounts his decade‑long journey from the early Taobao Mall project to leading the Cloud Computing “Flying‑Sky Eight” team, detailing pivotal initiatives like the Five‑Color Stone integration, full‑link stress testing for Double‑11, and the evolution toward self‑developed, distributed cloud technologies.
Agent Tiny, a lightweight middleware for resource-constrained IoT devices, lets developers quickly connect Huawei LiteOS-powered terminals to the Huawei OceanConnect cloud via simple API calls, offering full LWM2M, CoAP, mbedtls, and LwIP support, reducing development cycles and simplifying cloud onboarding.
Alibaba’s fourth middleware performance challenge invites developers to create a high‑performance Service Mesh Agent for Dubbo, leveraging Docker containers, etcd registration, load balancing, protocol translation, and offering optimization tips such as coroutines, async communication, and caching to achieve superior QPS scores.
This article explains how to create HTTP middleware in Go, covering request reading, trailing‑slash redirection, request‑ID injection, server header manipulation, custom ResponseWriter implementation, and handling of additional interfaces such as Push and Flush, with complete code examples.
This guide walks through creating Go middleware, showing how to read and modify requests, manage response headers with custom ResponseWriter implementations, handle edge cases like missing Write calls, and preserve additional interfaces such as http.Pusher and http.Flusher.
This article introduces message queue middleware, explains its role in distributed systems for decoupling, asynchronous processing, traffic shaping, and log handling, and reviews typical use cases, architectural patterns, JMS models, and popular products such as ActiveMQ, RabbitMQ, ZeroMQ, and Kafka.
The article outlines UDDB’s roadmap from a MySQL‑compatible middleware to a full‑featured distributed database, detailing its three‑stage evolution, system architecture, SQL parsing and routing design, and innovative techniques that enable read‑write separation, vertical sharding, and future horizontal scaling.
This article explains Pandora.js's Service mechanism—a high-level process orchestration feature for Alibaba's Node.js applications—detailing its role in middleware management, standardized service lifecycles, isolated tasks, and an Etcd‑based service discovery example.
This tutorial walks you through setting up a Node.js environment, installing Koa, and progressively building a web application by covering basic HTTP services, context handling, response types, routing, middleware, error handling, cookies, form processing, and file uploads with clear code examples.
This article explains how to add lightweight middleware in a Node.js server that records the start time on the request object, listens for the response finish event, calculates the elapsed time with process.hrtime, and uses curl to verify the timing for different endpoints.
This article traces the evolution of Remote Procedure Call (RPC) from its early definitions in the 1970s through various middleware implementations like CORBA, Java RMI, Thrift, and gRPC, highlighting key concepts, criticisms, and modern developments in distributed systems.
This article explains the motivations behind database sharding, defines the concept, explores its historical background, discusses storage stretching, indexing and consistency challenges, and presents a practical sharding design example for transaction systems.
This article traces Alibaba's e‑commerce platform evolution from a simple LAMP stack through Java migration, distributed caching, custom middleware, and multi‑active global deployment, highlighting the technical challenges, solutions like HSF RPC, TDDL sharding, and the high‑availability practices that now power Alibaba Cloud services.
Redux is a JavaScript state container that enforces a single‑store, unidirectional data flow using actions, reducers and middleware, drawing on Flux, CQRS and event sourcing, and the article examines its core source files while offering best‑practice guidelines such as immutability, pure reducers, smart‑dumb component separation, and careful middleware use.
Enterprise information systems increasingly rely on integrating business processes, and this article proposes a novel approach that combines Service‑Oriented Architecture with Message‑Oriented Middleware, delivering a three‑tier MOM framework that enhances efficiency, reusability, cross‑platform support, and flexible configuration for seamless business workflow integration.
This article examines Alibaba’s multi‑phase “Five‑Color Stone” initiative, detailing how the integration of Taobao and Tmall product, transaction, and store systems created a shared‑service, service‑oriented architecture that underpins the company’s modern, scalable e‑commerce platform.
This article introduces the WSGI specification, explains how WSGI servers and applications interact, details the application interface and environment handling, and provides practical examples for processing GET and POST requests in Python, helping beginners build their own web frameworks.
The article explains the design, implementation, and operational benefits of a middleware component that dynamically adjusts log levels in Java services, helping large‑scale delivery platforms balance comprehensive debugging information with system performance and avoid catastrophic failures during peak traffic.
This article explains what middleware is, how Redux adopts the middleware pattern, demonstrates the flow of actions with and without middleware, shows how to implement custom middleware including logging and async handling, and presents the official applyMiddleware implementation with code examples.
Alibaba’s transformation from e‑commerce leader to tech powerhouse is highlighted by its Feitian middleware platform, a cloud‑based, highly available solution that supports diverse industries, enables massive transaction volumes, and exemplifies the evolution of large‑scale distributed architectures pioneered since Alibaba’s early IOE days.
This article explains Redux’s fundamental ideas—including the store, dispatch, subscribe, actions, reducers, and compose—while comparing it to Flux, illustrating code snippets, and preparing readers for the upcoming middleware discussion, all aimed at front‑end developers seeking a clear grasp of the data‑flow framework.
MTDDL, Meituan’s in‑house client‑side sharding middleware, was created to address rapid product‑database growth by offering dynamic data‑source routing, read‑write separation, distributed ID generation, configurable database‑and‑table sharding, connection‑pool management, SQL monitoring, and live configuration updates via annotations and extensible strategies.
This article recounts Alibaba's RocketMQ journey—from record‑breaking low‑latency performance during Double‑Eleven, through the challenges of open‑source donation, to its successful incubation at Apache and future plans for both community and commercial versions.
This article reviews the motivations behind NewSQL, outlines its three main classifications, examines the technical challenges such as memory storage, sharding, concurrency control, replication and crash recovery, and provides a discussion on its scalability and architectural trade‑offs.
This guide introduces Express, a Node.js web framework, covering its advantages, environment setup, a step‑by‑step demo project, directory layout, core concepts such as routing, middleware and template engines, and practical code examples to help beginners launch a functional server quickly.
The article recaps Meituan‑Dianping’s 10th Tech Salon where senior DBA Ping Zhong detailed the Atlas database middleware, explaining its three‑layer architecture, connection‑string simplification, load balancing, read/write separation, automated slave management, monitoring, sharding capabilities, current 87% deployment across services, and upcoming enhancements such as stronger SQL processing and distributed transaction support.
The article presents Pitcher, a Go‑implemented reverse‑proxy middleware, detailing its one‑core‑multiple‑routes architecture, callback‑based module model, hot‑configuration reload, graceful restart strategies, GC optimizations, service splitting, and various transport choices such as TCP/protobuf, UDP, and Unix domain sockets to achieve high‑performance, scalable traffic entry for Qunar.
This article provides a comprehensive update on how microservices, containers, and cloud‑native architectures are reshaping middleware, covering key concepts, frameworks, CI/CD pipelines, service discovery, dynamic configuration, scalability, resilience patterns, and integration platforms for modern enterprise IT.
This article provides a comprehensive overview of Alibaba's numerous open‑source projects, ranging from high‑performance service frameworks and databases to messaging middleware, frontend tools, testing platforms, and infrastructure utilities, highlighting their key features and typical use cases.
The article explains that effective application monitoring must focus on how apps interact with the data layer, especially relational databases, and shows how a middleware like OneProxy can transparently capture transaction metrics without invasive logging.
To support over 140 million monthly active users, Sina Weibo evolved from a simple LAMP stack to a sophisticated third‑generation architecture featuring layered interfaces, service and resource tiers, custom RPC and messaging frameworks, SSD caching, and a large‑scale distributed tracing system called WatchMan.
This article, derived from the Efficient Operations Community Talk, explains how thoughtful application design—covering startup time, node placement, data structures, middleware choices, and architecture—determines the true performance and stability benefits when deploying containers.
This article explains the design principles, architecture, and performance optimizations of Alibaba's Notify and MetaQ message middleware, illustrating how they achieve reliable asynchronous communication, high scalability, and low latency for billions of messages during peak e‑commerce events like Double 11.
