BestHub
Sign in
Tagged articles
970 articles
Page 4 of 10
dbaplus Community
dbaplus Community
Nov 2, 2023 · Databases

Scaling a Ride‑Hailing Order System: From Single SQLServer to Sharded MySQL

This article recounts the step‑by‑step evolution of a ride‑hailing order service’s data layer—from a single SQLServer database through SQL optimization, read‑write splitting, business‑domain sharding, caching and MQ integration, to a custom sharding component and smooth migration to MySQL—highlighting challenges, solutions, and lessons learned.

Data MigrationMessage QueueMicroservices
0 likes · 15 min read
Scaling a Ride‑Hailing Order System: From Single SQLServer to Sharded MySQL
JD Cloud Developers
JD Cloud Developers
Oct 25, 2023 · Backend Development

Master Kafka: Core Concepts, Architecture, and Practical Tips

This article explains Kafka's fundamentals, including topics, partitions, brokers, replication, producer‑consumer workflow, consumer groups, offset management, and common exception handling, while providing code examples and diagrams to help developers understand and effectively use this distributed messaging system.

Distributed SystemsKafkaMessage Queue
0 likes · 21 min read
Master Kafka: Core Concepts, Architecture, and Practical Tips
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Oct 19, 2023 · Backend Development

Understanding RocketMQ Core Architecture and Its Role in High‑Concurrency Systems

This article explains the core components of RocketMQ—including NameServer, Broker, Producer, and Consumer—detailing their functions, deployment diagrams, and how the middleware supports high‑concurrency scenarios such as peak shaving, asynchronous messaging, fault tolerance, and system decoupling.

Backend ArchitectureDistributed SystemsMessage Queue
0 likes · 7 min read
Understanding RocketMQ Core Architecture and Its Role in High‑Concurrency Systems
Architecture & Thinking
Architecture & Thinking
Oct 17, 2023 · Backend Development

Boost Throughput with RocketMQ Batch Messaging: How and Why

This article explains why batch messaging in RocketMQ is crucial for high-throughput systems, outlines its characteristics and ideal scenarios, and provides complete Java code examples for sending and splitting large batches to improve performance and reduce downstream API calls.

Batch MessagingMessage QueuePerformance
0 likes · 7 min read
Boost Throughput with RocketMQ Batch Messaging: How and Why
Architect
Architect
Oct 13, 2023 · Backend Development

How to Implement Gray Release with RocketMQ: Step‑by‑Step Strategies

This article explains how to apply gray release techniques in RocketMQ by upgrading consumers, upgrading producers, and using consumer‑side filtering, tag filtering, and SQL92 filtering, providing concrete code examples, configuration steps, and trade‑off analysis for each approach.

Consumer FilteringMessage QueueRocketMQ
0 likes · 8 min read
How to Implement Gray Release with RocketMQ: Step‑by‑Step Strategies
Wukong Talks Architecture
Wukong Talks Architecture
Oct 13, 2023 · Backend Development

7 Common Message Queue Scenarios and Their Implementations

This article explains seven typical message‑queue use cases—including ordinary, ordered, delayed, transactional, trace, dead‑letter, and priority messages—detailing their business motivations, implementation challenges, and concrete code examples for Kafka, RocketMQ, Pulsar, and RabbitMQ.

Distributed SystemsKafkaMessage Queue
0 likes · 11 min read
7 Common Message Queue Scenarios and Their Implementations
Top Architect
Top Architect
Oct 11, 2023 · Backend Development

Netty TCP Client Demo with Spring Boot: Architecture, Implementation, and Testing

This article presents a complete Netty TCP client demo built with Spring Boot, detailing the project architecture, module layout, business flow, key code implementations—including a local BlockingQueue, message processing with Redis locks, client initialization, handler logic, and testing endpoints—providing a practical reference for backend developers.

Message QueueNettyTCP
0 likes · 21 min read
Netty TCP Client Demo with Spring Boot: Architecture, Implementation, and Testing
MaGe Linux Operations
MaGe Linux Operations
Oct 8, 2023 · Big Data

Understanding Kafka: Core Concepts, Architecture, and Performance Secrets

This article explains Kafka’s fundamental role as a message system, detailing topics, partitions, producers, consumers, replica management, consumer groups, the controller, Zookeeper coordination, and performance optimizations such as sequential writes, zero‑copy, log segmentation, and network design, providing a comprehensive overview for big‑data practitioners.

Big DataDistributed SystemsKafka
0 likes · 11 min read
Understanding Kafka: Core Concepts, Architecture, and Performance Secrets
Senior Tony
Senior Tony
Oct 8, 2023 · Backend Development

When Architecture Becomes Overkill: Real‑World Lessons on Over‑Design

The article recounts a series of real‑world anecdotes exposing how excessive architectural ambitions—such as needless microservice fragmentation, ubiquitous message‑queue usage, multi‑level caching, over‑engineered design patterns, and configuration‑driven code—lead to wasted resources, maintenance headaches, and fragile systems, urging a return to simplicity.

Configuration ManagementMessage QueueMicroservices
0 likes · 12 min read
When Architecture Becomes Overkill: Real‑World Lessons on Over‑Design
Practical DevOps Architecture
Practical DevOps Architecture
Oct 8, 2023 · Backend Development

Comprehensive RocketMQ Course: Source Code Deep Dive, Advanced Features, Performance Tuning, and Real‑World Projects

This course provides an in‑depth study of RocketMQ, covering its fundamentals, source‑code analysis, advanced features such as transactional and ordered messages, performance optimization, operational monitoring, and hands‑on projects that guide learners through installation, configuration, clustering, and integration with Spring Boot.

Distributed SystemsMessage QueuePerformance Optimization
0 likes · 4 min read
Comprehensive RocketMQ Course: Source Code Deep Dive, Advanced Features, Performance Tuning, and Real‑World Projects
Efficient Ops
Efficient Ops
Oct 7, 2023 · Big Data

Master Kafka Basics: Topics, Partitions, Producers, and Cluster Architecture

This article explains Kafka's role as a messaging system, covering core concepts such as topics, partitions, producers, consumers, messages, cluster architecture, replicas, consumer groups, controller coordination with Zookeeper, and performance optimizations like sequential writes and zero‑copy networking.

Big DataDistributed SystemsKafka
0 likes · 11 min read
Master Kafka Basics: Topics, Partitions, Producers, and Cluster Architecture
Architect
Architect
Oct 6, 2023 · Backend Development

Design and Implementation of QQ Reminder Subscription Push System

This article details the architecture, technical requirements, and implementation techniques—including hybrid push‑pull, heterogeneous storage, distributed scheduling, task chunking, and at‑least‑once delivery—used to build a high‑concurrency, reliable reminder notification service for QQ.

Distributed SchedulingMessage QueueMySQL
0 likes · 13 min read
Design and Implementation of QQ Reminder Subscription Push System
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Sep 30, 2023 · Backend Development

Mastering RabbitMQ Delayed and Priority Queues with Spring Boot

This guide explains how to implement delayed and priority queues in RabbitMQ 3.8 using Spring Boot 2.6, covering dead‑letter exchange configuration, message expiration, priority settings, code examples for sending and consuming messages, and practical considerations such as priority limits and ordering behavior.

Message QueueRabbitMQdelayed queue
0 likes · 8 min read
Mastering RabbitMQ Delayed and Priority Queues with Spring Boot
macrozheng
macrozheng
Sep 28, 2023 · Backend Development

Master RabbitMQ Integration in SpringBoot: From Theory to Real-World Code

This tutorial walks through RabbitMQ fundamentals, installation on macOS, core AMQP concepts, common exchange types, and step‑by‑step SpringBoot integration with code samples, while highlighting practical issues like connection leaks and the need for a connection pool.

IntegrationMessage QueueRabbitMQ
0 likes · 18 min read
Master RabbitMQ Integration in SpringBoot: From Theory to Real-World Code
Top Architect
Top Architect
Sep 25, 2023 · Backend Development

RabbitMQ vs Kafka: Detailed Comparison and When to Use Each

This article provides an in‑depth technical comparison of RabbitMQ and Apache Kafka, covering their core architectural differences, message ordering, routing, timing, retention, fault handling, scalability, consumer complexity, and offers guidance on selecting the appropriate platform for various backend scenarios.

KafkaMessage QueueRabbitMQ
0 likes · 18 min read
RabbitMQ vs Kafka: Detailed Comparison and When to Use Each
Wukong Talks Architecture
Wukong Talks Architecture
Sep 21, 2023 · Backend Development

Detecting and Preventing Message Loss in Kafka Message Queues

This article explains how to detect, diagnose, and prevent message loss in Kafka-based message queue systems by covering system decoupling, traffic control, data consistency challenges, producer, broker, and consumer issues, and offering configuration, monitoring, and operational best‑practice solutions.

Data ConsistencyDistributed SystemsKafka
0 likes · 12 min read
Detecting and Preventing Message Loss in Kafka Message Queues
ShiZhen AI
ShiZhen AI
Sep 19, 2023 · Backend Development

How RocketMQ Handles Concurrent and Ordered Message Consumption

This article explains RocketMQ's internal workflow for concurrent and ordered message consumption, covering thread‑pool configuration, pull‑message handling, request submission, execution steps, offset management, expired‑message cleanup, and answers common questions about batch retries and offset ordering.

Concurrent ConsumptionConsumeRequestMessage Queue
0 likes · 13 min read
How RocketMQ Handles Concurrent and Ordered Message Consumption
Sohu Tech Products
Sohu Tech Products
Sep 13, 2023 · Backend Development

Unlocking Redis Streams: How Radix Tree & Listpack Power Modern MQs

This article explains why using Redis List for a message queue is limited, introduces Redis Stream as a purpose‑built MQ with consumer groups, ACKs, and persistence, and dives into its internal Radix‑Tree and listpack structures, command usage, and memory‑saving techniques.

BackendListpackMessage Queue
0 likes · 14 min read
Unlocking Redis Streams: How Radix Tree & Listpack Power Modern MQs
360 Smart Cloud
360 Smart Cloud
Sep 13, 2023 · Backend Development

Introduction to Apache Pulsar Architecture and Features

This article introduces Apache Pulsar, an open‑source cloud‑native distributed messaging platform, detailing its storage‑compute separation architecture, multi‑tenant support, load balancing, fault tolerance, schema handling, functions, IO connectors, tiered storage, cross‑region replication, and operational commands for managing brokers, bookies, and namespaces.

Apache PulsarDistributed SystemsMessage Queue
0 likes · 20 min read
Introduction to Apache Pulsar Architecture and Features
Senior Tony
Senior Tony
Sep 12, 2023 · Backend Development

What Really Powers High‑Concurrency Systems? Practical Solutions Explained

This article breaks down real‑world high‑concurrency strategies—horizontal scaling, caching, Elasticsearch, sharding, message‑queue smoothing, and cellization—explaining when each applies, their trade‑offs, and practical tips for building scalable, reliable backend services.

BackendMessage QueueSystem Design
0 likes · 9 min read
What Really Powers High‑Concurrency Systems? Practical Solutions Explained
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 7, 2023 · Backend Development

Comprehensive Overview of Message Queues: Types, Core Concepts, and Comparison of Kafka, RocketMQ, and RabbitMQ

This article provides a detailed overview of popular message queue systems, explains their core concepts such as decoupling and eventual consistency, and compares the advantages and disadvantages of Kafka, RocketMQ, RabbitMQ, and other notable MQ solutions for high‑concurrency scenarios.

Backend ArchitectureDistributed SystemsKafka
0 likes · 7 min read
Comprehensive Overview of Message Queues: Types, Core Concepts, and Comparison of Kafka, RocketMQ, and RabbitMQ
MaGe Linux Operations
MaGe Linux Operations
Sep 4, 2023 · Databases

Why Redis Is So Fast: Features, Data Structures, and Real-World Use Cases

Redis is a high-performance, open-source in-memory key-value database offering rich data structures, persistence options, and advanced features like replication, clustering, and pub/sub, making it ideal for caching, counters, message queues, leaderboards, and session storage in demanding, high-concurrency applications.

Data StructuresIn-Memory DatabaseMessage Queue
0 likes · 9 min read
Why Redis Is So Fast: Features, Data Structures, and Real-World Use Cases
JD Tech
JD Tech
Aug 28, 2023 · Backend Development

Handling Large Payload Issues in JD Logistics: Causes, Impacts, and Mitigation Strategies

The article analyzes the root causes and system‑wide consequences of oversized messages in JD Logistics, explains middleware limits of JMQ and JSF, and presents design principles, code‑level checks, and practical mitigation techniques such as pagination, claim‑check pattern, batch sizing, and monitoring to prevent service outages.

JMQJSFMessage Queue
0 likes · 32 min read
Handling Large Payload Issues in JD Logistics: Causes, Impacts, and Mitigation Strategies
ITPUB
ITPUB
Aug 26, 2023 · Operations

When to Choose Kafka Over RabbitMQ? A Detailed Comparison

This article compares Kafka and RabbitMQ across scalability, durability, latency, data flow, ordering, reliability, persistence, extensibility, and complexity, then outlines ideal use cases for each and offers practical guidance on selecting the right message queue for a project.

ComparisonKafkaMessage Queue
0 likes · 8 min read
When to Choose Kafka Over RabbitMQ? A Detailed Comparison
Liangxu Linux
Liangxu Linux
Aug 23, 2023 · Fundamentals

Master Linux Process Creation & IPC: System Calls, Queues, Shared Memory, Sockets, Pipes, Semaphores

This guide explains what a process is, how it differs from a thread, various ways to create and terminate processes in Linux, and provides detailed examples of inter‑process communication mechanisms—including message queues, shared memory, UNIX domain sockets, pipes, and semaphores—complete with C code samples.

IPCLinuxMessage Queue
0 likes · 31 min read
Master Linux Process Creation & IPC: System Calls, Queues, Shared Memory, Sockets, Pipes, Semaphores
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 17, 2023 · Backend Development

Comprehensive Introduction to Message Queues

This article provides a thorough overview of message queues, covering their definition, core components, types (point‑to‑point and publish/subscribe), key characteristics such as asynchrony, loose coupling, distribution and reliability, selection criteria among popular MQ products, and typical application scenarios in high‑concurrency systems.

AsynchronousBackend ArchitectureDistributed Systems
0 likes · 9 min read
Comprehensive Introduction to Message Queues
FunTester
FunTester
Aug 10, 2023 · Backend Development

How QQ Music Scaled Its Comment System for Celebrity Live Events

This article details the architectural redesign of QQ Music's comment platform—migrating to MongoDB, introducing threaded comments, and employing caching and message‑queue decoupling—to handle massive read/write spikes during celebrity live‑drop events while maintaining high availability and performance.

Backend ArchitectureComment SystemMessage Queue
0 likes · 8 min read
How QQ Music Scaled Its Comment System for Celebrity Live Events
Tencent Cloud Developer
Tencent Cloud Developer
Aug 9, 2023 · Backend Development

Designing a High‑Availability Comment System for QQ Music: Architecture, Challenges, and Optimizations

QQ Music’s comment system was re‑engineered with a MongoDB backend, cache layer, asynchronous writes, split read/write services, priority queues and rate‑limiting, enabling it to endure celebrity‑driven traffic spikes, maintain data consistency, and deliver high‑availability, low‑latency user experiences.

Backend ArchitectureComment SystemMessage Queue
0 likes · 7 min read
Designing a High‑Availability Comment System for QQ Music: Architecture, Challenges, and Optimizations
Su San Talks Tech
Su San Talks Tech
Jul 26, 2023 · Operations

How to Quickly Sync Massive Third-Party Data with SFTP, Jobs, and Rate-Limiting

Learn a step‑by‑step strategy to synchronize millions of records from dozens of third‑party systems across all provinces, using SFTP for bulk transfers, standardized file formats, scheduled jobs, Redis‑based rate limiting, MQ‑driven ingestion, and data‑consistency checks, while addressing security and performance challenges.

Job SchedulingMessage QueueSFTP
0 likes · 12 min read
How to Quickly Sync Massive Third-Party Data with SFTP, Jobs, and Rate-Limiting
Su San Talks Tech
Su San Talks Tech
Jul 21, 2023 · Backend Development

Mastering RocketMQ Transaction Messages: Theory, Flow, and Real‑World Example

This article explains RocketMQ transaction messages by covering their use cases, underlying mechanisms, and a step‑by‑step implementation that demonstrates how to ensure eventual consistency between message production and local database transactions in distributed Java back‑end systems.

Distributed SystemsMessage QueueRocketMQ
0 likes · 8 min read
Mastering RocketMQ Transaction Messages: Theory, Flow, and Real‑World Example
Sohu Tech Products
Sohu Tech Products
Jul 19, 2023 · Backend Development

Understanding RocketMQ Consumption Logic in Version 4.9.x

This article provides a comprehensive walkthrough of RocketMQ 4.9.x consumption architecture, covering the four core roles, publish‑subscribe model, storage structures, load‑balancing, long‑polling, concurrent and ordered consumption flows, progress persistence, and retry mechanisms, with illustrative diagrams and code snippets.

ConsumerDistributed SystemsMessage Queue
0 likes · 28 min read
Understanding RocketMQ Consumption Logic in Version 4.9.x
21CTO
21CTO
Jul 15, 2023 · Backend Development

From ActiveMQ to Pulsar: The Evolution of Message Queues Explained

This article traces the development of message queues from early decoupling solutions like ActiveMQ and RabbitMQ, through high‑throughput designs such as Kafka and RocketMQ, to modern platform‑centric systems like Pulsar, while detailing core concepts, architecture diagrams, storage mechanisms and trade‑offs.

BackendKafkaMessage Queue
0 likes · 15 min read
From ActiveMQ to Pulsar: The Evolution of Message Queues Explained
macrozheng
macrozheng
Jul 4, 2023 · Backend Development

Ensuring Cache‑DB Consistency with Canal, RabbitMQ, and Redis in SpringBoot

This guide walks through building a SpringBoot architecture that updates MySQL first, deletes Redis cache asynchronously via Canal and RabbitMQ, resolves common Canal meta‑data mismatches, and configures manual RabbitMQ acknowledgments to guarantee reliable cache invalidation.

Cache ConsistencyCanalMessage Queue
0 likes · 12 min read
Ensuring Cache‑DB Consistency with Canal, RabbitMQ, and Redis in SpringBoot
政采云技术
政采云技术
Jun 29, 2023 · Backend Development

Understanding RocketMQ: Architecture, Modules, and Deployment Essentials

This article provides a comprehensive overview of RocketMQ, covering its origin, core concepts, component roles, cluster deployment architecture, workflow, feature details, persistence mechanisms, and cleanup policies, offering developers a solid foundation for using this high‑performance messaging middleware.

ApacheArchitectureDistributed Systems
0 likes · 18 min read
Understanding RocketMQ: Architecture, Modules, and Deployment Essentials
MaGe Linux Operations
MaGe Linux Operations
Jun 20, 2023 · Big Data

What Is Kafka? A Beginner’s Guide to Distributed Streaming and Messaging

Kafka is an open‑source, distributed streaming platform that uses a publish/subscribe message queue architecture to provide high‑throughput, fault‑tolerant real‑time data processing, featuring topics, partitions, replicas, consumer groups, and multiple APIs for producers, consumers, streams, connectors, and administration.

Big DataDistributed StreamingKafka
0 likes · 20 min read
What Is Kafka? A Beginner’s Guide to Distributed Streaming and Messaging
Sanyou's Java Diary
Sanyou's Java Diary
Jun 15, 2023 · Databases

Mastering Redis Pub/Sub: Channels, Patterns, and Real-World Use Cases

This article explains Redis Pub/Sub fundamentals, demonstrates channel‑based and pattern‑based subscription with command‑line examples, dives into the internal data structures that power them, and shows how to integrate Redis Pub/Sub in Spring Boot using Redisson for lightweight messaging.

Message Queuedatabasespub/sub
0 likes · 14 min read
Mastering Redis Pub/Sub: Channels, Patterns, and Real-World Use Cases
Sanyou's Java Diary
Sanyou's Java Diary
Jun 12, 2023 · Backend Development

Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies

This article walks through RocketMQ 4.9.x’s consumption architecture, explaining the roles of NameServer, Broker, Producer and Consumer, the publish‑subscribe model, storage structures, load‑balancing algorithms, long‑polling, concurrent and ordered consumption, progress persistence, and the built‑in retry mechanism.

ConsumerDistributed SystemsMessage Queue
0 likes · 28 min read
Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies
Architect's Guide
Architect's Guide
Jun 6, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning

This article provides a comprehensive overview of Kafka, covering its core value for decoupling and asynchronous processing, fundamental concepts such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, detailed resource evaluation for CPU, memory, disk and network, operational tools, consumer‑group rebalance strategies, LEO/HW offsets, controller management, and delayed‑task scheduling.

BackendCluster PlanningKafka
0 likes · 29 min read
Kafka Core Concepts, Architecture, Performance Tuning, and Cluster Capacity Planning
Top Architect
Top Architect
Jun 5, 2023 · Big Data

Deep Dive into Kafka’s High Reliability and High Performance Mechanisms

This article comprehensively explores Kafka’s core concepts, architecture, and the techniques it employs—such as ack strategies, replica synchronization, high‑watermark, leader‑epoch, zero‑copy, batch sending, compression, and reactor‑based networking—to achieve both strong reliability and high throughput in distributed messaging systems.

Distributed SystemsKafkaMessage Queue
0 likes · 31 min read
Deep Dive into Kafka’s High Reliability and High Performance Mechanisms
php Courses
php Courses
May 18, 2023 · Backend Development

RabbitMQ Message Queue Course: Introduction, Installation, PHP Integration, and TP6 Practical Implementation

This course covers an introduction to message queues and their use cases, detailed RabbitMQ concepts and installation, various PHP RabbitMQ patterns including simple, worker, fanout, direct, and topic modes, as well as dead‑letter and delayed queues, culminating in a TP6 practical implementation.

BackendMessage QueueRabbitMQ
0 likes · 3 min read
RabbitMQ Message Queue Course: Introduction, Installation, PHP Integration, and TP6 Practical Implementation
php Courses
php Courses
May 18, 2023 · Backend Development

Implementing Message Queues with PHP and RabbitMQ

This article explains how to set up a PHP development environment, install RabbitMQ and its dependencies, and provides complete producer and consumer code examples to create a simple "Hello World" message queue using RabbitMQ's AMQP protocol.

AMQPAsynchronousBackend
0 likes · 7 min read
Implementing Message Queues with PHP and RabbitMQ
WeChat Backend Team
WeChat Backend Team
May 17, 2023 · Big Data

Boosting Real-Time Recommendations: Apache Pulsar Optimizations at WeChat

This article details how WeChat's Gemini‑2.0 big‑data platform leverages Apache Pulsar, outlining cloud‑native advantages, load‑balancing refinements, cache and SSD tuning, high‑availability safeguards, and cost‑saving strategies that together enable large‑scale, real‑time, deep‑learning recommendation workloads.

Apache PulsarBig DataCloud Native
0 likes · 17 min read
Boosting Real-Time Recommendations: Apache Pulsar Optimizations at WeChat
Top Architect
Top Architect
May 15, 2023 · Backend Development

Comprehensive Guide to Kafka: Architecture, Performance Tuning, and Operational Practices

This article provides an in-depth overview of Kafka, covering its core value as a message queue, fundamental concepts, cluster architecture, producer and consumer configurations, scaling strategies, monitoring tools, and practical operational commands for building and maintaining high‑throughput, highly available streaming systems.

BackendKafkaMessage Queue
0 likes · 31 min read
Comprehensive Guide to Kafka: Architecture, Performance Tuning, and Operational Practices
Top Architect
Top Architect
May 6, 2023 · Backend Development

Netty TCP Client Demo with Spring Boot: Architecture, Message Queue, and Complete Code Walkthrough

An in‑depth tutorial demonstrates building a Netty‑based TCP client with Spring Boot, covering project architecture, module layout, message‑queue simulation, detailed Java code for client creation, connection handling, and testing endpoints, providing a complete, production‑ready demo for IoT socket communication.

BackendMessage QueueNetty
0 likes · 26 min read
Netty TCP Client Demo with Spring Boot: Architecture, Message Queue, and Complete Code Walkthrough
ITPUB
ITPUB
May 2, 2023 · Backend Development

Four Ways to Sync MySQL Data to Elasticsearch – Pros, Cons, and Tools

This article compares four common approaches for synchronizing MySQL data to Elasticsearch—synchronous dual write, asynchronous dual write via message queues, scheduled tasks, and binlog‑based data subscription—detailing their advantages, drawbacks, implementation steps, and tool choices such as Canal, Maxwell, and Python‑MySQL‑Replication.

CanalElasticsearchMessage Queue
0 likes · 6 min read
Four Ways to Sync MySQL Data to Elasticsearch – Pros, Cons, and Tools
Top Architect
Top Architect
Apr 30, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance, and Operational Practices

This article provides a comprehensive overview of Kafka, covering its core value as a message queue, fundamental concepts, cluster architecture, log storage mechanisms, zero‑copy data transfer, high‑throughput and high‑availability design, consumer group behavior, rebalance strategies, and practical operational commands for managing topics, partitions, and offsets.

BackendDistributed SystemsKafka
0 likes · 31 min read
Kafka Core Concepts, Architecture, Performance, and Operational Practices
Architecture Digest
Architecture Digest
Apr 23, 2023 · Backend Development

Kafka Core Concepts, Architecture, Performance Optimizations, and Production Deployment Guide

This article provides a comprehensive technical overview of Kafka, covering its core message‑queue value, architecture components such as producers, consumers, topics, partitions and replication, high‑performance mechanisms like zero‑copy and OS cache, resource planning for disks, memory, CPU and network, operational tools and commands, consumer‑group management, rebalance strategies, and internal scheduling mechanisms such as the time‑wheel.

Backend ArchitectureDistributed SystemsKafka
0 likes · 30 min read
Kafka Core Concepts, Architecture, Performance Optimizations, and Production Deployment Guide
Big Data Technology Architecture
Big Data Technology Architecture
Apr 22, 2023 · Big Data

Deep Dive into Kafka’s High Reliability and High Performance Mechanisms

This article comprehensively explores Kafka’s core architecture, explaining how asynchronous decoupling and traffic shaping are achieved, detailing the roles of producers, brokers, consumers, and ZooKeeper, and analyzing the reliability and performance techniques such as ACK policies, replication, idempotent and transactional producers, page‑cache flushing, zero‑copy, compression, batching, and load‑balancing strategies.

Distributed SystemsMessage QueueReliability
0 likes · 31 min read
Deep Dive into Kafka’s High Reliability and High Performance Mechanisms
Wukong Talks Architecture
Wukong Talks Architecture
Apr 15, 2023 · Backend Development

Design and Implementation of RocketMQ Tiered Storage

The article explains how RocketMQ 5.1.0 introduces a tiered storage module that offloads messages to cheaper media, describes its design, architecture layers, quick‑start configuration, upload and read mechanisms, prefetch cache, fault recovery, current development plans, and remaining challenges.

Message QueueRocketMQtiered storage
0 likes · 13 min read
Design and Implementation of RocketMQ Tiered Storage
Tencent Cloud Middleware
Tencent Cloud Middleware
Apr 13, 2023 · Fundamentals

RocketMQ, Kafka, Pulsar: Core Concepts, Architecture & Transactional Messaging

This article provides a comprehensive overview of major message‑queue middleware—including RocketMQ, Kafka, Pulsar, and RabbitMQ—covering fundamental concepts such as tags, groups, offsets, architectural components, storage mechanisms, transaction workflows, rebalance strategies, and recent developments, while comparing their features and performance characteristics.

ArchitectureKafkaMessage Queue
0 likes · 19 min read
RocketMQ, Kafka, Pulsar: Core Concepts, Architecture & Transactional Messaging
Code Ape Tech Column
Code Ape Tech Column
Apr 11, 2023 · Backend Development

Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ

This article provides a detailed side‑by‑side comparison of five popular message‑queue systems—Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ—covering documentation, programming languages, supported protocols, storage, transactions, load balancing, clustering, management UI, availability, duplication handling, throughput, subscription models, ordering, acknowledgments, replay, retry, concurrency, and includes promotional information from the author.

ActiveMQComparisonKafka
0 likes · 24 min read
Comprehensive Comparison of Kafka, RabbitMQ, ZeroMQ, RocketMQ, and ActiveMQ
IT Architects Alliance
IT Architects Alliance
Apr 11, 2023 · Backend Development

How to Build a High‑Performance Flash‑Sale System: Architecture & Best Practices

This article outlines a comprehensive flash‑sale system architecture covering front‑end separation, Nginx static handling, traffic shaping, Redis caching and locking, message‑queue throttling, database sharding, and captcha mechanisms to achieve high concurrency while ensuring security and reliability.

Message QueueNGINXSystem Architecture
0 likes · 11 min read
How to Build a High‑Performance Flash‑Sale System: Architecture & Best Practices
Selected Java Interview Questions
Selected Java Interview Questions
Apr 7, 2023 · Backend Development

Designing a High‑Concurrency Flash Sale (秒杀) System Architecture

This article explains the architecture of a flash‑sale system from seven dimensions, covering characteristics, overall design, peak‑limiting, security, page optimization, asynchronous processing, hotspot isolation, Nginx configuration, Redis clustering, message‑queue throttling, database design, and captcha mechanisms to handle massive concurrent requests.

Message QueueSystem Architectureflash sale
0 likes · 11 min read
Designing a High‑Concurrency Flash Sale (秒杀) System Architecture
360 Quality & Efficiency
360 Quality & Efficiency
Apr 7, 2023 · Backend Development

RabbitMQ Introduction: Installation, Basic and Advanced Producer/Consumer Patterns, Exchanges, and Common Issues

This guide introduces RabbitMQ, explains how to install it with Docker, covers basic and advanced producer/consumer usage including acknowledgments, durability, QoS, bindings, and exchange types, and discusses a typical Python reconnection problem, providing a practical overview for backend developers.

DockerExchangeMessage Queue
0 likes · 5 min read
RabbitMQ Introduction: Installation, Basic and Advanced Producer/Consumer Patterns, Exchanges, and Common Issues
dbaplus Community
dbaplus Community
Apr 3, 2023 · Operations

How to Guarantee Zero Message Loss in Kafka: Practical Detection and Prevention Strategies

This article explains why MQ middleware like Kafka is introduced for system decoupling and traffic control, outlines the three key challenges of message loss detection, loss points, and prevention, and provides detailed configurations, monitoring tips, and code examples to ensure reliable, loss‑free message delivery.

ConsumerData ConsistencyKafka
0 likes · 12 min read
How to Guarantee Zero Message Loss in Kafka: Practical Detection and Prevention Strategies
Sanyou's Java Diary
Sanyou's Java Diary
Apr 3, 2023 · Backend Development

How RocketMQ’s Storage Model Powers Fast Message Retrieval

This article breaks down RocketMQ’s storage architecture, explaining how its commitlog, consumequeue, and index files work together to ensure reliable persistence, quick offset-based lookups, and efficient message consumption in a publish‑subscribe model.

CommitLogConsumeQueueIndexFile
0 likes · 9 min read
How RocketMQ’s Storage Model Powers Fast Message Retrieval
Code Ape Tech Column
Code Ape Tech Column
Mar 30, 2023 · Backend Development

How to Ensure No Message Loss in MQ Systems – Interview Guide and Practical Solutions

This article explains the common interview question of guaranteeing 100% message reliability in MQ middleware such as Kafka or RabbitMQ, outlines the three lifecycle stages of a message, discusses detection mechanisms, id generation, idempotent consumption, and handling message backlog, providing concrete design patterns and practical examples.

Distributed SystemsIdempotencyKafka
0 likes · 12 min read
How to Ensure No Message Loss in MQ Systems – Interview Guide and Practical Solutions
Laravel Tech Community
Laravel Tech Community
Mar 22, 2023 · Backend Development

Designing a High-Concurrency Flash Sale System Architecture

This article explains the key characteristics of flash‑sale (秒杀) business and presents a comprehensive backend architecture—including Nginx, CDN, gateway, Redis, MQ, asynchronous processing, hotspot isolation, and database strategies—to handle massive simultaneous requests while ensuring performance, reliability, and security.

Message QueueSystem Architectureflash sale
0 likes · 11 min read
Designing a High-Concurrency Flash Sale System Architecture
Su San Talks Tech
Su San Talks Tech
Mar 22, 2023 · Backend Development

Why Does RocketMQ Duplicate Message Consumption? Root Causes Explained

This article examines the various reasons why RocketMQ can deliver the same message to consumers multiple times, covering send‑retry mechanisms, consumer‑side exceptions, offset commit and persistence failures, master‑slave synchronization issues, rebalance events, and long‑processing cleanup, and offers guidance on designing idempotent solutions.

Duplicate ConsumptionMessage QueueOffset Management
0 likes · 15 min read
Why Does RocketMQ Duplicate Message Consumption? Root Causes Explained
JD Retail Technology
JD Retail Technology
Mar 2, 2023 · Databases

Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization

This article details the architectural evolution of JD's VOP message warehouse, describing the challenges of massive data volumes, the transition from V1.0 to V3.0+ through database sharding, MongoDB adoption, traffic governance, stability improvements, and cost reduction strategies, while presenting performance metrics and future outlook.

Message QueueMongoDBPerformance Optimization
0 likes · 17 min read
Evolution of JD VOP Message Warehouse: From V1.0 to V3.0+ with Database Sharding and Performance Optimization
Sanyou's Java Diary
Sanyou's Java Diary
Feb 27, 2023 · Backend Development

11 Ways to Implement Delayed Tasks in Java – From DelayQueue to Redis and MQ

This article surveys eleven practical techniques for implementing delayed tasks in Java, covering JDK utilities like DelayQueue, Timer, and ScheduledThreadPoolExecutor, as well as message‑queue solutions such as RocketMQ, RabbitMQ, Redis key‑expiration, Redisson, Netty, Hutool, Quartz, and simple polling, with code demos and implementation principles.

Message QueueSchedulingdelayed tasks
0 likes · 26 min read
11 Ways to Implement Delayed Tasks in Java – From DelayQueue to Redis and MQ
Su San Talks Tech
Su San Talks Tech
Feb 24, 2023 · Backend Development

Why We’re Dropping RabbitMQ for Kafka: A Complete Migration Blueprint

Facing chaotic usage, maintenance challenges, partition tolerance issues, and performance bottlenecks with RabbitMQ, our middleware team decided to fully migrate to Kafka, outlining reasons, comparative models, migration strategies, and verification steps to ensure a smooth, high‑availability, high‑performance transition.

BackendKafkaMessage Queue
0 likes · 13 min read
Why We’re Dropping RabbitMQ for Kafka: A Complete Migration Blueprint
Java High-Performance Architecture
Java High-Performance Architecture
Feb 22, 2023 · Backend Development

8 Powerful Ways to Implement Asynchronous Programming in Java

This article explores eight Java asynchronous programming techniques—from raw threads and Future to CompletableFuture, Spring @Async, event-driven approaches, message queues, Hutool ThreadUtil, and Guava ListenableFuture—detailing their concepts, advantages, limitations, and providing complete code examples for each.

AsynchronousCompletableFutureFuture
0 likes · 14 min read
8 Powerful Ways to Implement Asynchronous Programming in Java
MaGe Linux Operations
MaGe Linux Operations
Feb 18, 2023 · Backend Development

8 Powerful Ways to Implement Asynchronous Programming in Java

This article explains why asynchronous execution improves latency in common scenarios like sending SMS or emails, and presents eight Java techniques—including threads, Future, CompletableFuture, Spring @Async, ApplicationEvent, message queues, third‑party utilities, and Guava—to implement robust asynchronous programming.

CompletableFutureFutureMessage Queue
0 likes · 14 min read
8 Powerful Ways to Implement Asynchronous Programming in Java
Tencent Cloud Middleware
Tencent Cloud Middleware
Feb 15, 2023 · Cloud Native

Tencent Cloud’s Secrets to Scaling Apache Pulsar: Stability & Performance Hacks

This article details Tencent Cloud's year‑long production experience with Apache Pulsar, covering why Pulsar was chosen over Kafka, deep dives into Ack hole handling, TTL/Backlog/Retention strategies, zk‑node and ledger leaks, cache optimizations, and concrete code snippets that illustrate the stability and performance improvements.

Apache PulsarCloud NativeMessage Queue
0 likes · 18 min read
Tencent Cloud’s Secrets to Scaling Apache Pulsar: Stability & Performance Hacks
ITPUB
ITPUB
Feb 12, 2023 · Backend Development

Uncovering RocketMQ Sync Lag: Why Messages Reach the Broker but Not the Consumer

A detailed investigation reveals that RocketMQ can report successful writes to the broker while consumers see minutes‑long delays because the transient store pool and commit‑log forwarding mechanisms delay the transfer of messages from the broker’s memory to the consumer queue.

Lag DiagnosisMessage QueueRocketMQ
0 likes · 10 min read
Uncovering RocketMQ Sync Lag: Why Messages Reach the Broker but Not the Consumer
Architect
Architect
Feb 4, 2023 · Backend Development

Understanding the Consumer Startup Process in RocketMQ (Pull Mode)

This article explains RocketMQ's consumer startup process in pull mode, detailing the underlying push‑like implementation, configuration validation, instance naming, client initialization, load‑balancing, wrapper handling, offset storage, scheduled tasks, and trace dispatching, accompanied by Java code examples.

ConsumerMessage QueuePull Mode
0 likes · 11 min read
Understanding the Consumer Startup Process in RocketMQ (Pull Mode)
Su San Talks Tech
Su San Talks Tech
Feb 1, 2023 · Backend Development

How to Sync MySQL Data to Elasticsearch: 4 Practical Strategies

This article explores four common approaches for synchronizing product data from MySQL to Elasticsearch in e‑commerce systems—synchronous dual write, asynchronous dual write with message queues, scheduled tasks, and binlog‑based data subscription—detailing their advantages, drawbacks, and implementation considerations.

CanalElasticsearchMessage Queue
0 likes · 7 min read
How to Sync MySQL Data to Elasticsearch: 4 Practical Strategies
macrozheng
macrozheng
Jan 31, 2023 · Backend Development

How to Sync MySQL Data to Elasticsearch: 4 Practical Strategies

This article explores four common approaches for synchronizing product data from MySQL to Elasticsearch—including synchronous dual writes, asynchronous messaging, scheduled jobs, and binlog‑based data subscription—detailing their advantages, drawbacks, and implementation considerations for e‑commerce search systems.

ElasticsearchMessage QueueMySQL
0 likes · 6 min read
How to Sync MySQL Data to Elasticsearch: 4 Practical Strategies
ITPUB
ITPUB
Jan 30, 2023 · Backend Development

How to Keep MySQL and Elasticsearch in Sync: 4 Practical Strategies

This article examines four common approaches for synchronizing product data from MySQL to Elasticsearch—synchronous dual write, asynchronous dual write with message queues, scheduled batch jobs, and binlog‑based data subscription—detailing their advantages, drawbacks, and implementation considerations.

CanalElasticsearchMessage Queue
0 likes · 6 min read
How to Keep MySQL and Elasticsearch in Sync: 4 Practical Strategies
Cognitive Technology Team
Cognitive Technology Team
Jan 19, 2023 · Databases

Implementation Principles of Redis Pub/Sub (Ordinary Subscription)

This article explains how Redis implements the Pub/Sub messaging pattern by storing subscription relationships in hash‑based dictionaries, detailing the processing flow of SUBSCRIBE and PUBLISH commands, cluster propagation, and key limitations such as lack of persistence and client buffer constraints.

Message Queuedatabasespub/sub
0 likes · 5 min read
Implementation Principles of Redis Pub/Sub (Ordinary Subscription)
Code Ape Tech Column
Code Ape Tech Column
Jan 18, 2023 · Backend Development

Eight Ways to Implement Asynchronous Execution in Java

This article introduces eight practical techniques for achieving asynchronous processing in Java—including raw threads, Future, CompletableFuture, Spring @Async, ApplicationEvent, message queues, Hutool ThreadUtil, and Guava ListenableFuture—complete with code examples and discussion of their advantages and limitations.

AsynchronousFutureGuava
0 likes · 14 min read
Eight Ways to Implement Asynchronous Execution in Java
macrozheng
macrozheng
Jan 13, 2023 · Backend Development

Mastering Disruptor: Build a High‑Performance Java Message Queue in 8 Steps

This article introduces the Disruptor library, explains its core concepts such as Ring Buffer, Sequencer, and Wait Strategy, and provides a complete eight‑step Spring Boot example with code to create, publish, and consume high‑throughput messages in Java.

DisruptorMessage Queueconcurrency
0 likes · 12 min read
Mastering Disruptor: Build a High‑Performance Java Message Queue in 8 Steps
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 10, 2023 · Backend Development

Key Differences Between RPC and Message Queues (MQ) in Distributed Systems

This article explains the core distinctions between Remote Procedure Call (RPC) and Message Queue (MQ) technologies, covering their architectures, communication patterns, functional features, and performance considerations, and outlines typical use cases such as synchronous calls, decoupling, traffic shaping, and asynchronous processing in distributed systems.

Distributed SystemsMessage QueueMicroservices
0 likes · 6 min read
Key Differences Between RPC and Message Queues (MQ) in Distributed Systems
Sanyou's Java Diary
Sanyou's Java Diary
Jan 9, 2023 · Backend Development

Unveiling the Full Lifecycle of a RocketMQ Message: From Production to Deletion

This article walks through every stage of a RocketMQ message—how producers create and route messages, the storage mechanisms and zero‑copy techniques used by brokers, high‑availability modes, consumption models, ordering guarantees, and the automatic cleanup policies that finally retire messages.

Message QueueRocketMQhigh availability
0 likes · 26 min read
Unveiling the Full Lifecycle of a RocketMQ Message: From Production to Deletion
Top Architect
Top Architect
Jan 5, 2023 · Backend Development

Design and Architecture of a One‑to‑One Instant Messaging System

This article analyzes the functional decomposition, data structures, system architecture, push‑pull mode selection, and message flow of a one‑to‑one instant messaging service, providing practical design guidelines and example Redis/MySQL schemas for building a scalable chat backend.

Backend ArchitectureInstant MessagingMessage Queue
0 likes · 13 min read
Design and Architecture of a One‑to‑One Instant Messaging System
Java High-Performance Architecture
Java High-Performance Architecture
Dec 29, 2022 · Backend Development

Why Message Queues Are Essential: Decoupling, Asynchrony, and Pitfalls Explained

This article explains why message queues are used to decouple services, enable asynchronous processing, smooth traffic spikes, and improve performance, while also detailing the new challenges they introduce such as reduced availability, increased complexity, duplicate consumption, data consistency, message loss, ordering, and backlog, along with practical solutions for each issue.

Backlog ManagementData ConsistencyDecoupling
0 likes · 18 min read
Why Message Queues Are Essential: Decoupling, Asynchrony, and Pitfalls Explained
Architecture & Thinking
Architecture & Thinking
Dec 28, 2022 · Backend Development

Ensuring Idempotency in Message Queues: Strategies for Reliable Messaging

This article explains the concept of idempotency, illustrates why repeated operations must yield identical results, and details how RocketMQ’s components—NameServer, Broker, Producer, and Consumer—can be designed with unique message IDs and acknowledgment mechanisms to achieve reliable, duplicate‑free messaging in backend systems.

BackendDistributed SystemsIdempotency
0 likes · 10 min read
Ensuring Idempotency in Message Queues: Strategies for Reliable Messaging
Alibaba Cloud Native
Alibaba Cloud Native
Dec 27, 2022 · Cloud Native

Contribute to Apache RocketMQ 5.0 SDK: New Cloud‑Native Features & How‑to Guide

Apache RocketMQ 5.0 introduces a stateless proxy, gRPC‑based multi‑language SDK with immutable APIs, enhanced error handling, SimpleConsumer, and pop consumption, and the article outlines the technical improvements, roadmap, and step‑by‑step guide for developers to set up the environment, understand the new protocols, and contribute language client implementations.

Cloud NativeMessage QueueOpen-source
0 likes · 8 min read
Contribute to Apache RocketMQ 5.0 SDK: New Cloud‑Native Features & How‑to Guide
Su San Talks Tech
Su San Talks Tech
Dec 20, 2022 · Backend Development

Master RabbitMQ: From Core Concepts to Real‑World Implementation

This comprehensive guide walks you through RabbitMQ fundamentals, deployment on macOS, core concepts such as exchanges and routing, detailed code examples for producers and consumers in Java, and advanced features like TTL, dead‑letter queues, and manual acknowledgments, helping you bridge theory and practice in message‑queue systems.

AMQPBackendMessage Queue
0 likes · 36 min read
Master RabbitMQ: From Core Concepts to Real‑World Implementation
Code Ape Tech Column
Code Ape Tech Column
Dec 20, 2022 · Backend Development

Building a High‑Availability RocketMQ Cluster (Version 4.9.4)

This tutorial explains why message queues are essential, compares popular MQ products, details RocketMQ's core components, and provides step‑by‑step instructions—including environment setup, broker configuration, firewall rules, and monitoring—to deploy a fault‑tolerant RocketMQ cluster on CentOS 7.

BackendClusterMessage Queue
0 likes · 23 min read
Building a High‑Availability RocketMQ Cluster (Version 4.9.4)