Tagged articles
57 articles
Page 1 of 1
Deepin Linux
Deepin Linux
Feb 2, 2026 · Fundamentals

Mastering Linux IPC: Pipes, Message Queues, Shared Memory, Semaphores, Signals & Sockets Explained

This comprehensive guide breaks down Linux inter‑process communication (IPC) by explaining its core concepts, why it’s needed, and detailing six mechanisms—pipes, named pipes, message queues, shared memory, semaphores/PV operations, signals, and sockets—complete with code samples, diagrams, and real‑world usage scenarios.

C programmingIPCLinux
0 likes · 49 min read
Mastering Linux IPC: Pipes, Message Queues, Shared Memory, Semaphores, Signals & Sockets Explained
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 30, 2025 · Backend Development

What’s New in Apache Kafka 4.1? Core Features and Architecture Changes Explained

Apache Kafka 4.1.0 introduces native queue semantics, a new Streams rebalancing protocol, multi‑version Connect plugins, a revamped consumer‑group protocol, enhanced transaction safety, and numerous client, monitoring, and security improvements, offering a comprehensive upgrade over the 4.0 release.

KafkaStreamingdistributed-systems
0 likes · 6 min read
What’s New in Apache Kafka 4.1? Core Features and Architecture Changes Explained
IT Services Circle
IT Services Circle
Oct 11, 2025 · Databases

Crack Backend Interviews: Redis, MySQL Locks, MQs & XiaoHongShu Salary Secrets

The article combines a surprising look at XiaoHongShu's record‑breaking graduate salaries with a comprehensive backend interview guide covering Redis advantages and drawbacks, common data structures, persistence and high‑availability, MySQL lock types, optimistic vs. pessimistic locking, message‑queue fundamentals, RabbitMQ vs. Kafka differences, deadlock avoidance, and a sample algorithm question.

Database LocksSalary Insightsbackend interview
0 likes · 19 min read
Crack Backend Interviews: Redis, MySQL Locks, MQs & XiaoHongShu Salary Secrets
Deepin Linux
Deepin Linux
Sep 15, 2025 · Fundamentals

Unlock Linux IPC: Deep Dive into Pipes, Signals, Shared Memory and More

This comprehensive guide explores Linux inter‑process communication (IPC), explaining why processes need to communicate, the underlying kernel mechanisms, and detailed coverage of pipes, FIFOs, signals, files, shared memory, message queues, and sockets with practical code examples and real‑world use cases.

IPCLinuxSockets
0 likes · 48 min read
Unlock Linux IPC: Deep Dive into Pipes, Signals, Shared Memory and More
G7 EasyFlow Tech Circle
G7 EasyFlow Tech Circle
Jun 12, 2025 · Backend Development

How G7 EasyFlow’s Low‑Code Data Sync Platform Boosts Efficiency and Reliability

The article details G7 EasyFlow's low‑code data synchronization platform, explaining its origins from massive integration demands, its architecture, core features such as high availability, high concurrency, fault‑tolerant mechanisms, low‑code scripting, distributed deployment, and how it streamlines multi‑system data consistency for enterprise customers.

Backend DevelopmentLow‑code platformdata synchronization
0 likes · 17 min read
How G7 EasyFlow’s Low‑Code Data Sync Platform Boosts Efficiency and Reliability
Full-Stack Internet Architecture
Full-Stack Internet Architecture
May 27, 2025 · Big Data

Understanding Event Streaming in Kafka: Core Concepts, Architecture, and Use Cases

This article explains Kafka's event streaming concept, detailing events and streams, core components such as producers, topics, partitions, consumers, persistence, and typical real‑time data pipeline, event‑driven architecture, stream processing, and log aggregation use cases, highlighting its role as a foundational big‑data infrastructure.

Event StreamingKafkaReal-time Processing
0 likes · 7 min read
Understanding Event Streaming in Kafka: Core Concepts, Architecture, and Use Cases
Liangxu Linux
Liangxu Linux
May 26, 2025 · Fundamentals

How Pipes, Named Pipes, and Message Queues Revolutionized Process Communication

From early 1970s Bell Labs' breakthrough of process isolation to the invention of in‑memory pipes, named pipes, and structured message queues, this article traces the evolution of inter‑process communication, highlighting design motivations, code structures, advantages, limitations, and the performance challenges that drove each innovation.

IPCOperating SystemsProcess Communication
0 likes · 8 min read
How Pipes, Named Pipes, and Message Queues Revolutionized Process Communication
DeWu Technology
DeWu Technology
Mar 26, 2025 · Fundamentals

Consistency Challenges and Solutions in Distributed Systems: CAP, BASE, RPC, and Messaging

To address consistency problems in distributed systems, the article explains CAP and BASE trade‑offs, shows how transactional RPC and messaging—using retries, RocketMQ two‑phase commits, Spring @TransactionalEventListener, or a local message log—can ensure atomic updates, and compares their reliability, latency, and performance impacts.

BASE theoryCAP theoremDistributed Consistency
0 likes · 12 min read
Consistency Challenges and Solutions in Distributed Systems: CAP, BASE, RPC, and Messaging
Java Tech Enthusiast
Java Tech Enthusiast
Dec 31, 2024 · Backend Development

Tencent Backend Interview Experience and Technical Knowledge Summary

The article details Tencent’s updated 15‑month compensation packages for 2025 backend roles, outlines a one‑hour interview covering OS process/thread concepts, sorting algorithms, MySQL storage engines and indexing, Redis data structures, Java collections, and compares RocketMQ with Kafka for reliable messaging.

Data StructuresInterview PreparationOperating Systems
0 likes · 27 min read
Tencent Backend Interview Experience and Technical Knowledge Summary
System Architect Go
System Architect Go
Dec 15, 2024 · Operations

A Structured Framework for Optimizing System Components

This article presents a comprehensive framework for optimizing system components such as databases, caches, message queues, and search engines, covering environment configuration, data structure organization, client‑side usage, and inter‑component collaboration, illustrated with MySQL, Redis, Kafka, and Elasticsearch examples.

SearchSystem optimizationcaching
0 likes · 6 min read
A Structured Framework for Optimizing System Components
Liangxu Linux
Liangxu Linux
Dec 11, 2024 · Fundamentals

Master Linux Inter‑Process Communication: Pipes, Signals, Shared Memory & More

This guide explains Linux inter‑process communication (IPC) mechanisms—including anonymous and named pipes, signals, file‑based communication, semaphores, various shared‑memory techniques, message queues, TCP/UDP sockets, and Unix domain sockets—providing concepts, typical use cases, and complete C code examples for each method.

IPCLinuxmessage queues
0 likes · 32 min read
Master Linux Inter‑Process Communication: Pipes, Signals, Shared Memory & More
MaGe Linux Operations
MaGe Linux Operations
Sep 10, 2024 · Backend Development

How Kafka Elects Leaders and Distributes Partitions: A Deep Dive

This article explains Kafka's leader election process, partition assignment strategy, distribution policies, file layout, and the evolution of consumer offset storage, providing a comprehensive overview of how Kafka ensures reliable and efficient message handling in a distributed environment.

Distributed SystemsKafkaPartition Assignment
0 likes · 5 min read
How Kafka Elects Leaders and Distributes Partitions: A Deep Dive
Architect
Architect
Jan 8, 2024 · Backend Development

RabbitMQ vs Kafka: Key Differences and When to Choose Each

This article compares RabbitMQ and Apache Kafka across dimensions such as message ordering, routing, timing, retention, fault handling, scalability, and consumer complexity, and provides practical guidance on which platform is better suited for specific architectural scenarios.

RabbitMQScalabilitySystem Architecture
0 likes · 16 min read
RabbitMQ vs Kafka: Key Differences and When to Choose Each
Architect
Architect
Jan 4, 2024 · Backend Development

RabbitMQ vs Kafka: How to Choose the Right Messaging System

This article explains asynchronous messaging patterns, compares RabbitMQ and Apache Kafka in depth, and provides a step‑by‑step decision guide that highlights their architectural differences, strengths, weaknesses, and suitable use‑cases for modern software systems.

Backend ArchitectureKafkaRabbitMQ
0 likes · 11 min read
RabbitMQ vs Kafka: How to Choose the Right Messaging System
Efficient Ops
Efficient Ops
Sep 24, 2023 · Big Data

Mastering Kafka: From Basics to Advanced Operations and Performance Tuning

This article provides a comprehensive overview of Apache Kafka, covering its architecture, core concepts such as topics, partitions, and replicas, common operational commands, and practical performance‑tuning tips for high‑throughput, low‑latency streaming workloads.

Distributed SystemsKafkaOperations
0 likes · 23 min read
Mastering Kafka: From Basics to Advanced Operations and Performance Tuning
Sanyou's Java Diary
Sanyou's Java Diary
Sep 21, 2023 · Big Data

Understanding Kafka: Core Concepts, Architecture, and Reliability Explained

This article provides a comprehensive overview of Kafka, covering its overall architecture, key components such as brokers, producers, consumers, topics, partitions, replicas, and ZooKeeper, as well as logical and physical storage mechanisms, producer and consumer workflows, configuration parameters, partition assignment strategies, rebalancing, and the replication model that ensures data reliability.

Data StreamingDistributed SystemsKafka
0 likes · 18 min read
Understanding Kafka: Core Concepts, Architecture, and Reliability Explained
FunTester
FunTester
Jun 19, 2023 · Big Data

Kafka Architecture and Core Concepts: Brokers, Producers, Consumers, Topics, Partitions, Replicas, and Reliability

This article provides a comprehensive overview of Kafka's architecture and fundamental concepts, covering its overall structure, key components such as brokers, producers, consumers, topics, partitions, replicas, leader‑follower synchronization, offset handling, message storage at both logical and physical layers, as well as producer and consumer workflows, partition assignment strategies, rebalancing, log management, zero‑copy I/O, and reliability mechanisms.

Distributed SystemsKafkaLog Management
0 likes · 22 min read
Kafka Architecture and Core Concepts: Brokers, Producers, Consumers, Topics, Partitions, Replicas, and Reliability
JD Retail Technology
JD Retail Technology
Apr 19, 2023 · Databases

Understanding Distributed Data Consistency: CAP, BASE, and Transaction Solutions

This article explains why achieving data consistency in modern distributed systems is challenging, reviews ACID properties of local databases, discusses the CAP and BASE theorems, examines event ordering mechanisms, and compares practical solutions such as two‑phase commit, XA, local message tables, and MQ‑based transaction models.

BASE theoremCAP theoremData Consistency
0 likes · 19 min read
Understanding Distributed Data Consistency: CAP, BASE, and Transaction Solutions
Tencent Cloud Middleware
Tencent Cloud Middleware
Dec 15, 2022 · Operations

Designing Pulsar Disaster Recovery: Multi‑Region Replication, Rack‑Aware Placement, and Dual‑Write Strategies

This article explains how Tencent engineers configure Apache Pulsar for disaster recovery, covering multi‑replica consistency, journal handling, rack‑aware placement, GEO cross‑region replication, dual‑write/dual‑consume setups, and operational lessons for ad and billing scenarios.

Apache PulsarRack Awarenessmessage queues
0 likes · 10 min read
Designing Pulsar Disaster Recovery: Multi‑Region Replication, Rack‑Aware Placement, and Dual‑Write Strategies
Programmer DD
Programmer DD
Sep 9, 2022 · Big Data

Why Kafka and Pulsar Lead the Distributed Streaming Landscape

This article introduces Apache Kafka and Apache Pulsar, compares their core features such as publish/subscribe messaging, storage, real‑time pipelines, and stream processing, outlines key characteristics like high throughput, scalability and fault tolerance, and explains fundamental concepts and architecture components unique to each platform.

Big DataDistributed StreamingKafka
0 likes · 14 min read
Why Kafka and Pulsar Lead the Distributed Streaming Landscape
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
May 1, 2022 · Backend Development

Real-Time Messaging with RabbitMQ and Spring Boot

This article demonstrates how to build a real‑time messaging system for a space‑station scenario using RabbitMQ and Spring Boot, covering configuration of direct and fanout exchanges, scheduling updates, one‑to‑one chat, and broadcast messaging with complete Java code examples.

Backend DevelopmentJavaRabbitMQ
0 likes · 14 min read
Real-Time Messaging with RabbitMQ and Spring Boot
IT Architects Alliance
IT Architects Alliance
Feb 13, 2022 · Big Data

Comprehensive Overview of Apache Kafka Architecture and Core Concepts

This article provides an in‑depth introduction to Apache Kafka, covering its distributed streaming platform fundamentals, message‑queue models, topic and partition design, broker and cluster roles, producer partitioning logic, reliability guarantees, consumer group assignors, offset management, and performance optimizations such as sequential disk writes and zero‑copy techniques.

Apache KafkaDistributed StreamingReliability
0 likes · 25 min read
Comprehensive Overview of Apache Kafka Architecture and Core Concepts
Wukong Talks Architecture
Wukong Talks Architecture
Dec 8, 2021 · Big Data

Understanding Kafka Core Concepts: Architecture, Messaging Models, Partitioning, Consumer Groups, and Reliability

This article provides a comprehensive overview of Kafka, covering its layered architecture with Zookeeper, core concepts such as topics, partitions and consumer groups, communication workflow, partition selection strategies, rebalancing mechanisms, reliability configurations, replica synchronization, and reasons for moving away from Zookeeper, all explained in clear English.

Distributed SystemsKafkaReliability
0 likes · 19 min read
Understanding Kafka Core Concepts: Architecture, Messaging Models, Partitioning, Consumer Groups, and Reliability
IT Architects Alliance
IT Architects Alliance
Dec 3, 2021 · Big Data

Comprehensive Overview of Apache Kafka Architecture and Core Concepts

This article provides an in‑depth technical guide to Apache Kafka, covering its distributed streaming architecture, core concepts such as topics, partitions, brokers, producers and consumers, reliability guarantees, storage mechanisms, configuration parameters, and consumer assignment strategies, supplemented with Java code examples.

Apache KafkaConsumerDistributed Streaming
0 likes · 24 min read
Comprehensive Overview of Apache Kafka Architecture and Core Concepts
Top Architect
Top Architect
Nov 19, 2021 · Big Data

Understanding Kafka’s Design: Topics, Partitions, Consumer Groups, and Cluster Architecture

This article explains Kafka’s core design concepts—including the role of a message system, topics, partitions, producers, consumers, consumer groups, replica management, controller coordination with Zookeeper, performance optimizations like sequential writes and zero‑copy, and its network thread model—illustrated with diagrams and code snippets.

Cluster ArchitectureKafkaconsumer groups
0 likes · 12 min read
Understanding Kafka’s Design: Topics, Partitions, Consumer Groups, and Cluster Architecture
Architects Research Society
Architects Research Society
Jul 30, 2021 · Fundamentals

RabbitMQ vs Apache Kafka: Messaging Patterns, Guarantees and Design Trade‑offs

This article compares RabbitMQ and Apache Kafka, explaining their core architectures, exchange and routing mechanisms, delivery guarantees, push vs pull models, dead‑letter handling, partitioning, consumer groups, log compaction, and the strengths and limitations of each system for scalable, ordered message processing.

KafkaMessaging SystemsRabbitMQ
0 likes · 21 min read
RabbitMQ vs Apache Kafka: Messaging Patterns, Guarantees and Design Trade‑offs
IT Architects Alliance
IT Architects Alliance
Jul 12, 2021 · Big Data

Kafka Core Concepts, Architecture, Performance Optimization, and Operational Practices

This article explains Kafka's fundamental principles, cluster architecture, data performance techniques such as zero‑copy and log segmentation, resource planning for high‑throughput scenarios, and provides practical operational commands and custom partitioning examples for reliable, high‑availability deployments.

Cluster DeploymentKafkamessage queues
0 likes · 32 min read
Kafka Core Concepts, Architecture, Performance Optimization, and Operational Practices
Tencent Cloud Middleware
Tencent Cloud Middleware
Jun 30, 2021 · Fundamentals

Understanding Apache Pulsar Transactions: Core Concepts and Workflow

Apache Pulsar 2.8.0 introduces transaction support, featuring a Transaction Coordinator, Transaction Buffer, Transaction Log, Transaction ID, and Pending Acknowledge State, with a detailed workflow that ensures exactly‑once semantics for stream processing, contrasting its design with Kafka’s approach.

Apache PulsarExactly-OnceKafka Comparison
0 likes · 13 min read
Understanding Apache Pulsar Transactions: Core Concepts and Workflow
Laravel Tech Community
Laravel Tech Community
May 21, 2021 · Backend Development

RabbitMQ Messaging Patterns and Exchange Types Overview

This article explains RabbitMQ's core messaging patterns—including simple, work queues, publish/subscribe, routing, topics, RPC, and publisher confirms—along with the four main exchange types, providing practical use‑case examples for each to help developers choose the appropriate pattern for their backend systems.

Backend DevelopmentDistributed SystemsMessaging
0 likes · 4 min read
RabbitMQ Messaging Patterns and Exchange Types Overview
Top Architect
Top Architect
Apr 25, 2021 · Backend Development

Seven RabbitMQ Messaging Patterns and Their Application Scenarios with Java Code Samples

This article introduces seven RabbitMQ messaging patterns—Simple, Work Queue, Publish/Subscribe, Routing, Topics, RPC, and Publisher Confirms—explains their typical use cases such as email delivery, order processing, cache synchronization, and provides complete Java code examples for each pattern.

Backend DevelopmentJavaMessaging Patterns
0 likes · 15 min read
Seven RabbitMQ Messaging Patterns and Their Application Scenarios with Java Code Samples
Big Data Technology & Architecture
Big Data Technology & Architecture
Apr 9, 2021 · Backend Development

Kafka 2.8 Introduces KRaft: Running Without ZooKeeper

Kafka 2.8 replaces ZooKeeper with an internal Quorum controller (KRaft), allowing users to run Kafka without external coordination, reducing resource usage, improving performance, and supporting larger clusters, while noting that some features like ACLs and partition reassignment are still pending.

Apache KafkaKRaftZooKeeper
0 likes · 4 min read
Kafka 2.8 Introduces KRaft: Running Without ZooKeeper
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jul 24, 2020 · Fundamentals

Common Interprocess Communication Methods in Linux

This article introduces several Linux interprocess communication mechanisms—including pipes, message queues, shared memory, semaphores, signals, and sockets—explaining their principles, advantages, drawbacks, and typical usage scenarios for developers preparing for system‑level programming or interviews.

IPCLinuxSockets
0 likes · 7 min read
Common Interprocess Communication Methods in Linux
ITPUB
ITPUB
Jun 22, 2020 · Backend Development

Essential Backend Development Tech Stack: Load Balancing, Microservices, Databases & More

This article provides a concise yet comprehensive overview of the backend development technology stack, covering load balancing, microservice ecosystems, RPC frameworks, service discovery, relational and NoSQL databases, caching strategies, message queues, object storage, and search engines, while highlighting practical configurations and real‑world trade‑offs.

Backend DevelopmentMicroservicesSearch
0 likes · 24 min read
Essential Backend Development Tech Stack: Load Balancing, Microservices, Databases & More
360 Quality & Efficiency
360 Quality & Efficiency
Aug 8, 2019 · Big Data

An Introduction to Kafka: Architecture, Design Principles, and Common Issues

This article introduces Kafka, covering its definition, core concepts such as topics, partitions, offsets, producers and consumers, typical use cases, underlying design principles including message‑partition allocation and retention policies, processing mechanisms, and common troubleshooting questions for real‑world deployments.

Big DataDistributed MessagingKafka
0 likes · 7 min read
An Introduction to Kafka: Architecture, Design Principles, and Common Issues
Programmer DD
Programmer DD
Dec 31, 2018 · Backend Development

Essential Spring Cloud Stream Resources: From Basics to Advanced Failure Handling

This curated list compiles essential Spring Cloud Stream articles covering quick start, core concepts, consumer groups and partitions, common FAQs, and four detailed failure‑handling strategies, providing developers with a handy reference to master message‑driven microservices.

Backend DevelopmentError HandlingMicroservices
0 likes · 3 min read
Essential Spring Cloud Stream Resources: From Basics to Advanced Failure Handling
Architecture Digest
Architecture Digest
Aug 29, 2017 · Big Data

Introduction to Apache Kafka: Concepts, Architecture, and Core APIs

This article provides a comprehensive overview of Apache Kafka, explaining its role in real‑time data pipelines and stream processing, describing key concepts such as topics, partitions, logs, producers, consumers, replication, guarantees, and how Kafka functions as both a messaging and storage system.

Consumer APIDistributed StreamingKafka
0 likes · 13 min read
Introduction to Apache Kafka: Concepts, Architecture, and Core APIs
21CTO
21CTO
Jan 8, 2017 · Backend Development

Unlocking High‑Availability: A Sneak Peek at the New Internet Architecture Series

The author announces a forthcoming series on Internet high‑availability architecture, outlining topics such as CAP theory, distributed caching, SOA, message queues, search systems, and real‑world case studies, and invites readers to suggest additional content while promising detailed, valuable guidance for developers and architects.

Distributed SystemsSoftware ArchitectureSystem Design
0 likes · 3 min read
Unlocking High‑Availability: A Sneak Peek at the New Internet Architecture Series
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Oct 22, 2016 · Backend Development

Inside Weibo’s Third-Gen Architecture: Scaling to 140M MAU

Facing over 140 million monthly active users, Weibo evolved from a LAMP stack to a sophisticated third‑generation architecture that separates interface, service, and resource layers horizontally and adds vertical dimensions of business, technology, monitoring, and governance, leveraging Java, SOA, custom RPC, message queues, SSD caching, and a distributed tracing system to ensure high availability and performance.

Backend DevelopmentService Architecturemessage queues
0 likes · 11 min read
Inside Weibo’s Third-Gen Architecture: Scaling to 140M MAU
Architect
Architect
Dec 9, 2015 · Backend Development

Message‑Based Distributed Architecture: Patterns, Applications, and Decision Guidelines

The article examines the fundamentals of message‑based distributed architecture, explains core messaging patterns such as Message Channel, Publisher‑Subscriber and Message Router, and provides practical application scenarios, technology‑selection criteria, and challenges for building robust enterprise integration solutions.

Backend DevelopmentIntegration PatternsRabbitMQ
0 likes · 32 min read
Message‑Based Distributed Architecture: Patterns, Applications, and Decision Guidelines
MaGe Linux Operations
MaGe Linux Operations
Apr 28, 2015 · Big Data

How LinkedIn Scales Kafka to Billions of Messages Every Day

This article explains how LinkedIn uses Apache Kafka as a high‑throughput, fault‑tolerant messaging backbone, detailing its architecture, message categories, layered replication, audit mechanisms, and the engineering practices that keep billions of daily messages reliable and fast.

Big DataDistributed SystemsKafka
0 likes · 11 min read
How LinkedIn Scales Kafka to Billions of Messages Every Day