Tagged articles
12 articles
Page 1 of 1
Alibaba Cloud Native
Alibaba Cloud Native
Oct 20, 2024 · Backend Development

How Adaptive K‑Value Backoff Locks Boost RocketMQ Performance by Up to 38%

A recent CCF‑A conference paper reveals that an adaptive K‑value backoff lock, derived from queueing theory and implemented in Apache RocketMQ, can replace both spin and mutex locks, achieving up to 37.58% performance gains on x86 CPUs and 32.82% on ARM while reducing CPU usage and resource consumption.

RocketMQbackend systemshigh concurrency
0 likes · 7 min read
How Adaptive K‑Value Backoff Locks Boost RocketMQ Performance by Up to 38%
Baobao Algorithm Notes
Baobao Algorithm Notes
Jul 11, 2024 · Artificial Intelligence

Why Separate Prefill and Decode? A Deep Dive into DistServe’s Split Inference Architecture

This article explores the two‑stage LLM inference pipeline, introduces TTFT and TPOT metrics, explains the motivation for prefilling‑decoding separation, presents experimental comparisons between split and merged architectures, and details optimization techniques and parallel‑strategy modeling for DistServe.

DistServeGoodputLLM inference
0 likes · 28 min read
Why Separate Prefill and Decode? A Deep Dive into DistServe’s Split Inference Architecture
Model Perspective
Model Perspective
Sep 29, 2023 · Operations

Why Holiday Traffic Jams Triple Travel Time: A Mathematical Model

Using queueing theory and traffic flow equations, this article builds a mathematical model to explain why travel times during the Mid‑Autumn and National Day holidays can be three times longer than normal, analyzing highway speed, vehicle density, entry/exit delays, and sensitivity of key parameters.

Operations Researchholiday congestionqueueing theory
0 likes · 12 min read
Why Holiday Traffic Jams Triple Travel Time: A Mathematical Model
Model Perspective
Model Perspective
Nov 9, 2022 · Operations

Understanding Queueing Theory: Core Models, Rules, and Key Metrics

This article introduces queueing theory, explains its mathematical models—including input, service, and queueing rules—covers the Kendall notation and outlines the main performance indicators such as queue length, waiting time, busy period, and utilization.

Operations Researchperformance metricsqueueing theory
0 likes · 9 min read
Understanding Queueing Theory: Core Models, Rules, and Key Metrics
Model Perspective
Model Perspective
Nov 9, 2022 · Fundamentals

Explore Key Probability & Monte Carlo Models: Curated Resource List

This article compiles recent resources on probability and statistical modeling, covering Monte Carlo simulation, Markov processes, queueing theory, and Bayesian methods, providing direct links to each detailed write‑up for students and researchers seeking comprehensive study material.

Bayesian methodsMarkov processMonte Carlo
0 likes · 3 min read
Explore Key Probability & Monte Carlo Models: Curated Resource List
Model Perspective
Model Perspective
Jul 4, 2022 · Fundamentals

Top Model Guides: Clustering, Regression, Queueing & Monte Carlo Simulations

This curated list groups recent explanatory and simulation model articles—covering clustering analysis, linear regression, queueing theory, Markov chains, and Monte Carlo methods—into easy-to-navigate sections for quick reference, helping students and practitioners locate relevant resources efficiently.

ModelingMonte Carloclustering
0 likes · 2 min read
Top Model Guides: Clustering, Regression, Queueing & Monte Carlo Simulations
Model Perspective
Model Perspective
Jun 30, 2022 · Operations

Simulating a Single-Server Queue: Daily Service Count and Wait Times

This article models a single-mechanic repair shop as a single-server queue with exponentially distributed arrivals and uniformly distributed service times, then uses Python to simulate one workday and 1,000 workdays, reporting average daily serviced customers and average customer waiting time.

Monte CarloOperations ResearchPython
0 likes · 4 min read
Simulating a Single-Server Queue: Daily Service Count and Wait Times
Model Perspective
Model Perspective
Jun 11, 2022 · Operations

Deriving the Multi-Server Queue Model: Theory and Key Metrics

This article derives the theoretical model of a multi‑server queueing system, detailing Poisson arrivals, exponential service times, state balance equations, and formulas for average queue length, system size, waiting and sojourn times.

Operations ResearchPoisson processmulti-server
0 likes · 2 min read
Deriving the Multi-Server Queue Model: Theory and Key Metrics
Model Perspective
Model Perspective
Jun 6, 2022 · Operations

How to Derive the Core Formulas of a Single-Server Queueing System

This article walks through the theoretical derivation of the classic M/M/1 queueing model, detailing arrival and service rates, state balance equations, performance metrics such as utilization, average number in system, average waiting time, and average residence time, with illustrative formulas and explanations.

M/M/1Operations Researchperformance analysis
0 likes · 4 min read
How to Derive the Core Formulas of a Single-Server Queueing System