BestHub
Sign in
Random Bulletin
Author

Random Bulletin

17-year internet software developer specializing in AI applications, networking, architecture, and open source. Led the delivery of network services handling hundreds of millions of concurrent devices and tens of millions of QPS, and has three years of experience designing and building an agent platform. Follow to stay updated.

81
Articles
0
Likes
35
Views
0
Comments
Recent Articles

Latest from Random Bulletin

81 recent articles
Random Bulletin
Random Bulletin
Aug 9, 2026 · Cloud Native

From VMs to Containers: Achieving Million‑QPS Elasticity with Immutable Images

Containers replace heavy VMs by sharing the host kernel, using namespaces for isolation and cgroups for resource limits, while immutable layered images lock down the runtime environment, enabling millisecond‑scale scaling, higher density, and standardized deployment that solves the elasticity, cost, and consistency challenges of million‑QPS services.

cgroupcontainersdeployment
0 likes · 16 min read
From VMs to Containers: Achieving Million‑QPS Elasticity with Immutable Images
Random Bulletin
Random Bulletin
Aug 9, 2026 · Big Data

Metadata Management at Million‑QPS Scale: From Chaos to a Unified Catalog

The article explains how scattered, hard‑coded metadata in large‑scale systems leads to unknown impact of changes, and walks through building a unified metadata center with a single source of truth, automatic collection, lineage, impact analysis, asset discovery, active metadata, and governance, while highlighting practical trade‑offs and real‑world tools.

active metadatadata catalogdata governance
0 likes · 19 min read
Metadata Management at Million‑QPS Scale: From Chaos to a Unified Catalog
Random Bulletin
Random Bulletin
Aug 7, 2026 · Operations

From Simple Toggles to Platform‑Scale Switch Management for Million‑QPS Systems

The article explains how moving feature switches from hard‑coded if‑else statements to a platform‑based runtime system enables granular targeting, gradual rollouts, A/B experiments, instant kill‑switches, and SDK‑based local evaluation that can handle millions of queries per second without redeployments.

A/B testingHigh QPSSDK local evaluation
0 likes · 17 min read
From Simple Toggles to Platform‑Scale Switch Management for Million‑QPS Systems
Random Bulletin
Random Bulletin
Aug 4, 2026 · Cloud Native

Stateless Design at Ten‑Million QPS: Moving State Out of Compute for Elastic Scaling

The article analyzes how local state—such as in‑memory sessions, caches, files, and long‑lived connections—breaks elastic scaling, outlines four concrete paths to externalize that state (Redis, JWT, object storage, and gateway separation), and explains the resulting scalability benefits, trade‑offs, and performance considerations.

Kubernetesmicroservicesredis
0 likes · 20 min read
Stateless Design at Ten‑Million QPS: Moving State Out of Compute for Elastic Scaling
Random Bulletin
Random Bulletin
Aug 3, 2026 · Operations

Cost Optimization at Ten‑Million QPS: Turning Ignored Expenses into Core Design

At ten‑million QPS scale, the article explains why cost shifts from a hidden after‑the‑fact bill to a primary design goal, detailing how to make costs observable, improve utilization, right‑size resources, leverage Spot and reserved instances, apply architectural savings, and embed FinOps culture while preserving SLA.

Capacity PlanningFinOpsHigh Scale Systems
0 likes · 22 min read
Cost Optimization at Ten‑Million QPS: Turning Ignored Expenses into Core Design
Random Bulletin
Random Bulletin
Aug 2, 2026 · Cloud Native

From Zero to Ten‑Million QPS: How to Reserve Resources for Guaranteed Capacity

The article explains how a noisy‑neighbor batch job can cripple a payment service at ten‑million‑QPS scale, then details five practical reservation techniques—quotas, reserved instances, isolation, priority preemption, and elastic prediction—while weighing their trade‑offs and showing how overcommit and offline mixing recover idle capacity for both high guarantee and high utilization.

Kubernetesovercommitpriority preemption
0 likes · 23 min read
From Zero to Ten‑Million QPS: How to Reserve Resources for Guaranteed Capacity
Random Bulletin
Random Bulletin
Aug 1, 2026 · Cloud Native

Mixed‑Tenant Architecture: From Exclusive to Shared, Boosting Utilization to 45%

The article explains how moving from exclusive, peak‑sized clusters to a mixed‑tenant architecture—leveraging time‑shifted workloads, cgroup and hardware isolation (LLC, memory bandwidth), QoS tiers, elastic throttling and dynamic over‑commit—can raise CPU utilization from under 20% to over 45% and cut costs by about 30%, while introducing significant operational complexity and stability risks.

CPU utilizationQoScgroup
0 likes · 18 min read
Mixed‑Tenant Architecture: From Exclusive to Shared, Boosting Utilization to 45%
Random Bulletin
Random Bulletin
Jul 31, 2026 · Cloud Native

Scaling at Ten‑Million QPS: From Manual to Automatic Autoscaling

The article analyzes why manual capacity adjustments break down at ten‑million‑QPS scale, then walks through metric‑driven autoscaling, anti‑flapping algorithms, headroom planning, predictive scaling, stateful service challenges, and multi‑dimensional strategies to achieve a cost‑stable dynamic balance.

Capacity PlanningKubernetesMetrics
0 likes · 20 min read
Scaling at Ten‑Million QPS: From Manual to Automatic Autoscaling
Random Bulletin
Random Bulletin
Jul 30, 2026 · Operations

From Guesswork to Math: Modeling Capacity for Ten‑Million QPS Services

Capacity evaluation evolves from intuition‑based estimates to rigorous modeling by measuring per‑request costs with single‑machine benchmarks, applying USL and queueing theory, bounding effective capacity with SLOs, conducting full‑link shadow traffic tests, and continuously calibrating online water‑marks to turn high‑traffic resilience into a calculable engineering decision.

Capacity PlanningSLOUSL
0 likes · 19 min read
From Guesswork to Math: Modeling Capacity for Ten‑Million QPS Services