Tagged articles
compute-storage separation
37 articles · Page 1 of 1

java1234Nov 15, 2026 · Backend Development
FlowMQ Kafka separates compute and storage with S3 and RLog backends, delivering 94% cost savings on cloud object storage and eliminating manual rebalancing through segment-level replication and Flexible Quorum, outperforming Kafka and Redpanda in multi-AZ failure recovery.
Flexible QuorumFlowMQKafka
0 likes · 15 min read

FlowMQ Kafka implements the Kafka protocol with compute-storage separation, offering S3 for low-cost cloud storage and RLog for low-latency on-prem deployments, using segment-level replication and Flexible Quorum to enable seamless scaling and fast failure recovery without data rebalancing.
Flexible QuorumFlowMQKafka
0 likes · 13 min read

This article analyzes the Dsh team's Super-agent design, showing how classic systems engineering — cache locality, fast/slow paths, speculative execution, and compute-storage separation — enables AI agents to maintain continuous context, handle concurrent events efficiently, act proactively on environmental triggers, and persist across device failures.
AI agentsAgent ArchitectureSpeculative execution
0 likes · 11 min read

The article analyzes DeepSeek's Super-agent architecture, showing how it maps operating system concepts—process scheduling, page caching, compute-storage separation, and watchdog mechanisms—to build a dual-layer Router-Worker agent system that enables continuous, efficient, proactive, and persistent autonomous agents, with source code insights from the open-source prototype.
Agent ArchitectureBYOMDeepSeek Super-agent
0 likes · 42 min read

This article analyzes DeepSeek Harness's Super-agent architecture, dissecting its dual-layer Router-Worker design, event-driven routing, context caching, speculative execution, and compute-storage separation, while highlighting trade-offs like cross-layer communication overhead, async complexity, and security risks in BYOM deployments.
Agent ArchitectureContext ManagementDeepSeek Harness
0 likes · 22 min read

DeepSeek releases dsh-superagent-prototype, a next-gen agent architecture using a dual-layer Router/Worker design, event-driven triggers with two-level filtering and subscription pass-through, context management via inline/spill and chained recall, async ReAct loops, compute-storage separation, and a Watchdog for self-healing; experiments show 12.4 min p50 task completion but 3.8x token overhead versus single-session baselines.
AI agentsAgent ArchitectureContext Management
0 likes · 13 min read

360 Zhihui Cloud's ZestKV is a Redis-compatible, cloud-native serverless KV store that separates compute from storage using shared object storage and a log service, enabling elastic scaling via region sharding, background task decoupling, and a dual-async write path achieving 700K SET QPS in benchmarks.
Cloud-Native DatabaseElastic ScalingLSM-tree
0 likes · 24 min read

This lesson explains why a single database cannot scale for massive e‑commerce data, introduces the three core pillars of distributed storage—sharding, replication, and horizontal scaling—covers batch and stream processing differences with Spark, Hive, Flink and Storm, compares compute‑storage integration versus separation, and shows how Kafka, HDFS, Spark and Flink fit together in a real‑time data platform.
FlinkKafkaSpark
0 likes · 25 min read

ZestKV is a Redis‑compatible distributed KV store that separates compute from storage, using a log service and object storage to lower hardware costs, guarantee data durability, and enable independent, elastic scaling of compute and storage resources.
Elastic ScalingObject StorageRedis Compatibility
0 likes · 11 min read

RocketMQ 5.0 replaces the monolithic Broker with a stateless Proxy layer that decouples compute from storage, solves scalability, multi‑protocol and cloud‑native adaptation challenges, and is demonstrated through detailed architecture comparisons, Java code samples, and two real‑world IoT and finance case studies showing significant performance and cost benefits.
Message QueueMulti-ProtocolProxy
0 likes · 20 min read

Facing Postgres overload and costly Snowflake queries, Fresha rebuilt its analytics platform by introducing StarRocks as a unified SQL entry point, combining federated lakehouse queries with high‑performance internal tables, which reduced homepage query latency to around 200 ms and achieved minute‑level data freshness across real‑time, historical, and search workloads.
StarRockscompute-storage separationdata pipeline
0 likes · 20 min read

Ctrip migrated its massive User Behavior Tracking system from ClickHouse to a compute‑storage separated StarRocks cluster on Kubernetes, achieving millisecond‑level query latency, halving storage usage, reducing node count, and sustaining millions‑of‑rows‑per‑second write throughput while simplifying scaling and operations.
ClickHouseKubernetesStarRocks
0 likes · 15 min read

The article analyzes how Chinese commercial banks are addressing AI data governance and domestic‑technology (信创) challenges by replacing server‑local disk replicas with professional SAN storage integrated into a true compute‑storage‑separated architecture, highlighting survey results, performance benchmarks, and ecosystem collaborations that demonstrate improved stability, latency, and scalability.
AIDistributed DatabaseSAN
0 likes · 19 min read

In StarRocks compute-storage separation clusters, Stream Load achieves 20-30x faster bulk data ingestion than INSERT by leveraging batch-oriented design, direct compute-node access, single-transaction metadata handling, large-file storage writes, and concentrated resource scheduling, avoiding INSERT's per-row overheads.
INSERTPerformance TuningStarRocks
0 likes · 11 min read

This guide details deploying a StarRocks compute-storage separation cluster using Alibaba Cloud OSS, covering architecture design, resource planning, Linux optimization, FE and CN node deployment with Ansible automation, configuration parameters, post-deployment tuning, and verification steps.
Alibaba Cloud OSSAnsibleCN
0 likes · 14 min read

DMALL upgraded its big‑data platform by adopting StarRocks 3.x with compute‑storage separation, lakehouse external tables, and Kubernetes deployment, achieving 20% higher compute utilization, 40% lower storage cost, faster cluster provisioning, and notable improvements in development and operations efficiency.
KubernetesStarRocksbig data
0 likes · 25 min read

The article reviews the major directions of Flink 2.0—including compute‑storage separation, a new Materialized Table for unified batch‑stream processing, and deeper integration with Paimon for streaming warehouses—while offering a cautious perspective on their practical impact and migration challenges.
Batch-Stream IntegrationFlinkStreaming Warehouse
0 likes · 5 min read

The article analyzes the limitations of current server‑based distributed storage—such as data‑lifecycle mismatches, performance‑resource trade‑offs, serverless workload demands, and the costly "datacenter tax"—and presents emerging hardware trends and a novel compute‑storage separation architecture that promises higher efficiency, reliability, and scalability for cloud and internet data centers.
CXLDPUHardware Trends
0 likes · 13 min read

This article presents Tencent Game's comprehensive lakehouse integration practice, detailing the project background, storage‑compute separation, data layering, unified DDL/DML operations, performance optimizations, and future plans, illustrating how StarRocks, Iceberg, and Spark are combined to achieve scalable, cost‑effective analytics for massive game data.
StarRockscompute-storage separationdata warehouse
0 likes · 16 min read

StarRocks, an open‑source MPP analytical database, consolidates BI, interactive, and real‑time analytics into a single engine by evolving from version 1.0 to 3.x, introducing compute‑storage separation, unified catalog, generated columns, operator spill, and advanced materialized views, while outlining its cloud‑native lakehouse roadmap.
MPP databaseStarRockscompute-storage separation
0 likes · 22 min read

This article details a Chinese tech company's migration of its internal big‑data analytics platform to StarRocks’ compute‑storage separation architecture, describing the original multi‑component setup, the pain points encountered, the evaluation methodology, performance and cost benchmarks, operational optimizations, migration steps, and future roadmap.
KubernetesStarRocksbig data
0 likes · 17 min read

REDck, a cloud‑native real‑time data warehouse built on open‑source ClickHouse, overcomes the original MPP architecture’s scaling and maintenance limits by separating compute and storage, introducing unified metadata, multi‑level caching, bucket‑based sharding, and distributed transaction support, delivering petabyte‑scale, 99.9% availability and ten‑fold cost and performance gains for Xiaohongshu’s diverse workloads.
ClickHouseReal-time OLAPcloud-native
0 likes · 22 min read

This article presents Kingsoft Cloud's comprehensive practice on big data compute‑storage separation, detailing the challenges of modern data platforms, comparing HDFS with object storage, describing three separation modes, and explaining the architecture, core modules, performance optimizations, and advantages of the KS3‑HDFS solution.
KS3-HDFSObject Storagecloud computing
0 likes · 21 min read

This article explains how StarRocks’ new compute‑storage separation architecture reduces storage expenses and improves analytical performance by leveraging hot‑cold data segregation, elastic scaling, caching strategies, multi‑version storage, and optimized compaction, illustrated with real‑world log and e‑commerce workload examples.
MPP databaseStarRockscompute-storage separation
0 likes · 18 min read


ITPUBNov 19, 2022 · Databases
This article compares the architectures of OceanBase and TiDB, explaining how their sharding and compute‑storage separation designs affect high availability, latency, and workload suitability, and offers guidance on selecting the right distributed database for complex enterprise applications.
OceanBaseShardingTiDB
0 likes · 12 min read

This article analyzes Baidu Intelligent Cloud's data‑lake acceleration strategy, covering the evolution of big‑data architectures, the advantages and challenges of compute‑storage separation, the native hierarchical namespace and RapidFS cache solutions, performance test results, and recommended deployment patterns.
BOSRapidFScloud storage
0 likes · 17 min read

This article explains Baidu Intelligent Cloud’s data lake acceleration solution, covering the evolution of big‑data technologies, the benefits and challenges of compute‑storage separation, the architecture of BOS object storage, and the native hierarchical namespace and RapidFS cache mechanisms that boost performance and reduce costs.
BOSRapidFSbig data
0 likes · 18 min read

This article explains how Zuoyebang redesigned its massive data retrieval platform by separating compute and storage with the Fluid project on Kubernetes, achieving minute‑level hundred‑TB distribution, elastic caching, and improved stability for real‑time educational services.
Data RetrievalFluidKubernetes
0 likes · 8 min read

This article describes the challenges of operating massive, TB‑scale retrieval clusters at Zuoyebang, and presents a Fluid‑based compute‑storage separation architecture that improves data distribution, update efficiency, scalability, and stability, enabling containerized search services to be managed like regular stateless workloads.
FluidKubernetesLarge-Scale Retrieval
0 likes · 13 min read


ITPUBJun 30, 2021 · Databases
This article explains the limitations of open‑source Redis, introduces Huawei Cloud's GaussDB for Redis with its compute‑storage separation architecture, details its design, implementation, and disaster‑recovery mechanisms, and summarizes the competitive advantages such as strong consistency, high availability, elastic scaling, and superior performance.
GaussDBNoSQLRedis
0 likes · 14 min read

This article explains how AnalyticDB MySQL’s elastic mode separates compute and storage to improve scalability, describes industry trends, details its architecture layers, presents performance test results on TPCH Q1, and outlines future enhancements for cloud‑native data warehousing.
AnalyticDBElastic Scalingcompute-storage separation
0 likes · 14 min read

This article analyzes the challenges of traditional monolithic big‑data architectures, explains how Tencent Cloud EMR integrates Alluxio for compute‑storage separation, presents detailed performance benchmarks showing 20‑50% bandwidth reduction and 5‑40% query speedup, and outlines the specific tuning measures applied.
AlluxioEMRbig data
0 likes · 10 min read

This article traces the historical laws that drove computing growth, examines how Redis, MongoDB and Memcached evolved, compares client‑side, proxy and compute‑storage‑separated architectures, evaluates their trade‑offs, and answers common questions about cloud‑based distributed databases.
Database ArchitectureMongoDBRedis
0 likes · 23 min read

This article examines the challenges of big‑data storage in containerized environments, compares compute‑storage‑separated architectures with traditional setups, presents performance and cost benchmarks of Alibaba Cloud ECS instances, and outlines practical storage options such as OSS, NAS, and DFS for Spark workloads on Kubernetes.
KubernetesSparkcloud-native
0 likes · 14 min read

Tencent Cloud’s CynosDB for MySQL separates compute from distributed storage, using a log‑driven, stateless architecture that eliminates local I/O, enables sub‑second failover, 2.5× write performance, lock‑free structures, async group‑commit, compressed logs, fast parallel recovery, and scalable replication, with future plans for external buffer pools and multi‑master support.
Cloud DatabaseCynosDBMySQL
0 likes · 23 min read

SequoiaDB, a financial‑grade open‑source distributed database, combines a multi‑model engine with a compute‑storage separation architecture to deliver full MySQL, PostgreSQL and SparkSQL compatibility, elastic scaling, HTAP capabilities, and robust multi‑site disaster recovery for cloud‑native enterprise workloads.
HTAPcloud-nativecompute-storage separation
0 likes · 12 min read

CynosDB, Tencent Cloud’s next‑generation enterprise distributed database, re‑architects MySQL with compute‑storage separation, distributed high‑availability storage, and RDMA‑accelerated low‑latency replication, delivering extreme performance, scalability, sub‑millisecond response times, and nine‑nine data reliability for cloud‑native applications.
Cloud DatabaseCynosDBMySQL
0 likes · 9 min read
