Scalable storage

360 Zhihui Cloud Developer

Apr 2, 2025 · Databases

How VictoriaMetrics' Distributed Architecture Scales Massive Time‑Series Data

VictoriaMetrics employs a modular, horizontally scalable architecture composed of vmagent, vminsert, vmstorage, vmselect, and vmalert, each handling data collection, ingestion, storage, querying, and alerting, while leveraging consistent hashing, LSM‑tree storage, TSID indexing, and multi‑tenant isolation to efficiently manage large‑scale time‑series workloads.

Query OptimizationScalable storageVictoriaMetrics

0 likes · 11 min read

How VictoriaMetrics' Distributed Architecture Scales Massive Time‑Series Data

Didi Tech

Sep 26, 2023 · Databases

Didi's Time Series Storage Evolution: From InfluxDB to VictoriaMetrics

Facing exponential growth of time‑series data from 2017 to 2023, Didi migrated from InfluxDB to RRDtool, then to an in‑memory cache layer, and finally adopted VictoriaMetrics because its low‑cost commodity‑hardware operation, high write throughput, strong compression, and easy horizontal scaling solved the earlier storage, OOM, and scalability problems.

ObservabilityScalable storageTSDB

0 likes · 13 min read

Didi's Time Series Storage Evolution: From InfluxDB to VictoriaMetrics

Architects' Tech Alliance

Jun 13, 2023 · Fundamentals

HadaFS: A Scalable Burst Buffer File System for Exascale Supercomputers

The article introduces HadaFS, a novel burst‑buffer file system that combines the scalability and performance of local burst buffers with the data‑sharing and cost advantages of shared buffers, details its LTA architecture, metadata handling, and evaluates its superior performance on the SNS supercomputer against BeeGFS and traditional GFS solutions.

Burst BufferFile SystemHPC

0 likes · 16 min read

HadaFS: A Scalable Burst Buffer File System for Exascale Supercomputers

Bilibili Tech

Nov 25, 2022 · Artificial Intelligence

Design and Evolution of a Scalable Danmaku Personalized Recommendation System

The paper describes how Bilibili transformed its danmaku service from a simple, limited‑recall pipeline into a ten‑fold larger, KV‑store‑backed recommendation architecture that unifies engineering and AI layers, uses dynamic sharding and Redis locks, and ultimately boosts recall pool size, exposure, and experiment speed while reducing downgrade rates.

AI integrationScalable storagebackend engineering

0 likes · 20 min read

Design and Evolution of a Scalable Danmaku Personalized Recommendation System

vivo Internet Technology

Jul 8, 2020 · Databases

OpenTSDB: Architecture, Data Model, and HBase Integration for Time-Series Data Storage

The article offers a detailed technical overview of OpenTSDB’s architecture and data model, explaining how it leverages HBase for scalable time‑series storage, describing core concepts, table schemas, ingestion flow, performance considerations, and future alternatives for large‑scale monitoring workloads.

Data ModelingHBaseOpenTSDB

0 likes · 12 min read

OpenTSDB: Architecture, Data Model, and HBase Integration for Time-Series Data Storage

Architecture Digest

Aug 6, 2019 · Databases

FeatureKV: A High‑Performance, Scalable Key‑Value Store for Billion‑Scale Read/Write Workloads at WeChat

FeatureKV is a high‑performance, scalable key‑value storage system built on WeChat’s internal file system and metadata service, designed to handle billion‑scale read and write demands, support batch offline writes, provide version management, and achieve low‑latency online reads for services like Look‑at‑Look, ads, and payments.

Key-Value StoreScalable storagedistributed systems

0 likes · 23 min read

FeatureKV: A High‑Performance, Scalable Key‑Value Store for Billion‑Scale Read/Write Workloads at WeChat

DataFunTalk

Jul 17, 2019 · Big Data

BitBase: An HBase‑Based Solution for Billion‑Scale User Feature Analysis at Kuaishou

This article describes how Kuaishou built BitBase on HBase to store and compute billions of user feature logs with millisecond‑level latency, covering business requirements, technical selection, bitmap data modeling, system architecture, device‑ID handling, performance results, and future roadmap.

Big DataBitBaseHBase

0 likes · 11 min read

BitBase: An HBase‑Based Solution for Billion‑Scale User Feature Analysis at Kuaishou

Didi Tech

Mar 15, 2019 · Databases

Design and Evolution of Fusion: Didi’s Distributed NoSQL Database

Fusion is Didi’s self‑developed distributed NoSQL database, fully compatible with the Redis protocol, that combines Redis‑level low latency, MySQL‑level durability, ACID transactions, multi‑replica high availability, FastLoad bulk import, NewSQL secondary indexes, and cross‑datacenter active‑active replication to serve petabyte‑scale ride‑hailing data.

Active‑Active ReplicationDistributed DatabaseFastLoad

0 likes · 15 min read

Design and Evolution of Fusion: Didi’s Distributed NoSQL Database