Tag

Distributed KV

1 views collected around this technical thread.

360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Nov 29, 2024 · Big Data

How Ozone Scales Metadata for Massive Big Data Storage

This article explains Ozone's object storage architecture, its evolution of metadata management using distributed KV stores like Apache Cassandra, and the performance optimizations—read/write separation, unlimited scaling, and partitioning—that enable high‑throughput, low‑latency handling of massive datasets.

Apache CassandraDistributed KVOzone
0 likes · 9 min read
How Ozone Scales Metadata for Massive Big Data Storage
Aikesheng Open Source Community
Aikesheng Open Source Community
Dec 6, 2023 · Backend Development

Comparison of Consistency Read Implementations in Consul and etcd

This article compares the consistency read mechanisms of the distributed key‑value stores Consul and etcd, detailing Consul’s three read modes and leader‑forwarding logic, and explaining etcd’s serialize and linearizable reads, including the internal notification and index‑checking processes.

ConsulDistributed KVbackend development
0 likes · 6 min read
Comparison of Consistency Read Implementations in Consul and etcd
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Jul 4, 2022 · Databases

RedKV: Xiaohongshu's Distributed NoSQL KV Storage System

RedKV, Xiaohongshu’s self‑developed distributed NoSQL key‑value store, combines a Redis‑compatible interface, RocksDB‑backed storage, and a shard‑managed multi‑cloud architecture that delivers three‑times higher write throughput, 1.5‑times read throughput, 40 % cost savings versus HBase, and sub‑5 ms P999 latency for petabyte‑scale workloads.

DatabaseDistributed KVLZ4 compression
0 likes · 25 min read
RedKV: Xiaohongshu's Distributed NoSQL KV Storage System
ByteDance Dali Intelligent Technology Team
ByteDance Dali Intelligent Technology Team
Aug 26, 2021 · Backend Development

Design and Implementation of a Distributed KV‑Based Message Queue

This article explains the core concepts and detailed design of a custom message queue built on a distributed key‑value store, covering terminology, architecture, broker metadata, topic metadata, message format, sending, storage, retrieval, delay handling, retry mechanisms, dead‑letter queues, and TTL policies.

Consumer GroupDelay MessageDistributed KV
0 likes · 13 min read
Design and Implementation of a Distributed KV‑Based Message Queue
Tencent Architect
Tencent Architect
Nov 21, 2017 · Operations

Redesign and Optimization of the WeChat Pay Transaction Record System

This article presents a comprehensive case study of how WeChat Pay rebuilt its transaction record storage to handle massive data growth, improve performance, ensure data completeness, and strengthen security through a distributed key‑value architecture, hierarchical archiving, and robust operational safeguards.

Data SecurityDistributed KVTransaction Storage
0 likes · 10 min read
Redesign and Optimization of the WeChat Pay Transaction Record System