Tagged articles

Metadata Caching

3 articles · Page 1 of 1
Big Data Technology Tribe
Big Data Technology Tribe
Jul 30, 2025 · Backend Development

How InfiniFS Optimizes Metadata Access with Optimistic Cache and Lazy Invalidation

This article explains InfiniFS's cache organization for directory metadata, its optimistic cache usage, and the lazy invalidation mechanism that broadcasts rename updates to a few metadata servers, enabling scalable and efficient metadata services in large‑scale distributed file systems.

Cache DesignMetadata CachingOptimistic Concurrency
0 likes · 7 min read
How InfiniFS Optimizes Metadata Access with Optimistic Cache and Lazy Invalidation
StarRocks
StarRocks
May 22, 2024 · Big Data

Unlocking Data Lake Power: Iceberg Architecture & StarRocks Acceleration

Apache Iceberg offers a modern, ACID‑compliant table format for data lakes with features like hidden partitions and schema evolution, while StarRocks provides high‑performance query acceleration, metadata caching, and distributed planning to address Iceberg’s latency challenges, enabling seamless lake‑warehouse integration and real‑time analytics.

Apache IcebergData LakeMetadata Caching
0 likes · 19 min read
Unlocking Data Lake Power: Iceberg Architecture & StarRocks Acceleration
DaTaobao Tech
DaTaobao Tech
Jun 7, 2023 · Backend Development

Taobao Open Platform Gateway Architecture Evolution

Taobao’s open platform gateway has evolved into a modular, decentralized system that uses full asynchronous processing, multi‑cluster deployment, token‑based authentication, and advanced metadata caching to boost scalability, security, and performance while protecting privacy and enabling efficient large‑scale reporting.

Cloud ComputingDecentralizationMetadata Caching
0 likes · 8 min read
Taobao Open Platform Gateway Architecture Evolution