How InfiniFS Optimizes Metadata Access with Optimistic Cache and Lazy Invalidation

This article explains InfiniFS's cache organization for directory metadata, its optimistic cache usage, and the lazy invalidation mechanism that broadcasts rename updates to a few metadata servers, enabling scalable and efficient metadata services in large‑scale distributed file systems.

Cache DesignDistributed SystemsMetadata Caching

0 likes · 7 min read

How InfiniFS Optimizes Metadata Access with Optimistic Cache and Lazy Invalidation

StarRocks

May 22, 2024 · Big Data

Unlocking Data Lake Power: Iceberg Architecture & StarRocks Acceleration

Apache Iceberg offers a modern, ACID‑compliant table format for data lakes with features like hidden partitions and schema evolution, while StarRocks provides high‑performance query acceleration, metadata caching, and distributed planning to address Iceberg’s latency challenges, enabling seamless lake‑warehouse integration and real‑time analytics.

Apache IcebergData LakeMetadata Caching

0 likes · 19 min read

Unlocking Data Lake Power: Iceberg Architecture & StarRocks Acceleration

DaTaobao Tech

Jun 7, 2023 · Backend Development

Taobao Open Platform Gateway Architecture Evolution

Taobao’s open platform gateway has evolved into a modular, decentralized system that uses full asynchronous processing, multi‑cluster deployment, token‑based authentication, and advanced metadata caching to boost scalability, security, and performance while protecting privacy and enabling efficient large‑scale reporting.

DecentralizationMetadata CachingTaobao Open Platform

0 likes · 8 min read

Taobao Open Platform Gateway Architecture Evolution