How Hierarchical Sparse Attention Breaks KVCache Limits for Ultra‑Long Context LLMs

This article explains how a hierarchical sparse‑attention framework redesigns KVCache storage across GPU, CPU, and remote memory, eliminates bandwidth and capacity bottlenecks, and enables efficient inference for 128K‑token and larger contexts with dramatically reduced GPU memory usage and higher throughput.

Dynamic Sparse AttentionGPU memory optimizationHierarchical Storage

0 likes · 20 min read

How Hierarchical Sparse Attention Breaks KVCache Limits for Ultra‑Long Context LLMs

21CTO

Mar 25, 2025 · Databases

How Google Spanner’s New Hierarchical Storage Cuts Costs with HDD Tiering

Google Cloud Spanner now offers a policy‑driven hierarchical storage tier that moves infrequently accessed data to cheap HDDs, reducing costs by up to 80% while keeping SQL queries seamless across SSD and HDD layers and preserving backup consistency.

Cost OptimizationDistributed SQLGoogle Cloud

0 likes · 5 min read

How Google Spanner’s New Hierarchical Storage Cuts Costs with HDD Tiering

DataFunTalk

May 27, 2024 · Big Data

JD Retail’s Unified HDFS Storage: Cross‑Region and Hierarchical Storage Practices

This article details JD Retail’s large‑scale HDFS deployment, describing how cross‑region storage challenges were solved with a full‑copy topology, asynchronous block replication, flow‑control mechanisms, and a tiered storage strategy that automatically moves hot, warm, and cold data among SSD, HDD, and high‑density HDD nodes to improve performance and cut costs.

Big DataData ManagementHDFS

0 likes · 20 min read

JD Retail’s Unified HDFS Storage: Cross‑Region and Hierarchical Storage Practices

DataFunSummit

Aug 12, 2022 · Big Data

JD's Big Data Cross‑Domain and Hierarchical Storage Practices

JD’s article details its big‑data platform’s cross‑domain and hierarchical storage solutions, describing the challenges of multi‑datacenter data synchronization, the architecture of its storage layer, the implemented asynchronous and synchronous data flows, topology management, metadata tagging, and performance‑enhancing techniques for efficient, disaster‑resilient data handling.

Data PlatformHierarchical Storagecross-domain storage

0 likes · 11 min read

JD's Big Data Cross‑Domain and Hierarchical Storage Practices