Tagged articles
HBM
48 articles · Page 1 of 1
This analysis traces how AI infrastructure bottlenecks have migrated from GPU shortages to power grid constraints, transformer lead times, cooling challenges, HBM and advanced packaging shortages, capital intensity, and community opposition, arguing that AI competition has become a systems engineering race across energy, manufacturing, finance, and governance.
AI infrastructureCoWoSHBM
0 likes · 27 min read

KAIST Laboratory presents a 99-page analysis of next-generation HBM architectures (HBM4–HBM8) for AI transformer workloads, detailing the memory-wall bottleneck, roofline modeling on V100, evolution from HBM1 to HBM3E, cooling progression from air to fluidic TSV, and six key technical directions including 3D near-memory computing and CXL integration.
3D stackingAI AcceleratorsCXL
0 likes · 7 min read

Alibaba Cloud expert Wu Guanying at the 2026 Advanced Storage Conference presents HBF as a high-bandwidth flash memory offering 8-16x HBM capacity at 1/10 $/GB, suitable for KV cache and model weights in AI inference, but faces challenges in latency, write bandwidth, software stack, and ecosystem maturity, requiring cross-industry collaboration for 2027 sampling and 2028 mass production.
AI inferenceHBFHBM
0 likes · 9 min read

This article evaluates High Bandwidth Flash (HBF) as a supplement to HBM for LLM inference through simulation, showing HBF can reduce GPU count and boost throughput for long-context and MoE models, but identifies three critical barriers: read bandwidth must match HBM, flash endurance needs 25× improvement, and write latency must be lowered for practical deployment.
HBFHBMHigh Bandwidth Flash
0 likes · 6 min read

This article explains why GPUs are essential for AI large models, detailing their parallel computing architecture, high-bandwidth memory (HBM), and multi-GPU interconnect technologies, then compares mainstream AI chips including NVIDIA's H100, H200, B200, AMD's MI300X, MI350X, and Google TPU across architecture, memory, bandwidth, and target workloads.
AI large modelsAMD MI300XGPU
0 likes · 5 min read

The FMW 2026 AI Storage Chip Map structures the AI storage ecosystem into three layers — system, device, and media/chip — listing key vendors from cloud providers and SSD controllers to HBM and emerging memories, while highlighting trends such as Chinese vendor rise, AI-centric tech hotspots, and open interconnect standards.
AI storageCXLFMW 2026
0 likes · 10 min read

The 2026 Future of Memory and Storage conference reveals a decisive industry pivot from traditional SSD scaling to AI-centric memory architectures, highlighted by Samsung's zHBM stacking, Kioxia's GPU-direct XL-FLASH SSD, SK Hynix/WD's open HBF standard, and CXL-enabled memory pooling and tiering for next-generation AI data centers.
AI storageCXLFMS 2026
0 likes · 10 min read

The article examines how AI models expose storage bottlenecks, introduces High Bandwidth Flash (HBF) as a 3D NAND‑based, HBM‑like stacked memory that combines subarray parallelism and a dedicated logic die, evaluates its technical principles, industry positioning, benchmark results showing 2.69× performance‑per‑watt gains, supply‑chain landscape, emerging standards, and the challenges that must be solved before commercial deployment.
AI storageCBA architectureHBM
0 likes · 10 min read

At Hot Chips 2026, Samsung, SK Hynix and Micron warned that traditional HBM is nearing physical limits and outlined a three‑stage roadmap that moves from stacking to integrated Base‑Die, while d‑Matrix showcased a 3D‑DRAM solution delivering ~100 TB/s bandwidth but with limited capacity, highlighting packaging and power challenges as the next competitive frontier.
3D-DRAMAI inferenceBase Die
0 likes · 9 min read

Nvidia has warned core customers that rising high‑bandwidth memory (HBM) costs will push prices of its Grace Blackwell and next‑gen Vera Rubin AI servers up by more than 15%, a hike that is already affecting major cloud providers, driving up server and compute‑as‑a‑service fees and prompting cloud vendors to accelerate their own chip development.
AI infrastructureGPUHBM
0 likes · 8 min read

The 2026 storage‑chip market report analyzes how exploding AI compute demand drives a historic surge in high‑bandwidth memory, enterprise SSD and DDR5 prices, projects global sales to reach $2.23 trillion by 2025, and details shifting market shares among Samsung, SK Hynix, Micron and rising Chinese players such as Yangtze Memory and ChangXin.
AIChinaDRAM
0 likes · 11 min read

The article provides a detailed technical comparison of SRAM, DRAM and HBM, explains their roles in modern AI GPUs such as the H100, discusses training and inference memory placement, and evaluates emerging ideas like High‑Bandwidth SRAM and High‑Bandwidth Flash, concluding that all three memory types will coexist in future AI systems.
AI hardwareDRAMGPU
0 likes · 12 min read

The article analyzes how the growing memory‑wall bottleneck forces GPUs to idle while waiting for data, compares on‑chip SRAM and high‑bandwidth memory (HBM) as remedies, and examines HBM’s technical advantages, supply constraints, and divergent manufacturing routes that may turn it into a new limitation.
AI computeGPUHBM
0 likes · 6 min read

South Korea's KOSPI surged over 100% this year, with active trading accounts exceeding the population, driven by tax‑free arbitrage, leveraged retail enthusiasm, and a semiconductor boom centered on Samsung and SK Hynix, raising concerns about market fragility.
HBMKOSPISouth Korea
0 likes · 11 min read

This article breaks down the core chip concepts—CPU, GPU, NPU, APU, SoC, HBM and Chiplet—explaining their functions, key characteristics, historical evolution, and how they relate to each other, and provides a 2026 mainstream‑chip comparison and selection guide.
CPUChipletGPU
0 likes · 18 min read

The article analyses how China’s AI chip industry confronts the 7nm process bottleneck by leveraging mature nodes, innovative architectures, chiplet packaging, high‑bandwidth memory and a growing software ecosystem, while projecting rapid market growth and outlining remaining technical gaps.
AI chipsChina semiconductorChiplet
0 likes · 13 min read

The article explains that AI chip performance is now limited by memory bandwidth, making High‑Bandwidth Memory (HBM) a crucial, stacked, ultra‑wide‑bus memory placed next to GPUs, and details its architecture, cost drivers, market dominance by three vendors, and future trends.
AI chipsGPUHBM
0 likes · 8 min read

The article analyzes Huawei's Ascend AI chip evolution from the 910C baseline through the 950 series' low‑precision FP8/FP4 breakthrough to the 960/970 generation’s 8 PFLOPS performance, highlighting architectural innovations, memory and interconnect upgrades, scenario‑specific models, and a cost advantage over competing solutions.
AI chipAscendBenchmark
0 likes · 6 min read

Huawei’s Ascend 950 series splits a single die into two variants—PR (Prefill & Recommendation) optimized for compute‑intensive inference with low cost, and DT (Decode & Training) tuned for memory‑bandwidth‑heavy generation and training—illustrating a scenario‑driven, P/D‑separated architecture that maximizes efficiency.
AI chipAscend 950Decode
0 likes · 5 min read

A Nikkei Asia report predicts that global DRAM supply will meet only about 60% of demand by the end of 2027, with new capacity focused on high‑bandwidth memory for AI, leaving ordinary consumer devices facing prolonged shortages and higher prices through 2030.
AI demandConsumer ElectronicsDRAM
0 likes · 6 min read

The article analyzes how generative AI workloads are reshaping the storage market into a multi‑year Memory Supercycle, detailing demand spikes from Mid‑Training checkpoints, synthetic data, KV‑Cache offload and multimodal video models, while supply is strained by HBM production and geopolitical factors.
AIHBMKV cache
0 likes · 26 min read

In October 2024 South Korea surged to the forefront of the AI industry as OpenAI, Anthropic, and major Korean chaebols forged massive investments, secured HBM memory supplies, and launched a national AI economic blueprint, while political deals and talent challenges shaped the country’s strategic position.
AIAnthropicHBM
0 likes · 16 min read

This article examines Huawei's Ascend AI accelerator architecture, detailing its heterogeneous compute units, memory hierarchy, task scheduling, programming model, and chip variants, while also discussing future challenges and the ecosystem needed for widespread AI deployment.
AI acceleratorAI hardwareDaVinci architecture
0 likes · 14 min read

The article outlines the upcoming high‑bandwidth memory (HBM) generations—from HBM4 to HBM8—detailing their planned release years, data rates, bandwidth, capacity, architectural innovations, and the shift toward memory‑centered computing for AI and high‑performance workloads.
AI hardwareHBMHigh Bandwidth Memory
0 likes · 5 min read

This article explains what high‑bandwidth memory (HBM) is, outlines its brief history, compares it with DDR, LPDDR and GDDR, describes why large language models and generative AI drive its demand, and reviews its architecture, PCB requirements, market status, and future outlook.
AI hardwareGenerative AIHBM
0 likes · 3 min read

This article outlines the next‑generation high‑bandwidth memory (HBM) roadmap from HBM4 to HBM8, detailing launch timelines, architectural shifts, I/O counts, data rates, bandwidth, capacities, and novel integration concepts such as modular stacks, near‑memory compute, four‑tower structures, memory‑storage convergence, and full 3D integration.
HBMHigh Bandwidth MemoryMemory Architecture
0 likes · 5 min read

This article provides an in‑depth technical analysis of Huawei’s Ascend AI accelerator architecture, detailing its heterogeneous compute units, memory hierarchy, task scheduling, programming model, compiler optimizations, and the capabilities of the Ascend 310 and 910 chips, while also discussing future challenges and market competition.
AI acceleratorAI hardwareHBM
0 likes · 14 min read

This article breaks down the core components of high‑performance GPU servers—including PCIe switch chips, the evolution of NVLink from version 1.0 to 4.0, NVSwitch architecture, HBM memory tiers, and the nuances of bandwidth units—providing a comprehensive technical foundation for large‑scale model training.
GPU computingHBMHigh-Performance Computing
0 likes · 10 min read

This article explains the technical differences between GDDR and HBM GPU memory, compares their bandwidth, cost, and use‑case scenarios, and helps engineers decide which memory type best fits their performance and efficiency requirements.
GDDRGPU memoryGraphics
0 likes · 8 min read

The rapid rise of AI workloads is reshaping server economics, exposing the memory wall, and spurring a shift toward high‑bandwidth memory, CXL‑based pooling, and advanced DIMM technologies, while manufacturers like SK Hynix, Samsung and Micron race to dominate the emerging market.
AI serversCXLDDR5
0 likes · 9 min read

High Bandwidth Memory (HBM) is a DRAM technology that uses stacked chips, TSV, and micro‑bump interconnects to deliver ultra‑high data rates, lower power consumption, and compact form factor, addressing the bandwidth, latency, power, space, thermal, and complexity challenges of traditional 2D memory in GPUs, AI, HPC, and data‑center workloads.
HBMHigh Bandwidth MemoryHigh-Performance Computing
0 likes · 10 min read

The article analyzes how AI servers are shifting from pure compute power to storage‑centric designs, detailing the memory‑wall challenge, the rise of HBM and CXL technologies, vendor market shares, upcoming product roadmaps, and the broader supply‑chain opportunities shaping the AI hardware ecosystem.
AI serversCXLHBM
0 likes · 9 min read

The article explains the evolution, technical specifications, and packaging methods of High Bandwidth Memory (HBM) from HBM1 to HBM3E, highlights its dominant role in AI servers, and analyzes market share and growth forecasts for HBM products through 2026.
AI serversHBMHigh Bandwidth Memory
0 likes · 8 min read

HBM's near‑memory architecture, stacked design, and TSV integration dramatically cut latency and space while boosting bandwidth, leading NVIDIA and AMD to adopt it across multiple GPU generations, spurring fierce competition among SK Hynix, Samsung, and Micron and projecting a four‑fold market surge to $169 billion by 2024.
AIGPUHBM
0 likes · 11 min read

This article provides a comprehensive overview of the core components and terminology of large‑scale GPU computing, covering GPU server architecture, PCIe interconnects, NVLink generations, NVSwitch, high‑bandwidth memory (HBM), and bandwidth unit considerations for AI and HPC workloads.
AI hardwareGPU computingHBM
0 likes · 11 min read

This article provides a detailed technical overview of modern multi‑GPU server architectures—including PCIe switches, NVLink, NVSwitch, and HBM—explaining their hardware topologies, bandwidth characteristics, monitoring methods, and network choices to help engineers design efficient AI training clusters.
AI TrainingGPUHBM
0 likes · 18 min read

This article provides a comprehensive breakdown of high‑performance GPU server infrastructure, covering PCIe generations, NVLink evolution, NVSwitch and NVLink switches, HBM memory technologies, and bandwidth measurement units, helping readers understand the hardware connections and performance considerations essential for large‑scale model training.
GPU architectureHBMHigh-Performance Computing
0 likes · 10 min read

The article analyzes how the surge in AI workloads and the “East‑West Computing” strategy are reshaping the server industry, detailing the AI server component chain, the role of HBM memory, SSD evolution, and the stark cost‑structure differences between traditional and AI‑optimized servers.
AI serversGPUHBM
0 likes · 5 min read

This analysis forecasts semiconductor process evolution, advanced packaging growth, and HBM memory capacity through 2025, highlighting TSMC and Samsung’s 2nm/3nm timelines, Nvidia and AMD packaging limits, and the assumptions driving Nvidia’s future AI‑chip architecture.
AI chipsAdvanced packagingHBM
0 likes · 7 min read

The article analyzes how HBM has broken the memory wall, outlines the expected shift from TSV+Bumping+TCB to hybrid bonding for higher I/O counts and speeds, forecasts a $10 billion+ market by 2024, and predicts HBM4’s 2026 release will drive new opportunities for AI accelerators and Chinese supply chains.
3D packagingHBMHigh Bandwidth Memory
0 likes · 6 min read

HBM, a vertically stacked DRAM technology, is evolving to HBM3E with up to 8 Gbps speed and 16 GB capacity, driving explosive growth in AI server demand, reshaping market shares among SK Hynix, Samsung and Micron, and relying on CoWoS and TSV packaging advances.
AI serversCoWoSHBM
0 likes · 8 min read

The article explains how High Bandwidth Memory (HBM) technology has evolved to HBM3E, details its technical advantages, outlines the rapid growth of AI server shipments, projects a $15 billion HBM market by 2025, and analyzes the competitive landscape of major suppliers and packaging methods.
AI serversCoWoSHBM
0 likes · 9 min read

The article examines High Bandwidth Memory (HBM) technology—its 3D‑stacked architecture, superior bandwidth and power efficiency over GDDR, adoption in AI GPUs, generational performance gains, TSV manufacturing processes, and the evolving market share among major vendors.
AI serversGPUHBM
0 likes · 10 min read

High Bandwidth Memory (HBM), introduced in 2014 using TSV stacking, has evolved through HBM2, HBM2e, and HBM3 standards and is now integrated into CPUs, GPUs, and accelerators from AMD, NVIDIA, Intel, and others, with advanced interconnects like CoWoS, EMIB, and Foveros enabling high‑capacity, high‑bandwidth packaging.
CPUGPUHBM
0 likes · 16 min read

This report analyzes the role of memory interface chips in modern servers, the transition from DDR4 to DDR5, market penetration forecasts, the technical distinctions between RCD and DB buffers, and emerging standards such as CXL, HBM, and PCIe that shape future high‑performance computing architectures.
CXLDDR5HBM
0 likes · 10 min read

The explosive growth of ChatGPT and other AI chatbots is driving unprecedented demand for high‑performance AI chips and high‑bandwidth memory, positioning Nvidia as the primary beneficiary while also creating significant market opportunities for Samsung, SK Hynix, and other semiconductor manufacturers.
AI chipsAI hardwareChatGPT
0 likes · 11 min read

This article explains the three JEDEC DRAM categories—Standard DDR, Mobile DDR (LPDDR), and Graphics DDR (GDDR/HBM)—detailing their architectures, performance characteristics, power requirements, and typical application domains such as servers, mobile devices, AI, and high‑throughput graphics.
DDRGDDRHBM
0 likes · 12 min read

The article analyzes the limitations of general‑purpose CPUs for deep‑learning workloads, explains how semiconductor scaling and memory‑bandwidth constraints drive the shift toward specialized heterogeneous processors such as GPUs, FPGAs, and ASICs, and discusses the design trade‑offs of embedded versus cloud AI accelerators.
AIASICCPU
0 likes · 13 min read
