Tagged articles
memory hierarchy
59 articles · Page 1 of 1
This article explores why linked lists often underperform arrays in modern CPUs despite O(1) insertion complexity, examining cache locality, memory walls, and real-world benchmarks from Stroustrup and Carruth, while identifying scenarios where linked lists remain essential.
C++Chandler CarruthStroustrup
0 likes · 14 min read

Harvard lecture notes explain GPU hardware principles for LLMs, using the Roofline model to contrast compute-bound prefill vs. memory-bound decode phases, detailing Hopper/Blackwell architectures, memory hierarchy, multi-GPU scaling, and comparing NVIDIA with AMD MI355X, Google TPU Ironwood, and AWS Trainium3 accelerators.
AI AcceleratorsBlackwell ArchitectureGPU
0 likes · 9 min read

The 2026 Future of Memory and Storage conference reveals a decisive industry pivot from traditional SSD scaling to AI-centric memory architectures, highlighted by Samsung's zHBM stacking, Kioxia's GPU-direct XL-FLASH SSD, SK Hynix/WD's open HBF standard, and CXL-enabled memory pooling and tiering for next-generation AI data centers.
AI storageCXLFMS 2026
0 likes · 10 min read


TonyBaiSep 9, 2026 · Artificial Intelligence
YC Paper Club reveals how the same Claude Opus model scores 30% on ARC-AGI bare but reaches 95% with proper Harness, and NVIDIA's AVO hits 100%, proving agent runtime—not model weights—determines the performance ceiling.
ARC-AGIAgent RuntimeContinual Harness
0 likes · 20 min read

The article explains how cache hit rate directly impacts program speed, describes the three hit‑rate levels, factors such as data locality, working‑set size and associativity, types of cache misses, and provides practical techniques—data alignment, array traversal, packing, prefetching, and monitoring tools—to improve performance.
C++Cachedata locality
0 likes · 11 min read

The article provides a detailed technical comparison of SRAM, DRAM and HBM, explains their roles in modern AI GPUs such as the H100, discusses training and inference memory placement, and evaluates emerging ideas like High‑Bandwidth SRAM and High‑Bandwidth Flash, concluding that all three memory types will coexist in future AI systems.
AI hardwareDRAMGPU
0 likes · 12 min read

This article breaks down NVIDIA GPU fundamentals—contrasting GPU with CPU design, tracing CUDA’s evolution, detailing the hardware hierarchy from chips to SM units, explaining memory tiers, and presenting a step‑by‑step performance‑optimization methodology for AI training and inference workloads.
AI TrainingCUDAGPU architecture
0 likes · 22 min read

The article explains the layered memory hierarchy of a computer—from ultra‑fast registers and multi‑level CPU caches to RAM, SSD/HDD storage, and dedicated VRAM—using everyday analogies and concrete examples, and shows why “out of memory” warnings appear.
CPU cacheRAMRegisters
0 likes · 6 min read

The AICon 2026 talks detail how Xiaohongshu’s engineering team tackles long‑context agent challenges by introducing Self‑GC’s ContextObject model, side‑channel commit mechanisms, a NEX sandbox for runtime isolation, and an L0‑L2 memory hierarchy, achieving 10‑20% token savings with over 90% impact‑free execution.
AI agentsContext GovernanceNEX sandbox
0 likes · 7 min read

CPU arithmetic runs at near‑physical limits because all operations stay on‑chip, but data lookup is throttled by three physical bottlenecks—storage hierarchy, data placement, and addressing rules—forcing the processor to wait for cache, memory or disk transfers and dramatically reducing overall system throughput.
CPUCachelatency
0 likes · 18 min read

This article explains why TPU programming differs from GPU, describes the explicit HBM‑VMEM‑register data movement required on TPU, introduces the Pallas grid‑BlockSpec‑Ref model, and walks through four progressively more complex kernels—including element‑wise add, tiled dot product, fused RMSNorm with scratch memory, and a production‑grade FlashAttention implementation—showing how each kernel maps to the TPU memory hierarchy and leverages Pallas features such as input_output_aliases and PrefetchScalarGridSpec.
FlashAttentionJAXPallas
0 likes · 20 min read

CPU caches bridge the speed gap between processors and memory, but cache misses can dramatically degrade performance, especially under high concurrency or big‑data workloads; this article explains cache architecture, common miss causes, diagnostic tools like perf and cachestat, and practical optimization techniques for Linux systems.
CPU cacheMESI protocolcache coherence
0 likes · 44 min read

This article explains how key‑value (KV) caching and the new CachedAttention technique dramatically reduce large‑language‑model inference costs by reusing stored attention data across dialogue turns, leveraging a three‑tier memory hierarchy of HBM, DRAM, and SSD to overcome bandwidth and capacity bottlenecks.
AI performanceCachedAttentionKV Cache
0 likes · 8 min read

This article explains how compilers generate load/store instructions, why modern CPUs rely on multi‑level caches instead of direct memory access, the impact of program locality, cache write policies, replacement strategies, and the challenges of cache coherence in multicore systems.
CISCCPUCache
0 likes · 14 min read

This article explains how memory hierarchy and cache design, guided by the principle of locality, reduce the CPU‑memory speed gap, and provides practical guidelines for writing cache‑friendly code to dramatically improve program performance.
Cache Memorycomputer architecturememory hierarchy
0 likes · 14 min read

This article explains why modern CPUs need cache memory, describes the hierarchy of L1‑L3 caches, the principles of locality, write policies, multi‑core coherence mechanisms such as bus snooping and the MESI protocol, and offers practical code‑level optimizations to improve cache performance.
CPUCacheMESI protocol
0 likes · 31 min read

This article provides a detailed technical comparison between Nvidia's Blackwell GB202 GPU and AMD's RDNA4 RX 9070, covering CPU and GPU updates, SM front‑end design, memory hierarchies, execution units, atomics, L2 performance, power consumption, and real‑world benchmark results such as FluidX3D.
AMD RDNA4GPU architectureNVIDIA Blackwell
0 likes · 21 min read

This article explains the principles of CPU cache, the multi‑level memory hierarchy, virtual memory, data consistency, and concurrency control mechanisms, illustrating how they together bridge the speed gap between the fast processor and slower memory/storage in modern computer systems.
CPUWrite Policiescomputer architecture
0 likes · 21 min read

CPU cache, a multi‑level SRAM memory positioned between registers and main memory, evolved from non‑existent in early CPUs to sophisticated L1‑L4 hierarchies, addressing the massive speed disparity between processors and RAM by exploiting spatial and temporal locality to dramatically boost overall system performance.
CPUCachecomputer architecture
0 likes · 10 min read

This article explains how CPU caches bridge the speed gap between the processor and main memory, describes cache hierarchy, locality principles, write policies, coherence protocols, and provides concrete C code examples and practical tips such as data alignment and loop restructuring to improve cache hit rates and overall program speed.
CPU cacheMESI protocolcache coherence
0 likes · 30 min read

The article explains how CPUs read and write memory through a hierarchy of caches, virtual memory translation, and coherence protocols, revealing that the seemingly simple operation actually involves multiple hardware and software layers that programmers must understand to write high‑performance code.
CacheCoherencememory hierarchy
0 likes · 16 min read

This article explains the evolution of CPU cache, its underlying principles of temporal and spatial locality, various cache architectures, implementation details, and practical considerations such as cache line size and replacement policies, providing a comprehensive overview for developers and computer engineers.
CPUCachememory hierarchy
0 likes · 20 min read

This article explains why CPU caches are needed, describes the hierarchy and internal structure of L1, L2, and L3 caches, compares direct‑mapped, set‑associative and fully‑associative designs, and shows how cache‑aware coding (row‑major vs column‑major loops) dramatically improves execution speed.
CPU cachecache architecturecache types
0 likes · 12 min read

The article explains that software performance is measured in milliseconds to nanoseconds, describes core hardware components—CPU, caches, and DRAM—shows how cache hierarchy speeds differ, defines a clock cycle as the basic time unit, and provides typical latency figures for operations ranging from a single CPU cycle to a full system reboot.
CPU cycleslatencymemory hierarchy
0 likes · 7 min read

The article explains why iterating a two‑dimensional array by rows runs dramatically faster than by columns, covering memory‑hierarchy basics, locality principles, cache behavior, cache‑line mechanics, and Linux perf measurements that reveal a 20‑fold speed gap caused by cache‑miss rates.
Cachec-programminglocality
0 likes · 11 min read

This article explains the four main categories of computer storage—Level 1 (directly attached memory), Level 2 (I/O‑connected drives like HDDs and SSDs), Level 3 (large removable media such as tape), and offline storage (manual devices like optical discs and USB drives)—and clarifies how Direct‑Attached Storage (DAS) and RAID technologies fit into this hierarchy.
DASRAIDcomputer storage
0 likes · 5 min read

This article explains the fundamental principles of computer operation, covering the von Neumann model, CPU and RAM interaction, instruction sets, memory hierarchy, caches, endianness, compilers, operating systems, and performance optimizations, while illustrating each concept with diagrams and code examples.
CPUcompilerscomputer architecture
0 likes · 28 min read

This article explains the fundamental principles of how computers operate, covering the basic architecture of CPUs and memory, the role of buses and registers, instruction sets, compiler translation, cache hierarchies, storage layers, and the impact of 32‑bit versus 64‑bit designs.
CPUInstruction Setcompilers
0 likes · 27 min read

This article provides a comprehensive overview of FPGA technology, detailing its programmable logic cells, input/output blocks, switch matrices, historical evolution, flexibility versus ASIC and GPU, memory hierarchy including on‑chip and HBM2e, and the benefits of Network‑on‑Chip architectures for performance, power and design modularity.
ASICFPGAGPU
0 likes · 12 min read

This article explains the purpose of CPU caches, describes the three cache levels and their internal structures—including direct‑mapped, set‑associative, and fully‑associative designs—and shows how cache‑aware programming can dramatically improve code performance.
CPU cacheFully AssociativeSet Associative
0 likes · 11 min read

This article explains the purpose of CPU cache memory, the principles of temporal and spatial locality, the multi‑level cache architecture, the MESI cache‑coherence protocol for multi‑core processors, and the optimizations such as store buffers and memory barriers that address performance and consistency challenges.
CPU cachecache coherencememory hierarchy
0 likes · 16 min read

This article explains how modern computer systems use a hierarchical memory structure and virtual memory to overcome physical memory limitations, address translation challenges, fragmentation, and security issues, detailing concepts such as page tables, TLB caching, multi‑level paging, and practical examples.
TLBaddress translationmemory hierarchy
0 likes · 21 min read

This article provides a comprehensive overview of how computers operate, covering CPU instruction cycles, memory organization, endianness, compiler translation, operating‑system interaction, cache levels, storage tiers, and the principles of temporal and spatial locality that drive modern performance optimizations.
CPUcachescompilers
0 likes · 27 min read

The article explains how modern computers use fast SRAM caches (L1‑L3) inside the CPU with various mapping schemes and the MESI coherence protocol to keep data consistent, while DRAM serves as main memory, and virtual memory with multi‑level page tables and a TLB abstracts physical memory, provides isolation, and enables swapping.
CPU cacheMESI protocolTLB
0 likes · 16 min read

This article explains the memory hierarchy—from registers to disks—covers cache fundamentals, the principle of locality, cache organization (including direct‑mapped caches), and provides guidelines and example code for writing cache‑friendly programs to improve performance.
Cachecache-friendly programmingcomputer architecture
0 likes · 15 min read

This article explains the basic principles of computer architecture, covering CPU operation, memory hierarchy, cache levels, instruction sets, compilation, endianness, and related concepts such as simulators and operating system interactions, illustrating how simple instructions enable complex computations.
CPUInstruction Setcaches
0 likes · 27 min read

This article explores the core principles of computer operation, covering CPU architecture, memory hierarchy, instruction execution, compiler role, cache levels, and the impact of hardware design on performance, while illustrating concepts with diagrams and practical examples to demystify how modern computers process data.
CPUcompilerscomputer architecture
0 likes · 27 min read

This article explains the structure of modern CPU caches, the principles of cache lines, associativity, and coherence protocols, and demonstrates how these hardware details affect program performance through multiple code examples covering loop stride, matrix traversal, multithreading, and false sharing.
CPU cacheMultithreadingcache coherence
0 likes · 21 min read


21CTODec 2, 2021 · Fundamentals
This article provides a comprehensive overview of CPU caches, covering why they are needed, their classification, placement and lookup mechanisms, replacement and write policies, and coherence protocols such as MESI, illustrating each concept with diagrams and code examples.
CPUCachecache coherence
0 likes · 11 min read

This article explores the role of cache in computer architecture, covering why caches are needed, how data is placed and retrieved, various replacement policies, write strategies, and consistency protocols such as MESI, while illustrating concepts with diagrams and code examples.
CacheCache ConsistencyLRU
0 likes · 12 min read

This article explains the motivation behind CPU caches, describes their placement in the memory hierarchy, details cache organization, placement policies, lookup mechanisms, replacement strategies, write handling, and coherence protocols such as MESI, providing a comprehensive overview of cache fundamentals.
CPUCachecache coherence
0 likes · 13 min read

This article explains the fundamental principles of computer operation, covering CPU architecture, memory organization, instruction execution, compiler translation, caching strategies, and the role of operating systems, while illustrating concepts with diagrams and code examples.
CPUCachingcompilers
0 likes · 25 min read

This article explains the basic principles of computer architecture, covering CPU operation, memory organization, binary representation, instruction sets, caching levels, storage hierarchy, compilers, script languages, and the impact of open‑source software on system design.
CPUCachingStorage
0 likes · 26 min read

This article explains the basic principles of how computers work, covering CPU and memory organization, instruction sets, endianness, compiler role, operating system interaction, cache levels, storage technologies, and performance optimization techniques.
CPUCachingcompilers
0 likes · 28 min read

This article provides a comprehensive overview of cache memory, explaining why caches are needed, their placement strategies, operation principles, replacement policies, write handling methods, and coherence protocols such as MESI, offering essential knowledge for computer architecture and system design.
CacheReplacement Policiescomputer architecture
0 likes · 12 min read

This article explains the purpose of CPU caches, their classification, placement and replacement strategies, write policies, and coherence protocols, providing a comprehensive overview of cache concepts essential for modern computer architecture.
CacheLRUcache coherence
0 likes · 13 min read

This article explains the motivation behind CPU caches, their classification, placement and lookup methods, replacement and write policies, and coherence protocols, providing a comprehensive overview of cache fundamentals for modern computer architectures.
LRUcache coherencememory hierarchy
0 likes · 14 min read

The article explains the purpose and structure of the memory hierarchy—from ultra‑fast registers and caches inside the CPU, through volatile main memory, to slower non‑volatile disks—showing how programs are loaded, executed, and how virtual memory and locality principles extend usable memory beyond physical limits.
CacheRegisterscomputer architecture
0 likes · 12 min read

This article explains how computer systems combine hardware and system software, describes the memory hierarchy, OS abstractions, Amdahl's law, and the three levels of parallelism—thread‑level, instruction‑level, and SIMD—showing why understanding these concepts is essential for writing fast, reliable programs.
Amdahl's LawParallelismcomputer architecture
0 likes · 16 min read

This article explains the role of CPU cache in modern processors, covering its types, how it works within the memory hierarchy, the differences among L1, L2, and L3 levels, and the impact of cache hits, misses, and latency on overall system performance.
CPUCacheL1
0 likes · 8 min read

This article explains the role of CPU cache in modern processors, covering its purpose, the memory hierarchy, the differences between L1, L2, and L3 caches, how cache hits and misses affect latency, and future trends such as larger and on‑chip caches.
CPUcomputer architecturememory hierarchy
0 likes · 8 min read

This article explains what CPU cache is, why it matters for processor performance, how it works within the memory hierarchy, the differences among L1, L2, and L3 caches, the impact of cache hits and misses on latency, and emerging trends in cache design.
CPUcomputer architecturememory hierarchy
0 likes · 7 min read

Understanding CPU cache hierarchy, its speed advantages over memory, and the mechanics of cache lines, tags, and offsets reveals why code that maximizes cache hit rates—through sequential data access, branch prediction, and core affinity—can run dramatically faster on modern processors.
CPU cacheCache Hit RateLow-Level Programming
0 likes · 18 min read

This article explains why cache memory is essential for modern CPUs, how different loop orders affect cache hits, the structure of direct‑mapped, set‑associative and fully‑associative caches, multi‑level cache hierarchies, and the policies that govern cache allocation and updates.
CPU performanceCacheSet Associative
0 likes · 21 min read

This article provides a comprehensive overview of operating system fundamentals, covering hardware components, kernel and user modes, CPU architecture, memory hierarchy, caching strategies, I/O devices, bus systems, boot processes, and various types of operating systems from mainframes to embedded devices.
CPU designI/O devicesboot process
0 likes · 34 min read

This article explains basic computer concepts such as storage units, registers, memory hierarchy, kernel and user space, CPU word length, and then details the Java Virtual Machine's runtime data areas, object creation process, and object reference mechanisms.
CPU architectureJVMJava
0 likes · 14 min read


DevOpsApr 17, 2016 · Fundamentals
Through a whimsical first‑person narrative, the article walks readers through a CPU’s start‑up sequence, BIOS interrupt handling, loading the boot sector, memory access patterns, the principle of locality, cache usage, and the introduction of pipelining to illustrate fundamental computer architecture concepts.
CPUCacheboot process
0 likes · 11 min read


21CTOAug 26, 2015 · Fundamentals
Registers outrun main memory because they sit closer to the CPU, employ high‑performance hardware designs, and involve far fewer access steps, a distinction illustrated with examples from iPhone 5s architecture and detailed step‑by‑step memory access processes.
CPU architectureRegistershardware design
0 likes · 6 min read

This article explains why CPU caches are needed, the evolution to multi‑level caches, the concept of cache lines, practical experiments demonstrating their impact, and how different cache organization strategies such as fully associative, direct‑mapped, and N‑way set‑associative affect performance and eviction policies.
cache architecturecache linememory hierarchy
0 likes · 14 min read
