Three Forms of Large Model Memory – Parameter, Token, and Latent – Why Top Companies Are All‑In
A new paper unifies AI memory research with a three‑dimensional framework (Forms, Functions, Dynamics), classifies memory as parameter‑level, token‑level, or latent‑space, and evaluates real‑world implementations from OpenAI, Google, Amazon and dozens of open‑source frameworks, highlighting trade‑offs such as retrieval quality, catastrophic forgetting and forgetting mechanisms.
