Machine Heart

Oct 18, 2026 · Artificial Intelligence

Elad Hazan's 20-Year OCO Retrospective: Regret Minimization, AdaGrad, and AI Frameworks

Princeton professor Elad Hazan recounts 20 years of Online Convex Optimization research, from inventing Online Newton Step and co-creating AdaGrad to developing spectral filtering for dynamical systems and Flash STU architectures, arguing that as AI excels at theorem-proving, human value lies in choosing problems and inventing frameworks.