Skip to content
Tagged articles

state space models

5 articles · Page 1 of 1
AI2ML AI to Machine Learning
AI2ML AI to Machine Learning
Oct 28, 2026 · Artificial Intelligence

Attention Evolution: From Transformer to Dynamic Sparse & Hybrid LLM Architectures

This article traces the evolution of attention mechanisms from early visual attention and RNN-based attention through the Transformer revolution to modern sparse, linear, and state-space variants, detailing recent innovations like GQA, MLA, dynamic sparse attention (MoBA, NSA), hybrid architectures, and cross-layer memory sharing in open-source LLMs such as Llama, DeepSeek, and Qwen.

Attention MechanismCross-Layer SharingDynamic Sparse Attention
0 likes · 17 min read
Attention Evolution: From Transformer to Dynamic Sparse & Hybrid LLM Architectures
Bighead's Algorithm Notes
Bighead's Algorithm Notes
Mar 5, 2026 · Artificial Intelligence

AB‑SSM: Adaptive Bidirectional State‑Space Model for High‑Frequency Portfolio Management

The paper introduces AB‑SSM, an adaptive bidirectional state‑space model that incorporates a time‑varying linear structure and a bidirectional layer to capture market non‑stationarity and asset correlations, and demonstrates through extensive US, China, and crypto experiments that it outperforms traditional, deep‑learning, and DRL baselines in profit‑risk trade‑offs, efficiency, and scalability.

adaptive linear time-varyingbidirectional SSMdeep reinforcement learning
0 likes · 12 min read
AB‑SSM: Adaptive Bidirectional State‑Space Model for High‑Frequency Portfolio Management
AI Frontier Lectures
AI Frontier Lectures
Jul 24, 2025 · Artificial Intelligence

State Space Models vs Transformers: Uncovering the Real Trade‑offs in Sequence Modeling

This article analyzes the fundamental differences between state space models (SSM) and Transformer architectures, highlighting their three core components, training efficiency, memory handling, tokenization impact, and empirical performance trade‑offs, and argues why SSMs can outperform Transformers on many sequence tasks.

AI ArchitectureSequence ModelingTransformers
0 likes · 19 min read
State Space Models vs Transformers: Uncovering the Real Trade‑offs in Sequence Modeling
NewBeeNLP
NewBeeNLP
Mar 4, 2024 · Artificial Intelligence

A Curated Tour of Mamba Papers: 25 Cutting‑Edge State‑Space Model Innovations

This article presents a GitHub‑hosted collection of 25 recent research papers on Mamba and its variants, summarizing each work’s core contributions across sequence modeling, vision, medical imaging, graph analysis, and multimodal tasks, and highlighting their performance gains over prior methods.

Computer VisionMambaSequence Modeling
0 likes · 13 min read
A Curated Tour of Mamba Papers: 25 Cutting‑Edge State‑Space Model Innovations