Tagged articles

mixed linear attention

2 articles · Page 1 of 1

Jul 17, 2026 · Artificial Intelligence

Kimi K3 Unveiled: 2.8 Trillion‑Parameter Open‑Source LLM Sets New Record

On July 16, the Moon‑of‑Darkness team released Kimi K3, a 2.8‑trillion‑parameter open‑source large language model that introduces mixed‑linear attention, attention residuals, and a highly efficient Mixture‑of‑Experts design, achieving roughly 2.5× the scaling efficiency of its predecessor while approaching the performance of top closed‑source models.

Kimi K3Large Language ModelOpen source AI

0 likes · 6 min read

Kimi K3 Unveiled: 2.8 Trillion‑Parameter Open‑Source LLM Sets New Record

AntTech

Feb 16, 2026 · Artificial Intelligence

Ling‑2.5‑1T: Open‑Source 1‑Trillion‑Parameter Instant LLM with 1M‑Token Context

Ling‑2.5‑1T is an open‑source instant large language model with 1 trillion total parameters, 63 B active weights, and a 1 M token context window, featuring mixed‑linear attention, a composite correctness‑plus‑process reward for token efficiency, fine‑grained alignment, and leading benchmark performance across reasoning, instruction‑following, and agentic tasks.

Large Language Modelagentic interactionbenchmark

0 likes · 13 min read

Ling‑2.5‑1T: Open‑Source 1‑Trillion‑Parameter Instant LLM with 1M‑Token Context

mixed linear attention

Kimi K3 Unveiled: 2.8 Trillion‑Parameter Open‑Source LLM Sets New Record

Ling‑2.5‑1T: Open‑Source 1‑Trillion‑Parameter Instant LLM with 1M‑Token Context

Kimi K3 Unveiled: 2.8 Trillion‑Parameter Open‑Source LLM Sets New Record