Skip to content
Tagged articles

Post-Training

52 articles · Page 1 of 1
Machine Heart
Machine Heart
Nov 14, 2026 · Artificial Intelligence

RSI Arena: AI Agents Self-Train Models, But Popularity ≠ Capability or Safety

The RSI Arena experiment had 10 frontier AI agents autonomously post-train a base model under equal compute constraints, evaluating via benchmarks and human blind voting; results show optimal strategies beat raw compute, human preference correlates with response length not capability, and popularity doesn't guarantee safety, prompting the RSIHF framework for human-in-the-loop recursive improvement.

AI agentsAI safetyHuman Feedback
0 likes · 14 min read
RSI Arena: AI Agents Self-Train Models, But Popularity ≠ Capability or Safety
SmartApe AI
SmartApe AI
Nov 5, 2026 · Artificial Intelligence

Zhipu GLM-5.5 Post-Training Aims for 100% RSI and 100T Tokens

Leaked R&D records reveal Zhipu is conducting end-to-end programming post-training on 32B, 122B, and 256B models for GLM-5.5, targeting 100% recursive self-improvement via coding agents, a 100T token dataset goal, and new scale-correctness validation methods.

100T tokensGLM-5.5HarnessPro
0 likes · 10 min read
Zhipu GLM-5.5 Post-Training Aims for 100% RSI and 100T Tokens
AntTech
AntTech
Oct 27, 2026 · Artificial Intelligence

Ant Group's Bailing Open-Sources Ling-3.1-flash Models for Personal Agents

Ant Group's Bailing team open-sources Ling-3.1-flash-base (560B MoE, 25B active) and post-trained Ling-3.1-flash-1019 (44 on Artificial Analysis Index), detailing architecture, benchmark results across 47 tests, vision model Ling-3.1-flash-VL, and real-world Personal Agent applications like homework analysis and travel planning.

Ant GroupLLMMoE architecture
0 likes · 12 min read
Ant Group's Bailing Open-Sources Ling-3.1-flash Models for Personal Agents
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 26, 2026 · Artificial Intelligence

On-Policy Distillation Explained: White-Box, Self-Distillation & Black-Box Methods

This article provides a comprehensive analysis of On-Policy Distillation (OPD), covering white-box distillation with token-level probability matching, self-distillation using privileged context, black-box distillation via reward modeling, and industrial applications from MiMo, DeepSeek, and Qwen, while discussing OPD's limitations and generalization capabilities.

Black-Box DistillationGKDMiniLLM
0 likes · 56 min read
On-Policy Distillation Explained: White-Box, Self-Distillation & Black-Box Methods
SmartApe AI
SmartApe AI
Oct 13, 2026 · Artificial Intelligence

Why AI's Next Era Is Automation, Not Claude Code: RLHF's Fundamental Limit

Diogo Almeida argues that current RLHF-trained AI excels at human-assisted tasks but fails at true automation because its optimization target is human preference, not calibrated correctness, and proposes a new post-training paradigm optimizing for reliable, automated decision-making in software.

AI assistantsAI automationPost-Training
0 likes · 12 min read
Why AI's Next Era Is Automation, Not Claude Code: RLHF's Fundamental Limit
Machine Heart
Machine Heart
Oct 11, 2026 · Artificial Intelligence

Tsinghua's MGFlow & Elastic Forcing: Distributional Training for One-Step Images & Streaming Video

Tsinghua researchers introduce MGFlow and Elastic Forcing, two distributional training methods that achieve state-of-the-art one-step image generation and enable efficient 14B-parameter streaming video model post-training on just 8 GPUs, using sample distribution matching instead of per-sample supervision.

Elastic ForcingMGFlowPost-Training
0 likes · 20 min read
Tsinghua's MGFlow & Elastic Forcing: Distributional Training for One-Step Images & Streaming Video
SmartApe AI
SmartApe AI
Oct 8, 2026 · Artificial Intelligence

Tang Jie Unveils GLM's AGI Roadmap: Pre-training, Post-training & Agent Scaling

Zhipu AI founder Tang Jie outlines GLM's five-stage evolution toward AGI — Knowledge, Chat, Coding, LHT, and AAS — highlighting three scaling directions: pre-training, post-training with RL, and agentic reasoning, while introducing SAO for long-horizon agent training and emphasizing memory over context length.

AGIGLMMemory Mechanisms
0 likes · 10 min read
Tang Jie Unveils GLM's AGI Roadmap: Pre-training, Post-training & Agent Scaling
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 7, 2026 · Artificial Intelligence

VeriLoop E2 Advances Riemann Hypothesis Zero Proportion to 67.35% with Verifiable AI

Tsinghua researchers open-source VeriLoop E2, a post-trained model using verifiable recurrence to achieve 67.35% zero proportion lower bound for Riemann hypothesis, while setting new benchmarks in code, math, and physics reasoning with external verification.

Post-TrainingQwen 3.8-27BRiemann hypothesis
0 likes · 40 min read
VeriLoop E2 Advances Riemann Hypothesis Zero Proportion to 67.35% with Verifiable AI
Machine Heart
Machine Heart
Oct 7, 2026 · Artificial Intelligence

SAGE: Topological Guidance Mitigates Long-Horizon Reasoning Biases, 8x Lean Pass Rate

Researchers from Virginia Tech, UW-Madison, and Dartmouth introduce SAGE, a post-training method that uses symbolic closure analysis to diagnose exploration and accumulation biases in long-horizon reasoning, applying algebraic sparsification and hyperbolic structure guidance to improve sampling and provide early feedback, achieving near 8x Lean verification pass rate on Andrews-Curtis tasks and outperforming baselines across 12 benchmarks.

Andrews-CurtisLean verificationLong-Horizon Reasoning
0 likes · 14 min read
SAGE: Topological Guidance Mitigates Long-Horizon Reasoning Biases, 8x Lean Pass Rate
Baobao Algorithm Notes
Baobao Algorithm Notes
Oct 3, 2026 · Artificial Intelligence

Jev's Decision Model Threatens Fine-Tuning Roles in Business AI

Jev, a new System One model from TypeSafe AI, outputs calibrated decisions instead of tokens using RLCD rather than RLHF, offering speed, generalization, and calibrated confidence that could shrink business post-training roles for classification, routing, and filtering tasks, leaving only constrained long-text generation and non-standard schema extraction.

CalibrationDecision ModelJev
0 likes · 20 min read
Jev's Decision Model Threatens Fine-Tuning Roles in Business AI
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Sep 29, 2026 · Artificial Intelligence

AI That Builds AI: Naive AI's Self-Evolving Models Beat Top Benchmarks in 151 Experiments

Naive AI demonstrates AI-driven R&D where agents autonomously redesign model architectures, optimize training systems, and achieve breakthrough benchmarks—Naive-N0.5-Flash surpasses larger models on coding and research tasks, while AI-built NaiveRT delivers 30-50x inference speedups and AutoWM sets new world model records through self-discovered algorithms.

AI for AIAI research agentsInference Optimization
0 likes · 22 min read
AI That Builds AI: Naive AI's Self-Evolving Models Beat Top Benchmarks in 151 Experiments
Machine Heart
Machine Heart
Sep 27, 2026 · Artificial Intelligence

LIFT: Teaching VLA Models Force Perception via Post-Training Without Force Pretraining

Shanghai Jiao Tong University's LIFT method enables Vision-Language-Action models to learn force perception through post-training alone, achieving significant performance gains on contact-rich tasks with only 20-30 force-labeled demonstrations while preserving pretrained knowledge via weight copying and shifted causal attention.

CoRL 2026LIFTPost-Training
0 likes · 8 min read
LIFT: Teaching VLA Models Force Perception via Post-Training Without Force Pretraining
Tech Architecture Stories
Tech Architecture Stories
Sep 24, 2026 · Artificial Intelligence

From Harness to Weights: Enterprise AI's Autonomous Intelligence Loop

The article analyzes how enterprise AI is evolving from external harness scaffolding to internalized model weights, forming a closed loop where harness strategies are validated in production, decision traces become private evaluation and post-training data, and stable behaviors are distilled into specialized model weights, as demonstrated by Harvey, Glean, Engram, Strands, NVIDIA×Palantir, and Grok 4.7.

AI LoopDecision TracesHarness Architecture
0 likes · 16 min read
From Harness to Weights: Enterprise AI's Autonomous Intelligence Loop
java1234
java1234
Sep 16, 2026 · Artificial Intelligence

Why LLM Post-Training Got Hard: 5 Paradigm Shifts in 6 Months

This article analyzes five major paradigm shifts in large model post-training over the past six months, covering expert distillation, online distillation as RL alternative, RLVR refinements, SFT-RL distribution mismatch, and data quality as irreducible constraint, with specific papers and metrics.

Post-TrainingRLVRReinforcement Learning
0 likes · 11 min read
Why LLM Post-Training Got Hard: 5 Paradigm Shifts in 6 Months
Tech Architecture Stories
Tech Architecture Stories
Sep 11, 2026 · Industry Insights

Harvey's $15.5B Vertical Neo-Lab: Beyond Legal ChatGPT to Closed-Loop AI Training

This analysis of Harvey, a $15.5B legal AI company, reveals its 'vertical Neo-Lab' model that integrates real legal workflows, legal engineers, expert evaluations, agent runtimes, and synthetic training environments into a closed loop, prioritizing task definition and evaluation before model training, offering five lessons for enterprise AI startups.

HarveyLegal AIModel Evaluation
0 likes · 11 min read
Harvey's $15.5B Vertical Neo-Lab: Beyond Legal ChatGPT to Closed-Loop AI Training
Alibaba Cloud Native
Alibaba Cloud Native
Sep 5, 2026 · Artificial Intelligence

DeepSeek Harness: Architecting Enterprise Evolution via Post-Training Design

This article analyzes DeepSeek Harness from a post-training perspective, revealing how its architecture bakes enterprise evolution into environment shaping and trajectory sedimentation, validated by a self-evolution POC that identifies interface design, contract shape, and feedback quality as critical bottlenecks.

Agent ArchitectureDeepSeek HarnessPoC validation
0 likes · 37 min read
DeepSeek Harness: Architecting Enterprise Evolution via Post-Training Design
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Sep 4, 2026 · Artificial Intelligence

Sliding Window Attention Beats Linear Attention: Microsoft's 0-Training Baseline Matches Costly Post-Training

Microsoft research shows sliding window attention with four attention sinks achieves 99% performance recovery on knowledge tasks without any post-training, matching linear attention methods requiring hundreds of millions of tokens while outperforming them 2-10x on long-context benchmarks.

KV CacheLinear attentionLong Context
0 likes · 9 min read
Sliding Window Attention Beats Linear Attention: Microsoft's 0-Training Baseline Matches Costly Post-Training
Fighter's World
Fighter's World
Aug 14, 2026 · Artificial Intelligence

How Companies Can Build Their Own Intelligent Moat as Models and Frameworks Become Commoditized

As AI models and frameworks turn into off‑the‑shelf components, enterprises must convert their unique business knowledge—task standards, evaluations, harnesses, and continual learning loops—into proprietary intelligent assets that persist beyond each model upgrade, creating a sustainable competitive moat.

AI agentsContinual LearningPost-Training
0 likes · 28 min read
How Companies Can Build Their Own Intelligent Moat as Models and Frameworks Become Commoditized
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Aug 13, 2026 · Artificial Intelligence

Why RL Matters: From Reinforcement Learning to (Soft) Distillation

The article argues that reinforcement learning is crucial in post‑training because it refines and localizes chain‑of‑thought patterns learned during supervised fine‑tuning, improves model controllability, and can be complemented or substituted by distillation—especially soft distillation—to transfer high‑quality patterns from stronger teachers to weaker models.

LLMPost-TrainingReinforcement Learning
0 likes · 12 min read
Why RL Matters: From Reinforcement Learning to (Soft) Distillation
Fighter's World
Fighter's World
Aug 12, 2026 · Artificial Intelligence

Why Successful AI Application Companies Are Shifting from Renting to Owning Intelligence

As foundation models become more capable, AI application firms initially rely on external APIs, but in high‑stakes domains they must capture task standards, expert rubrics, data, and feedback in a continuous learning loop, prompting a strategic shift from renting to owning core intelligence, illustrated by Harvey’s legal AI practice.

AI strategyLegal AIPost-Training
0 likes · 30 min read
Why Successful AI Application Companies Are Shifting from Renting to Owning Intelligence
Machine Heart
Machine Heart
Aug 9, 2026 · Artificial Intelligence

Why Continual Learning Won’t Take Ten Years—Five Hot Paths and the Fight Against Catastrophic Forgetting

The article surveys five emerging approaches to LLM continual learning—external agent memory, context engineering, post‑training, pre‑training, and self‑modifying models—explaining how each tackles the core obstacle of catastrophic forgetting, citing benchmarks such as TRACE, ACE, and SDFT, and reflecting on Karpathy’s ten‑year timeline.

Agent MemoryCatastrophic ForgettingContinual Learning
0 likes · 17 min read
Why Continual Learning Won’t Take Ten Years—Five Hot Paths and the Fight Against Catastrophic Forgetting
Model Perspective
Model Perspective
Jul 31, 2026 · Artificial Intelligence

Understanding the Post-Training Process in DeepSeek V4‑Flash

DeepSeek released the V4‑Flash model with the same architecture as the preview but a revamped post‑training pipeline—SFT, reinforcement learning with GRPO, and distillation—yielding dramatic benchmark jumps and illustrating how post‑training now defines the model's real‑world capabilities.

DeepSeekGRPOLLM training
0 likes · 11 min read
Understanding the Post-Training Process in DeepSeek V4‑Flash
AI Large-Model Wave and Transformation Guide
AI Large-Model Wave and Transformation Guide
Jul 31, 2026 · Artificial Intelligence

DeepSeek V4‑Flash Official Release: Agent Upgrade, Post‑Training Boost, and Codex Integration

DeepSeek announced the public beta of its V4‑Flash model, highlighting a dramatic agent capability upgrade, performance gains from post‑training that surpass the previous preview and rival Opus 4.8 on DSBench tests, native Responses API support, full Codex compatibility, and easy setup scripts for developers.

AI ModelAgentCodex Integration
0 likes · 6 min read
DeepSeek V4‑Flash Official Release: Agent Upgrade, Post‑Training Boost, and Codex Integration
DataFunSummit
DataFunSummit
Jul 24, 2026 · Industry Insights

Why High-Quality Data Is the New Bottleneck in Large Model Competition

In a four‑hour investor briefing, DeepSeek founder Liang Wenfeng explains that the real competitive edge for large language models now lies in the ability to continuously produce high‑quality training signals, a capability limited by time rather than capital.

AI industryDeepSeekHigh-Quality Data
0 likes · 10 min read
Why High-Quality Data Is the New Bottleneck in Large Model Competition
Fighter's World
Fighter's World
Jun 21, 2026 · Artificial Intelligence

How Post‑Training Turns General AI into Enterprise‑Specific Intelligence

The article explains how post‑training shifts AI investment from massive pre‑training compute to targeted, low‑cost fine‑tuning that lets enterprises embed proprietary business logic, outlines the ROI formula based on data exclusivity, eval formalizability, and task frequency, and presents real‑world case studies.

AI economicsPost-TrainingReinforcement Learning
0 likes · 24 min read
How Post‑Training Turns General AI into Enterprise‑Specific Intelligence
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 19, 2026 · Artificial Intelligence

Can Post‑Training Close the Gap to Mythos‑Level AI? Musk Says 9 Months, Tang Says Faster

The article analyzes whether post‑training on GLM‑5.1/5.2 can bridge the gap to the banned Mythos model, citing Musk’s nine‑month claim, Tang’s rebuttal, Mind Lab’s benchmark gains, architectural adaptations, and the high barriers that make post‑training a critical yet scarce capability in China.

AI developmentGLM-5.2IndexCache
0 likes · 9 min read
Can Post‑Training Close the Gap to Mythos‑Level AI? Musk Says 9 Months, Tang Says Faster
Machine Heart
Machine Heart
Jun 19, 2026 · Artificial Intelligence

Who Is Quietly Building China’s Mythos‑Level AI? Musk Says 9 Months, Tang Says It’s Not That Fast

The article analyzes China’s race to achieve Mythos‑level intelligence, contrasting Musk’s nine‑month claim with Tang’s skepticism, and highlights Mind Lab’s unique post‑training work on GLM‑5.1/5.2 that has already delivered significant benchmark gains, while outlining the technical hurdles and timeline uncertainties.

AI development in ChinaGLM-5.2Mind Lab
0 likes · 8 min read
Who Is Quietly Building China’s Mythos‑Level AI? Musk Says 9 Months, Tang Says It’s Not That Fast
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 18, 2026 · Artificial Intelligence

Can a 3B Model Rival Claude Opus 4.5? Benchmark Gaps or Aggressive Post‑Training?

VibeThinker‑3B, a 3‑billion‑parameter language model built on Qwen2.5‑Coder‑3B, achieves scores within the range of 671 B‑parameter models on benchmarks such as LiveCodeBench, AIME26, IMO‑AnswerBench and GPQA, thanks to a two‑stage SFT, multi‑domain reinforcement learning, offline self‑distillation and a claim‑reliability (CLR) evaluator that together push its reasoning ability to the frontier.

Post-TrainingReinforcement LearningVibeThinker-3B
0 likes · 9 min read
Can a 3B Model Rival Claude Opus 4.5? Benchmark Gaps or Aggressive Post‑Training?
Network Intelligence Research Center (NIRC)
Network Intelligence Research Center (NIRC)
May 25, 2026 · Artificial Intelligence

What Does On-Policy Distillation Really Teach Large Language Models?

On-Policy Distillation (OPD) trains large language models by letting the student generate its own inference paths while the teacher supplies token‑level guidance, offering denser signals than RL but sometimes failing when teacher and student reasoning diverge, as detailed by THUNLP’s recent study.

Distillation MetricsPost-TrainingToken-level Supervision
0 likes · 8 min read
What Does On-Policy Distillation Really Teach Large Language Models?
Baobao Algorithm Notes
Baobao Algorithm Notes
May 22, 2026 · Artificial Intelligence

How LiteScale Cuts Wait Times in Large‑Model Post‑Training with Gradient Accumulation

The article examines the bottleneck of synchronous rollout in large‑model post‑training, proposes an asynchronous design using gradient accumulation and a global micro‑batch count to preserve loss equivalence, and introduces LogitsExpress for efficient top‑K knowledge‑distillation communication, all implemented in the lightweight LiteScale framework.

Post-Trainingasynchronous rolloutdistributed training
0 likes · 16 min read
How LiteScale Cuts Wait Times in Large‑Model Post‑Training with Gradient Accumulation
Machine Heart
Machine Heart
May 8, 2026 · Artificial Intelligence

How an 8B Video‑Language Model Beats GPT‑5 and Gemini‑3.1‑Pro at Cinematic Understanding

The CHAI framework introduced by CMU and Harvard defines a structured video‑language annotation scheme, scalable human‑AI oversight, and a post‑training pipeline that enables an 8B open‑source model to outperform closed‑source GPT‑5 and Gemini‑3.1‑Pro on professional cinematic techniques.

Post-TrainingQwen3-VLannotation
0 likes · 11 min read
How an 8B Video‑Language Model Beats GPT‑5 and Gemini‑3.1‑Pro at Cinematic Understanding
Xiaomi Tech
Xiaomi Tech
Apr 27, 2026 · Artificial Intelligence

Xiaomi‑Robotics‑0: 20‑Hour Post‑Training Enables Seamless Earphone‑Box Assembly (Open‑Source)

The article details how Xiaomi‑Robotics‑0 achieves precise earphone‑to‑case insertion after only 20 hours of post‑training, outlines the sub‑millimetre precision challenges, presents a triple‑strategy (asynchronous execution, adaptive loss re‑weighting, Λ‑shape attention mask and random masking) to avoid the "lazy effect", and releases the full pipeline and code as open source for the robotics community.

Embodied AIPost-TrainingXiaomi Robotics
0 likes · 6 min read
Xiaomi‑Robotics‑0: 20‑Hour Post‑Training Enables Seamless Earphone‑Box Assembly (Open‑Source)
Architect
Architect
Apr 25, 2026 · Artificial Intelligence

DeepSeek V4: 1M‑Token Context’s Impact on Model, Inference, Cache & Agents

The DeepSeek V4 technical report shows how a 1 million‑token context forces a redesign of attention, KV‑cache, optimizer, quantization and inference budgeting, turning long‑context capability from a costly showcase into a production‑ready feature for agents, search and Chinese professional tasks.

1M contextAgentic SearchAttention optimization
0 likes · 28 min read
DeepSeek V4: 1M‑Token Context’s Impact on Model, Inference, Cache & Agents
AIWalker
AIWalker
Apr 20, 2026 · Artificial Intelligence

How VA‑π Bridges Tokenizers and Autoregressive Generators for Pixel‑Perfect Images

VA‑π introduces a lightweight post‑training framework that uses variational inference and reinforcement learning to align tokenizers with visual autoregressive generators, achieving dramatic quality gains, extreme training efficiency, and robust pixel‑level reconstruction across diverse image generation tasks.

Pixel AlignmentPost-TrainingReinforcement Learning
0 likes · 14 min read
How VA‑π Bridges Tokenizers and Autoregressive Generators for Pixel‑Perfect Images
Machine Heart
Machine Heart
Apr 19, 2026 · Artificial Intelligence

World Engine: How Post‑Training Is Launching a New Era of Physical AGI

World Engine introduces a post‑training pipeline that combines high‑fidelity 3DGS simulation, hard‑case mining with diffusion generation, and reinforcement‑learning optimization to give autonomous‑driving models true decision‑making ability, surpassing data‑scaling limits and achieving significant safety gains in both industrial simulations and real‑world tests.

Autonomous DrivingPhysical AIPost-Training
0 likes · 11 min read
World Engine: How Post‑Training Is Launching a New Era of Physical AGI
Data Party THU
Data Party THU
Apr 12, 2026 · Artificial Intelligence

What’s Driving the Next Wave of LLM Post‑Training? A Deep Dive into SFT, RLHF, GRPO and Emerging Trends

This article systematically reviews the core post‑training techniques for large language models—including supervised fine‑tuning, RLHF, PPO, GRPO, DPO, RLVR and Agentic RL—explains their evolution, compares their trade‑offs, and highlights the most promising research directions for 2025‑2026.

AI AlignmentGRPOLLM
0 likes · 20 min read
What’s Driving the Next Wave of LLM Post‑Training? A Deep Dive into SFT, RLHF, GRPO and Emerging Trends
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Mar 15, 2026 · Artificial Intelligence

Is RL Dead in LLM Post-Training? MIT’s RandOpt Challenges Traditional Methods

The MIT‑CSAIL paper introduces RandOpt, a single‑step, gradient‑free, fully parallel post‑training algorithm that adds Gaussian noise to pretrained LLM weights and ensembles the results, achieving or surpassing PPO/GRPO performance by exploiting dense "neural thickets" that emerge as model scale grows.

LLMPost-TrainingRandOpt
0 likes · 12 min read
Is RL Dead in LLM Post-Training? MIT’s RandOpt Challenges Traditional Methods
PaperAgent
PaperAgent
Jan 8, 2026 · Artificial Intelligence

How SOP Enables Scalable Online Post-Training for Real‑World Robots

The SOP (Scalable Online Post‑training) framework redesigns VLA post‑training from offline, single‑machine, sequential processing to a distributed, parallel online system, allowing robot fleets to continuously learn, share experiences, and scale intelligence while maintaining stability and generalization in complex real‑world environments.

Post-TrainingRoboticsSOP
0 likes · 11 min read
How SOP Enables Scalable Online Post-Training for Real‑World Robots
Baobao Algorithm Notes
Baobao Algorithm Notes
Nov 11, 2025 · Artificial Intelligence

Why Redesign the Training Stack? Inside Olmo‑Thinking’s Open‑Source RL Journey

This article provides a detailed technical analysis of the Olmo‑Thinking project, covering why a new open‑source LLM was built, the challenges of reinforcement learning at scale, data‑mix optimization, architectural bottlenecks such as missing GQA and QK‑Norm, and the post‑training techniques used to improve reasoning and long‑context capabilities.

Post-TrainingRLVRdata selection
0 likes · 20 min read
Why Redesign the Training Stack? Inside Olmo‑Thinking’s Open‑Source RL Journey
Code Archaeology
Code Archaeology
Oct 20, 2025 · Artificial Intelligence

LLaMA 2 & 3 Deep Dive: Architecture Innovations (RMSNorm, RoPE, GQA) and Post-Training Pipeline

This article explains Meta's LLaMA model series, detailing LLaMA 2's architectural innovations—RMSNorm, SwiGLU, rotary positional encoding, and grouped-query attention—and LLaMA 3's post-training pipeline including supervised fine-tuning, reward modeling, rejection sampling, and direct preference optimization.

DPOGrouped-Query AttentionLLM Architecture
0 likes · 10 min read
LLaMA 2 & 3 Deep Dive: Architecture Innovations (RMSNorm, RoPE, GQA) and Post-Training Pipeline
Hailey Says
Hailey Says
Sep 7, 2025 · Artificial Intelligence

What to Consider When Discussing Large AI Models

The article explains how to choose suitable large AI models for product use by focusing on three key aspects—model inference, post‑training optimization techniques such as quantization, pruning and distillation, and the role of GPUs, including their kernels, software stack, and computing platforms.

GPUPost-Traininginference
0 likes · 8 min read
What to Consider When Discussing Large AI Models
Alibaba Cloud Developer
Alibaba Cloud Developer
Jul 31, 2025 · Artificial Intelligence

Why Post‑Training Matters: Scaling Laws, Fine‑Tuning, and RL Strategies for LLMs

This article explores the importance of post‑training for large language models, explains scaling laws for pre‑ and post‑training, details common fine‑tuning methods (full, PEFT, LoRA), outlines alignment techniques such as RLHF, DPO, PPO, and presents practical workflows using Llama 3 and DeepSeek‑R1, while also discussing test‑time reasoning optimizations.

LLMPost-TrainingRLHF
0 likes · 19 min read
Why Post‑Training Matters: Scaling Laws, Fine‑Tuning, and RL Strategies for LLMs
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Jun 25, 2025 · Artificial Intelligence

Boost Post‑Training Efficiency with Cosmos‑RL, Ray, and VeRL on Alibaba PAI

This article introduces Alibaba Cloud's PAI platform and demonstrates how open‑source reinforcement‑learning frameworks such as Cosmos‑RL, Ray, and VeRL accelerate post‑training for large language models, offering higher throughput, fault‑tolerance, and seamless integration for AI developers.

AI PlatformOpen Source FrameworksPost-Training
0 likes · 9 min read
Boost Post‑Training Efficiency with Cosmos‑RL, Ray, and VeRL on Alibaba PAI
Baobao Algorithm Notes
Baobao Algorithm Notes
Mar 21, 2025 · Artificial Intelligence

Unlocking LLM Reasoning: A Deep Dive into Post‑Training Techniques

This article provides a comprehensive technical overview of large language model post‑training, covering fine‑tuning methods (full, parameter‑efficient, LoRA families, prompt tuning), domain‑adaptive tuning, reinforcement‑learning reward modeling, process vs. outcome rewards, inference‑enhancement strategies, dynamic compute allocation, verifier‑augmented reasoning, current challenges, and emerging research directions such as meta‑cognition, physical reasoning, and swarm intelligence.

LLMPost-Trainingmeta-cognition
0 likes · 21 min read
Unlocking LLM Reasoning: A Deep Dive into Post‑Training Techniques
Baobao Algorithm Notes
Baobao Algorithm Notes
Sep 29, 2024 · Artificial Intelligence

Decoding OpenAI o1: Test‑Time Scaling, PRM Search & Inference Strategies

This article analyses the training tricks behind OpenAI's o1 model, explaining test/inference‑time scaling laws, post‑training techniques, process‑supervised reward models (PRM), various inference‑time search methods, data‑collection pipelines, and the trade‑offs between allocating compute to pre‑training versus inference.

LLM inferenceOpenAI o1Post-Training
0 likes · 34 min read
Decoding OpenAI o1: Test‑Time Scaling, PRM Search & Inference Strategies