BestHub
Sign in
Tagged articles

reinforcement learning

822 articles · Page 2 of 9
PaperAgent
PaperAgent
Jun 11, 2026 · Artificial Intelligence

184 Ready-to-Use PINN Innovations Powering Nature‑Level Research

The article compiles 184 practical PINN innovations—including theory advances, new training paradigms, and integrations with Bayesian methods, reinforcement learning, Transformers, and graph neural networks—along with ready-to-use source code and starter resources for researchers seeking cutting‑edge physics‑informed neural network solutions.

Adaptive MethodsPINNScientific Computing
0 likes · 7 min read
184 Ready-to-Use PINN Innovations Powering Nature‑Level Research
Machine Heart
Machine Heart
Jun 10, 2026 · Artificial Intelligence

Can AI Bridge the College Application Gap? Alibaba’s Free Volunteer‑Filling Agent Tested by 400K AI Candidates

Alibaba’s free Qianwen high‑school volunteer‑filling Agent combines a knowledge base of 3,000 schools, proactive calendar planning, persistent memory and reinforcement‑learning‑trained LLM to guide 12.9 million candidates, and its performance was stress‑tested with 400,000 simulated AI applicants.

AI AgentCollege AdmissionsEducation Technology
0 likes · 10 min read
Can AI Bridge the College Application Gap? Alibaba’s Free Volunteer‑Filling Agent Tested by 400K AI Candidates
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 10, 2026 · Artificial Intelligence

OneReason: Enabling Recommendation Systems to Reason

OneReason introduces a systematic reasoning capability into industrial recommendation models through multi‑stage pre‑training, chain‑of‑thought fine‑tuning, and reinforcement learning, achieving significant gains in click‑through, revenue, and cross‑domain recommendation performance while preserving the underlying language abilities of the base model.

Recommendation Systemschain-of-thoughtindustrial AI
0 likes · 29 min read
OneReason: Enabling Recommendation Systems to Reason
Machine Heart
Machine Heart
Jun 9, 2026 · Artificial Intelligence

OneReason: When Recommendation Systems Learn to Reason

The OneReason report details how Kuaishou’s recommendation team injects reasoning into large‑scale recommender models through a four‑level pre‑training pipeline, chain‑of‑thought (CoT) fine‑tuning, and specialized reinforcement learning, achieving significant offline gains and a 10.33% exposure lift in a live A/B test.

CoTLLMindustry
0 likes · 31 min read
OneReason: When Recommendation Systems Learn to Reason
DataFunSummit
DataFunSummit
Jun 6, 2026 · Artificial Intelligence

From Traffic Links to Task Management: 1688’s Agentic AI Evolution

The article details how 1688 transformed its platform from a traditional intent‑matching traffic hub into an Agentic AI system that understands business tasks, outlining a three‑step implementation of knowledge, trajectory and environment redesign, dual‑track evolution, novel evaluation methods, and the emerging role of product managers as evaluation engineers.

Retrieval-Augmented GenerationSkill Hubagentic AI
0 likes · 13 min read
From Traffic Links to Task Management: 1688’s Agentic AI Evolution
Alimama Tech
Alimama Tech
Jun 4, 2026 · Artificial Intelligence

ICML 2026 Highlights: Five Taotian Group Papers Pushing Multimodal AI Boundaries

The article showcases five ICML 2026 papers from the Taotian Group that tackle core multimodal AI challenges—interactive video try‑on, high‑resolution vision, e‑commerce video reasoning, sparse‑reward reinforcement learning, and curriculum learning for large language models—detailing their problem statements, novel solutions, and strong experimental results.

ICML 2026Large Language Modelsbenchmark
0 likes · 15 min read
ICML 2026 Highlights: Five Taotian Group Papers Pushing Multimodal AI Boundaries
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 1, 2026 · Artificial Intelligence

MetaAgent-X Enables Agents to Self‑Evolve: A New Paradigm for Native Collaboration

MetaAgent‑X integrates system design and execution within a single base model, using hierarchical rollout and stagewise co‑evolution to jointly train Designer and Executor roles, and achieves significant gains over single‑agent and prior multi‑agent baselines on math and code benchmarks.

AI collaborationLarge Language ModelsMetaAgent-X
0 likes · 13 min read
MetaAgent-X Enables Agents to Self‑Evolve: A New Paradigm for Native Collaboration
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 31, 2026 · Artificial Intelligence

MetaAgent-X Enables Self‑Evolving Agents for Native Collaboration

MetaAgent-X tackles the limitation of fixed‑executor multi‑agent systems by jointly training a Designer that creates lightweight Python‑based collaboration scripts and an Executor that runs them, using hierarchical rollouts and stagewise co‑evolution to improve both design and execution across math and code benchmarks.

LLMMetaAgent-Xhierarchical rollout
0 likes · 13 min read
MetaAgent-X Enables Self‑Evolving Agents for Native Collaboration
Data Party THU
Data Party THU
May 31, 2026 · Artificial Intelligence

Reinforcement Learning Launches a New Paradigm for Spatial Omics Experiment Design

A reinforcement‑learning framework called SOFisher, developed by teams from Fudan and Beijing Institute of Technology, enables intelligent, adaptive selection of field‑of‑view positions in costly spatial‑omics experiments, dramatically improving target detection efficiency and revealing disease‑relevant cellular niches with far fewer measurements.

AI-driven microscopyAlzheimer's diseaseSOFisher
0 likes · 7 min read
Reinforcement Learning Launches a New Paradigm for Spatial Omics Experiment Design
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 30, 2026 · Artificial Intelligence

Breaking the Agent Training Bottleneck: Open‑Source ClawGym Data, Training, and Evaluation Pipeline

ClawGym provides a complete open‑source framework for Claw‑style personal agents, linking a 13.5 K synthetic task dataset, black‑box rollout training, sandbox‑parallel reinforcement learning, and a rigorously verified benchmark of 200 tasks, and demonstrates that synthetic data can lift a 30 B model beyond a 235 B baseline.

Agent TrainingClawGymOpenClaw
0 likes · 16 min read
Breaking the Agent Training Bottleneck: Open‑Source ClawGym Data, Training, and Evaluation Pipeline
Machine Heart
Machine Heart
May 30, 2026 · Artificial Intelligence

How Abstract Symbols Cut AI Inference Cost by 11×

The article examines IBM Research's Abstract‑CoT approach, which replaces verbose natural‑language chain‑of‑thought reasoning with a compact abstract token vocabulary, achieving up to an 11‑fold reduction in inference tokens while maintaining comparable accuracy across math, instruction‑following, and multi‑hop QA benchmarks.

AI InferenceAbstract-CoTLarge Language Models
0 likes · 11 min read
How Abstract Symbols Cut AI Inference Cost by 11×
AI Engineering
AI Engineering
May 30, 2026 · Artificial Intelligence

A Unified Toolbox for JEPA and World Model Research: stable-worldmodel

Researchers tackling world‑model problems often rebuild data pipelines, environments, and baselines from scratch, but the open‑source stable‑worldmodel platform consolidates diverse dataset formats, SOTA baselines, hundreds of environments, and multiple solvers, offering a three‑step workflow with demonstrated storage and speed advantages.

JEPALanceDBWorld Models
0 likes · 4 min read
A Unified Toolbox for JEPA and World Model Research: stable-worldmodel
SuanNi
SuanNi
May 29, 2026 · Artificial Intelligence

SenseNova-U1-8B-MoT-Infographic: Academic Charts, Posters, Recipes

The SenseNova-U1-8B-MoT-Infographic model dramatically improves AI‑generated infographics by enhancing dense‑text rendering, layout stability, and chart accuracy through targeted data, extended mid‑training, and reinforcement‑learning fine‑tuning, achieving top scores on BizGenEval and IGenBench and surpassing many commercial rivals.

AI modelMultimodalSenseNova
0 likes · 9 min read
SenseNova-U1-8B-MoT-Infographic: Academic Charts, Posters, Recipes
Old Zhang's AI Learning
Old Zhang's AI Learning
May 29, 2026 · Artificial Intelligence

How NVIDIA’s Polar Enables Any Agent Framework to Plug Into Reinforcement Learning

Integrating diverse AI agent harnesses into reinforcement‑learning pipelines is notoriously labor‑intensive, but NVIDIA’s new Polar system inserts an API‑proxy layer that treats any harness as a black box, enabling seamless rollout recording and trajectory reconstruction, as demonstrated by dramatic performance gains on a 4B model across multiple harnesses.

AI AgentAPI ProxyNvidia
0 likes · 10 min read
How NVIDIA’s Polar Enables Any Agent Framework to Plug Into Reinforcement Learning
Bighead's Algorithm Notes
Bighead's Algorithm Notes
May 29, 2026 · Artificial Intelligence

AlphaCFG: Grammar‑Guided, Interpretable Alpha‑Factor Discovery Framework

AlphaCFG introduces a grammar‑based framework that defines a controllable search space for discovering syntactically valid, financially interpretable alpha factors, using syntax‑aware Monte‑Carlo tree search guided by value and policy networks, and demonstrates superior search efficiency and profitability on Chinese and US stock datasets.

Grammar Guided SearchMonte Carlo Tree Searchalpha factor
0 likes · 17 min read
AlphaCFG: Grammar‑Guided, Interpretable Alpha‑Factor Discovery Framework
Machine Heart
Machine Heart
May 29, 2026 · Artificial Intelligence

DiffusionOPD: A New Online Policy Distillation Paradigm for Multi‑Task Diffusion Models

DiffusionOPD introduces a unified on‑policy distillation framework for diffusion models that decouples single‑task online policy exploration from multi‑task capability integration, training expert teachers per task and distilling their skills into a single student model, achieving faster convergence and higher performance across composition, OCR, and aesthetic tasks.

KL DivergenceOn-Policy DistillationPPO
0 likes · 8 min read
DiffusionOPD: A New Online Policy Distillation Paradigm for Multi‑Task Diffusion Models
SuanNi
SuanNi
May 28, 2026 · Artificial Intelligence

How a 3.8B Model Beats 6B+ Models Using Just 20% of the Compute – Inside Microsoft Lens

Microsoft’s Lens team shows that a 3.8 B‑parameter image‑generation model can match or surpass 6 B‑plus models while consuming only about 19 % of the GPU compute, thanks to aggressive model compression, dense captioning, mixed‑resolution training, optimized VAE and language encoders, and targeted RL fine‑tuning.

Benchmarkingdense captioningimage generation
0 likes · 14 min read
How a 3.8B Model Beats 6B+ Models Using Just 20% of the Compute – Inside Microsoft Lens
Alimama Tech
Alimama Tech
May 28, 2026 · Artificial Intelligence

TAR: Multi‑Scale Trajectory Model Fixes Granularity Mismatch, Raising CTR >12%

The paper introduces the Trajectory Auto‑Regressive (TAR) model, which uses multi‑scale trajectory generation, a VQ‑VAE latent compression, and a state‑action fusion architecture to address granularity mismatch between fine‑grained decision steps and coarse‑grained feedback in online advertising, achieving over 12% CTR lift, smoother budget pacing, and faster inference compared to prior baselines.

Budget PacingMulti-Scale GenerationOnline Advertising
0 likes · 18 min read
TAR: Multi‑Scale Trajectory Model Fixes Granularity Mismatch, Raising CTR >12%
HyperAI Super Neural
HyperAI Super Neural
May 28, 2026 · Artificial Intelligence

Large-Model RL Advances: Credit Allocation, Complex Reasoning, Agent Learning

HyperAI curates six cutting‑edge large‑model reinforcement‑learning papers—from ECHO’s free world‑model learning to DelTA’s discriminative token credit, GoLongRL’s capability‑oriented long‑context RL, Anti‑SD’s reverse distillation, RubricEM’s rubric‑guided policy decomposition, and Poly‑EPO’s diversity‑driven exploration—highlighting their methods, benchmarks, and performance gains.

Agent LearningComplex ReasoningCredit Assignment
0 likes · 10 min read
Large-Model RL Advances: Credit Allocation, Complex Reasoning, Agent Learning
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 28, 2026 · Artificial Intelligence

Open‑Source 35B Intern‑S2‑Preview Rivals Trillion‑Parameter Models on Scientific Benchmarks

The open‑source 35‑billion‑parameter Intern‑S2‑Preview model achieves scientific‑task performance comparable to trillion‑parameter models, thanks to full‑link “general‑specialized” training, reinforced‑learning scaling, and hardware‑aware optimizations, and it outperforms leading closed‑source models on benchmarks such as MolecularIQ and crystal‑structure generation.

InternLMScientific AIbenchmark
0 likes · 11 min read
Open‑Source 35B Intern‑S2‑Preview Rivals Trillion‑Parameter Models on Scientific Benchmarks
Data Party THU
Data Party THU
May 27, 2026 · Artificial Intelligence

How Bengio’s TBA Decouples Sampling and Learning to Speed Up LLM RL by 50×

The article explains how large‑language‑model post‑training suffers from rollout bottlenecks, introduces the Trajectory Balance with Asynchrony (TBA) framework that separates a Searcher from a Trainer, reuses off‑policy trajectories via a Trajectory Balance objective, and demonstrates up to 50× speed‑ups while preserving or improving performance on math reasoning, preference fine‑tuning, and automated red‑team tasks.

Asynchronous TrainingLLMOff-Policy
0 likes · 9 min read
How Bengio’s TBA Decouples Sampling and Learning to Speed Up LLM RL by 50×
SuanNi
SuanNi
May 26, 2026 · Artificial Intelligence

Why Tokens Are Burning Out and a Free Claude Opus 4.6‑Level Model Is Coming

The SkyClaw‑v1.0 model from Skywork AI offers a free, soon‑to‑be open‑source large‑language model for agent applications that matches Claude Opus 4.6 in performance while cutting token costs dramatically, and the article details its benchmarks, training pipeline, and deployment recommendations.

AgentOpenAI APISkyClaw
0 likes · 7 min read
Why Tokens Are Burning Out and a Free Claude Opus 4.6‑Level Model Is Coming
Machine Heart
Machine Heart
May 23, 2026 · Artificial Intelligence

Why Can’t LLMs Directly Copy AlphaGo’s MCTS Success?

The article analyzes why large language models cannot simply adopt AlphaGo’s Monte‑Carlo Tree Search, highlighting credit‑assignment difficulties, gradient‑variance explosion in multi‑step RL, and how AlphaGo’s tight integration of value and policy networks amortizes search in a way LLMs cannot replicate.

AlphaGoCredit AssignmentLLM
0 likes · 6 min read
Why Can’t LLMs Directly Copy AlphaGo’s MCTS Success?
Machine Heart
Machine Heart
May 22, 2026 · Artificial Intelligence

ATLAS: One Word Unifies Agentic and Latent Visual Reasoning

ATLAS introduces a discrete functional token that simultaneously serves as an agentic operation and a latent reasoning unit, enabling large multimodal models to perform visual tasks without external tools or intermediate image generation, and achieves competitive results through SFT‑plus‑RL training and a token‑level gradient‑anchor technique.

ATLASVisual Reasoningagentic reasoning
0 likes · 11 min read
ATLAS: One Word Unifies Agentic and Latent Visual Reasoning
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 21, 2026 · Artificial Intelligence

Breaking the UED Bottleneck: PACE Locates the Reinforcement‑Learning Zone of Proximal Development

The paper introduces PACE, a Parameter‑Change based Unsupervised Environment Design method that evaluates training levels by the magnitude of induced policy‑parameter updates, offering a low‑variance, computationally cheap signal that consistently outperforms prior UED approaches on MiniGrid and Craftax benchmarks.

CraftaxICML 2026MiniGrid
0 likes · 11 min read
Breaking the UED Bottleneck: PACE Locates the Reinforcement‑Learning Zone of Proximal Development
Machine Heart
Machine Heart
May 21, 2026 · Artificial Intelligence

Breaking the Traditional UED Bottleneck: Using RL to Precisely Locate the Zone of Proximal Development

The paper introduces PACE, a Parameter Change Environment Design method that evaluates training levels by measuring induced policy parameter updates, offering a low‑variance learning‑progress signal that outperforms prior UED approaches on MiniGrid and Craftax benchmarks, achieving higher success rates and more stable generalization.

CraftaxICML 2026MiniGrid
0 likes · 10 min read
Breaking the Traditional UED Bottleneck: Using RL to Precisely Locate the Zone of Proximal Development
Old Zhang's AI Learning
Old Zhang's AI Learning
May 21, 2026 · Artificial Intelligence

SkillOS: Enabling Agents to Self‑Manage Their Skills

SkillOS reframes skill management for LLM agents as a long‑horizon reinforcement‑learning problem, letting a trainable Skill Curator automatically insert, update, or delete markdown‑based skills, which the frozen Agent Executor then consumes, improving memory‑free performance and cross‑task transfer.

LLM AgentsMarkdownSkillOS
0 likes · 6 min read
SkillOS: Enabling Agents to Self‑Manage Their Skills
Machine Heart
Machine Heart
May 21, 2026 · Artificial Intelligence

OneModel 1.7 Hits 99% LIBERO Success, Bridging ‘Seeing’ to ‘Doing’ with Implicit Predictive Policy

OneModel 1.7 FrontoStria‑RL achieves a 99% average success rate on the LIBERO benchmark, surpassing π0.5, GR00T‑N1.5 and OpenVLA‑OFT, by introducing a Predictive Policy Latent that implicitly links world‑model understanding to action execution and is continuously refined through a reinforcement‑learning loop and a Retrieve‑then‑Steer memory mechanism.

LIBERO BenchmarkPredictive Policy LatentWorld Models
0 likes · 15 min read
OneModel 1.7 Hits 99% LIBERO Success, Bridging ‘Seeing’ to ‘Doing’ with Implicit Predictive Policy
Data Party THU
Data Party THU
May 21, 2026 · Artificial Intelligence

ICML 2026: MedScope Introduces a New Paradigm for Long Medical Video Reasoning—From Watching to Verifying

MedScope proposes a "Think with Videos" paradigm that lets AI models actively locate and verify evidence in long clinical videos, using coarse‑to‑fine tool calling, evidence‑centric training data (ClinVideoSuite) and a grounding‑aware reinforcement learning objective, achieving superior performance on multiple video‑understanding benchmarks.

Evidence-based QALong Video ReasoningMedical Video AI
0 likes · 10 min read
ICML 2026: MedScope Introduces a New Paradigm for Long Medical Video Reasoning—From Watching to Verifying
PaperAgent
PaperAgent
May 21, 2026 · Artificial Intelligence

238 Promising Reinforcement‑Learning Ideas Likely to Earn CCF‑A Papers in 2026

The article compiles 238 cutting‑edge reinforcement‑learning ideas across 21 research directions, highlights recent breakthroughs such as Sutton’s Intentional Updates, and provides brief overviews of representative papers—including knowledge‑graph, Kalman‑filter, agentic, LLM‑driven, and world‑model approaches—along with links to the accompanying source code.

Agentic RLKalman filterKnowledge Graph
0 likes · 6 min read
238 Promising Reinforcement‑Learning Ideas Likely to Earn CCF‑A Papers in 2026
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 20, 2026 · Artificial Intelligence

Composer 2.5 Narrows the Gap to Claude Opus 4.7 with Ten‑Fold Cost Savings

Composer 2.5, the latest AI‑coding model from Cursor, claims near‑par performance with Claude 4.7 Opus and GPT‑5.5 while delivering up to ten‑times higher efficiency and a pricing model of $0.5 per M input tokens and $2.5 per M output tokens, backed by novel reinforcement‑learning tricks, massive synthetic data, and a custom Muon optimizer with dual‑grid HSDP architecture.

AI programmingComposer 2.5Cost Efficiency
0 likes · 13 min read
Composer 2.5 Narrows the Gap to Claude Opus 4.7 with Ten‑Fold Cost Savings
DeepHub IMBA
DeepHub IMBA
May 19, 2026 · Artificial Intelligence

A 2026 Survey of LLM‑Focused RL: From PPO to DPO, GRPO, and Multi‑Agent RL

The article reviews five years of LLM‑centric reinforcement learning, tracing the evolution from early Q‑learning to PPO, then to Direct Preference Optimization, Group Relative Policy Optimization, and finally multi‑agent RL, detailing each method’s mechanics, strengths, failure modes, practical considerations, and emerging open‑source toolchains.

DPOGRPOLLM alignment
0 likes · 33 min read
A 2026 Survey of LLM‑Focused RL: From PPO to DPO, GRPO, and Multi‑Agent RL
Machine Heart
Machine Heart
May 19, 2026 · Artificial Intelligence

HyperEyes: Parallel Multimodal Search Agents Move from Deep to Wide for Efficiency

HyperEyes introduces a unified‑location‑as‑search (UGS) action space, parallel data synthesis, and a dual‑granularity efficiency‑aware RL framework that enable multimodal agents to perform simultaneous multi‑target retrieval, dramatically reducing interaction rounds while improving accuracy and cost‑efficiency across benchmark evaluations.

AgentEfficiencybenchmark
0 likes · 9 min read
HyperEyes: Parallel Multimodal Search Agents Move from Deep to Wide for Efficiency
Machine Heart
Machine Heart
May 19, 2026 · Artificial Intelligence

100k‑Token Natural‑Language Reasoning Enables a 30B‑A3B Model to Reach Olympiad Gold Level

A 30B‑A3B model, trained with reverse‑perplexity supervised fine‑tuning, two‑stage reinforcement learning, and a multi‑round generate‑verify‑revise inference loop, achieves gold‑medal performance on IMO, USAMO and IPhO contests using over 100 k token natural‑language reasoning without external tools.

30B-A3Bnatural language processingolympiad AI
0 likes · 11 min read
100k‑Token Natural‑Language Reasoning Enables a 30B‑A3B Model to Reach Olympiad Gold Level
ByteDance SE Lab
ByteDance SE Lab
May 19, 2026 · Artificial Intelligence

Introducing Uni-Agent: veRL’s Open‑Source Unified Framework for General‑Purpose Agent Training

Uni-Agent is an open‑source framework that unifies building, running, and training of general AI agents, offering extensible model, tool, and environment modules, scalable sandbox execution via veFaaS, live monitoring, and demonstrated performance gains on large‑scale coding‑agent experiments.

AgentScalable ExecutionUnified Framework
0 likes · 8 min read
Introducing Uni-Agent: veRL’s Open‑Source Unified Framework for General‑Purpose Agent Training
AI Insight Log
AI Insight Log
May 19, 2026 · Artificial Intelligence

Cursor Returns with Composer 2.5: Openly Built on Kimi, 10× Lower Cost, Musk Endorses

Cursor unveiled Composer 2.5, reporting benchmark scores comparable to Opus 4.7 and GPT‑5.5, a ten‑fold cost reduction, explicit use of Moonshot’s Kimi K2.5 as a base, new RL training techniques, and a partnership with SpaceXAI that multiplies compute power, all highlighted by Elon Musk’s retweet.

AI modelComposer 2.5Cost Efficiency
0 likes · 10 min read
Cursor Returns with Composer 2.5: Openly Built on Kimi, 10× Lower Cost, Musk Endorses
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 19, 2026 · Artificial Intelligence

From P(y|x) to P(y): Reinforcement Learning in Pre‑train Space Unlocks Endogenous Reasoning

The paper introduces PreRL, which removes the input condition to directly optimize the reasoning trajectory (P(y)) of large language models, and combines it with standard RL in Dual Space RL (DSRL), achieving consistent gains on math and out‑of‑distribution benchmarks, faster training, and richer reasoning behaviors.

DSRLLarge Language ModelsMath Benchmarks
0 likes · 11 min read
From P(y|x) to P(y): Reinforcement Learning in Pre‑train Space Unlocks Endogenous Reasoning
Machine Heart
Machine Heart
May 18, 2026 · Artificial Intelligence

Composer 2.5 Delivers Opus‑level Performance at One‑Tenth the Cost

Composer 2.5, Cursor’s latest LLM, matches Claude Opus 4.7‑level capabilities while costing roughly one‑tenth as much, thanks to larger training scale, precise text‑feedback reinforcement learning, 25× more synthetic tasks, and a new Muon‑HSDP optimizer that boosts efficiency up to ten‑fold.

Composer 2.5Cost EfficiencyLLM
0 likes · 9 min read
Composer 2.5 Delivers Opus‑level Performance at One‑Tenth the Cost
Bighead's Algorithm Notes
Bighead's Algorithm Notes
May 18, 2026 · Artificial Intelligence

FineFT: Efficient Risk-Aware Reinforcement Learning for Futures Trading

FineFT introduces a three‑stage ensemble reinforcement‑learning framework that tackles high‑leverage reward volatility and missing ability‑boundary awareness in crypto futures trading by using selective TD‑error updates, VAE‑based market‑state boundary detection, and a risk‑aware routing mechanism, ultimately outperforming twelve baselines on six financial metrics while cutting risk by over 40%.

Variational Autoencoderensemble methodsfinancial RL
0 likes · 12 min read
FineFT: Efficient Risk-Aware Reinforcement Learning for Futures Trading
Machine Heart
Machine Heart
May 18, 2026 · Artificial Intelligence

ICML 2026: Teaching Large Models to Think and Speak – Turning “When to Speak” into a Learnable Strategy

The paper “When to Think, When to Speak” introduces Side‑by‑Side Interleaved Reasoning, a learnable disclosure policy that lets LLMs alternate between internal thinking and user‑visible answer fragments, reducing content latency while preserving or improving accuracy on math and scientific QA benchmarks.

CoTLLMQwen3
0 likes · 10 min read
ICML 2026: Teaching Large Models to Think and Speak – Turning “When to Speak” into a Learnable Strategy
Machine Heart
Machine Heart
May 17, 2026 · Artificial Intelligence

What Exactly Is a World Model? History, Technology, and the $10 B Bet

The article traces the two decades‑long, parallel research lines that birthed video world models—dreaming agents in reinforcement learning and learning physics from human video—explains how they converged in 2024‑2025, evaluates current capabilities and limitations, and analyzes the $10 billion investment landscape and strategic moves by NVIDIA, OpenAI, and others.

AI researchSimulationVideo Generation
0 likes · 32 min read
What Exactly Is a World Model? History, Technology, and the $10 B Bet
Machine Heart
Machine Heart
May 16, 2026 · Artificial Intelligence

GIPO: Overcoming Utilization Collapse for Efficient Large‑Model Reinforcement Learning

GIPO (Gaussian Importance Sampling Policy Optimization) replaces PPO’s hard clipping with a smooth Gaussian‑weighted trust region, achieving log‑space symmetry and bias‑variance balance that mitigates policy lag and utilization collapse, and demonstrates superior stability and sample efficiency on GridWorld, LIBERO, MetaWorld, and 7‑billion‑parameter VLA experiments.

Bias-Variance TradeoffGIPOLarge‑Scale Training
0 likes · 17 min read
GIPO: Overcoming Utilization Collapse for Efficient Large‑Model Reinforcement Learning
Machine Heart
Machine Heart
May 16, 2026 · Artificial Intelligence

Why More Compute Can't Fix LLM Inference Lag and Why RL Leads to Overtraining

In a deep interview, former Google TPU architect Reiner Pope explains that low‑concurrency fast‑mode services trade higher fees for faster streaming but are limited by memory‑bandwidth bottlenecks, that optimal concurrency balances compute and memory costs, and that pipeline‑parallel sparse expert models and reinforcement‑learning fine‑tuning introduce new inefficiencies and overtraining risks.

LLMOvertrainingPipeline Parallelism
0 likes · 7 min read
Why More Compute Can't Fix LLM Inference Lag and Why RL Leads to Overtraining
Machine Heart
Machine Heart
May 14, 2026 · Artificial Intelligence

Breaking Homogeneous Reasoning: I²B‑LPO Guides RLVR from Repeated Sampling to Effective Exploration

I²B‑LPO is an exploration‑enhancement framework for RLVR that branches rollouts at high‑entropy nodes, injects latent variables via pseudo self‑attention, and filters paths with an information‑bottleneck self‑reward, achieving up to 5.3% accuracy and 7.4% diversity improvements on multiple math reasoning benchmarks.

RLVRentropyexploration
0 likes · 14 min read
Breaking Homogeneous Reasoning: I²B‑LPO Guides RLVR from Repeated Sampling to Effective Exploration
Machine Heart
Machine Heart
May 14, 2026 · Artificial Intelligence

How PsiBot Uses 100,000 Hours of Human Data to Power Embodied Intelligence

PsiBot demonstrates that, with a 100,000‑hour human‑operation dataset captured via exoskeleton gloves and ego‑vision, a world‑model (W0) and reinforcement‑learning policy (R2) can bridge the gap to robot control, offering a scalable alternative to costly teleoperation pipelines.

Data Collectionembodied AIhuman data
0 likes · 12 min read
How PsiBot Uses 100,000 Hours of Human Data to Power Embodied Intelligence
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 12, 2026 · Artificial Intelligence

Breaking Off‑Policy Shift: Bengio’s TBA Decouples Sampling and Learning for 50× Faster LLM RL

Trajectory Balance with Asynchrony (TBA) separates sample generation (Searcher) from model updates (Trainer), uses a trajectory‑balance objective to incorporate off‑policy data, and achieves up to 50× speedup in large‑model RL post‑training while preserving or improving performance on math reasoning, preference fine‑tuning, and red‑team tasks.

Asynchronous TrainingLLMLarge Language Models
0 likes · 10 min read
Breaking Off‑Policy Shift: Bengio’s TBA Decouples Sampling and Learning for 50× Faster LLM RL
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 12, 2026 · Artificial Intelligence

LaST‑R1: Embodied Robot Model Hits 99.9% LIBERO Success via Physical Reasoning

LaST‑R1 presents a new embodied AI framework that inserts latent physical reasoning before action generation and jointly optimizes reasoning and control with LAPO, achieving 99.9% average success on the LIBERO benchmark after a single‑trajectory warm‑up and boosting real‑world task success from 52.5% to 93.75%, while showing superior generalization to unseen objects, backgrounds and lighting.

LAPOLIBERO Benchmarkadaptive CoT
0 likes · 11 min read
LaST‑R1: Embodied Robot Model Hits 99.9% LIBERO Success via Physical Reasoning
Data Party THU
Data Party THU
May 12, 2026 · Artificial Intelligence

MathForge: Leveraging Hard Problems in RL to Boost Large‑Model Mathematical Reasoning (ICLR 2026)

MathForge tackles the long‑standing question of which math problems deserve focus in reinforcement‑learning‑based training, introducing a difficulty‑aware optimizer (DGPO) and multi‑aspect question reformulation (MQR) that together prioritize harder‑but‑learnable questions, yielding consistent performance gains across model sizes and modalities.

DGPODifficulty‑Aware OptimizationLarge Language Models
0 likes · 11 min read
MathForge: Leveraging Hard Problems in RL to Boost Large‑Model Mathematical Reasoning (ICLR 2026)
AsiaInfo Technology: New Tech Exploration
AsiaInfo Technology: New Tech Exploration
May 12, 2026 · Artificial Intelligence

Silicon Brain: Neural Connections, Symbolic Reasoning, and Reinforcement Learning in AGI

This article analyses DeepMind’s three‑pronged AGI paradigm—combining neural networks, symbolic systems, and reinforcement learning—by dissecting AlphaGo, AlphaFold 2, Gemini, and the Genie‑Sima loop, mapping the biological inspiration, outlining engineering and safety challenges, and proposing research directions for large‑scale deployment in communication scenarios.

AGIDeepMindEngineering Challenges
0 likes · 21 min read
Silicon Brain: Neural Connections, Symbolic Reasoning, and Reinforcement Learning in AGI
Smart Sea Tide
Smart Sea Tide
May 12, 2026 · Artificial Intelligence

UI-Venus-1.5: How Ant Group’s Open‑Source GUI Agent Achieves SOTA Performance

UI‑Venus‑1.5, an open‑source end‑to‑end GUI agent from Ant Group, tackles knowledge gaps, offline‑online mismatch, and high coordination costs by introducing mid‑stage training with a 10 B‑token corpus, online reinforcement learning, a “split‑then‑merge” model fusion, and a scalable DaaS layer, achieving top scores on VenusBench‑GD, ScreenSpot‑Pro and real‑world AndroidWorld tests.

AI AgentGUI automationbenchmark
0 likes · 5 min read
UI-Venus-1.5: How Ant Group’s Open‑Source GUI Agent Achieves SOTA Performance
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 11, 2026 · Artificial Intelligence

Heuristic Learning: A New Reinforcement Learning Paradigm for Continual Learning

The article proposes Heuristic Learning (HL) as a way to tackle continual learning’s catastrophic forgetting by using coding agents that iteratively refine rule‑based policies, showing empirical gains on Atari, MuJoCo, and VizDoom tasks and outlining HL’s benefits, challenges, and future integration with neural networks.

LLMcoding agentscontinual learning
0 likes · 15 min read
Heuristic Learning: A New Reinforcement Learning Paradigm for Continual Learning
PaperAgent
PaperAgent
May 11, 2026 · Artificial Intelligence

SkillOS: How Skill Governance Powers Self‑Evolving AI Agents

SkillOS addresses the one‑off nature of current LLM agents by introducing a closed‑loop system where a trainable Skill Curator continuously extracts, updates, and manages reusable skills from execution traces, leading to measurable gains in success rates, efficiency, and cross‑task generalization.

Grouped Task StreamsLLM AgentsMeta-Strategy Skills
0 likes · 10 min read
SkillOS: How Skill Governance Powers Self‑Evolving AI Agents
Machine Heart
Machine Heart
May 10, 2026 · Artificial Intelligence

Embodied AI Unveiled: Ted Xiao Revisits Three Eras of Robot Learning from Google RT‑1/2 to SayCan

In a detailed interview, Ted Xiao, former Google DeepMind researcher, walks through the existence‑proof, foundation‑model, and scaling eras of embodied robot learning, explaining the technical challenges, pivotal decisions, and the evolving role of large language and vision models in robotics.

Large Language Modelsembodied AIfoundation models
0 likes · 19 min read
Embodied AI Unveiled: Ted Xiao Revisits Three Eras of Robot Learning from Google RT‑1/2 to SayCan
DataFunTalk
DataFunTalk
May 10, 2026 · Artificial Intelligence

DeepSeek vs MCTS: Decoding the ‘Chicken & Liquor’ Dilemma in LLM Training

The article analyzes why DeepSeek’s large‑model training struggles with Monte‑Carlo Tree Search, explains its use of Chain‑of‑Thought prompting, GRPO entropy‑boosting and rejection‑sampling fine‑tuning, compares these methods with Google’s OmegaPRM and PRM approaches, and proposes a concrete MCTS‑driven data‑generation pipeline to overcome the “chicken and liquor” trade‑off.

DeepSeekGRPOLarge Language Models
0 likes · 14 min read
DeepSeek vs MCTS: Decoding the ‘Chicken & Liquor’ Dilemma in LLM Training
Machine Heart
Machine Heart
May 10, 2026 · Artificial Intelligence

Stop Fragmenting Long Texts: HiLight Lets AI Highlight Key Points Directly

The HiLight approach inserts lightweight highlight tags into full-length inputs, training a small Emphasis Actor to score token importance and guide a frozen large language model, improving performance on tasks like recommendation and QA without modifying the solver, while keeping low latency and training cost.

LLMevaluationhighlighting
0 likes · 9 min read
Stop Fragmenting Long Texts: HiLight Lets AI Highlight Key Points Directly
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 9, 2026 · Artificial Intelligence

Heuristic Learning: Reinforcement Without Parameter Updates via .py File

OpenAI researcher Yong Jiayi introduces Heuristic Learning, a reinforcement paradigm that replaces gradient‑based neural network updates with code‑editing driven by GPT‑5.4, achieving the theoretical 864‑point Atari Breakout score and matching or surpassing PPO on multiple Atari and robot tasks.

Atari BenchmarkGPT-5.4continual learning
0 likes · 8 min read
Heuristic Learning: Reinforcement Without Parameter Updates via .py File
PaperAgent
PaperAgent
May 9, 2026 · Artificial Intelligence

How Anthropic’s Natural Language Autoencoders Open the LLM Black Box

Anthropic’s Natural Language Autoencoders (NLA) translate high‑dimensional LLM activation vectors into readable text, using an Activation Verbalizer and Reconstruction module trained via RL to maximize Fraction of Variance Explained, and reveal internal planning, language bias, tool‑call hallucinations, and hidden reasoning across multiple Claude models.

Activation VerbalizerAnthropicClaude
0 likes · 9 min read
How Anthropic’s Natural Language Autoencoders Open the LLM Black Box
DeepHub IMBA
DeepHub IMBA
May 8, 2026 · Artificial Intelligence

Building a Custom 8×8 GridWorld with Q‑Learning in Gymnasium

This tutorial walks through creating a custom 8×8 GridWorld environment in Gymnasium, implementing a Q‑Learning agent that learns to navigate from the top‑left corner to the bottom‑right goal while avoiding walls, and visualizing training curves, learned policies, and a performance comparison with a random agent.

GridWorldGymnasiumPython
0 likes · 10 min read
Building a Custom 8×8 GridWorld with Q‑Learning in Gymnasium
Machine Heart
Machine Heart
May 8, 2026 · Industry Insights

How SGLang’s $100M Seed Funding Powers the Next‑Gen Open AI Infrastructure

RadixArk raised a $100 million seed round backed by top hardware and AI investors to turn the open‑source SGLang inference engine and the Miles RL framework into day‑0 standards, aiming to democratize AI infrastructure and eliminate bottlenecks from training to inference.

AI infrastructureDeepSeek V4Hardware‑agnostic AI
0 likes · 10 min read
How SGLang’s $100M Seed Funding Powers the Next‑Gen Open AI Infrastructure
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 7, 2026 · Artificial Intelligence

Latent Action RL Shrinks Exploration Space for Multimodal Dialogue Fine‑Tuning

By learning a compact latent‑action space from paired image‑text and large‑scale text data, the authors reduce the RL search space from a vocabulary of over 150 k tokens to a 128‑codebook, enabling more efficient fine‑tuning of multimodal conversational agents and achieving consistent gains across several RL algorithms.

MultimodalVision-Language Modelsdialogue agents
0 likes · 11 min read
Latent Action RL Shrinks Exploration Space for Multimodal Dialogue Fine‑Tuning
Alimama Tech
Alimama Tech
May 7, 2026 · Artificial Intelligence

Dual‑Phase RL‑LLM Framework DARA for Few‑Shot Online Advertising Budget Allocation

The DARA framework splits online advertising budget allocation into a few‑shot LLM reasoning stage and a fine‑grained optimizer stage, enhanced by a dynamically updated RL‑fine‑tuning algorithm (GRPO‑Adaptive), achieving significantly lower ROI variance than traditional baselines in both real and simulated environments.

LLMOnline Advertisingbudget allocation
0 likes · 16 min read
Dual‑Phase RL‑LLM Framework DARA for Few‑Shot Online Advertising Budget Allocation
PaperAgent
PaperAgent
May 7, 2026 · Artificial Intelligence

190 Must-Read AI Agent Papers + 321 Google Implementation Cases – Free Resource Pack

The article provides a free compiled resource containing 190 essential AI Agent papers—from fundamentals to cutting‑edge topics—along with 321 Google‑released implementation cases and 500 open‑source agent applications, all with source code to help beginners and researchers quickly understand the field and reproduce results.

AI AgentLLMMemory
0 likes · 6 min read
190 Must-Read AI Agent Papers + 321 Google Implementation Cases – Free Resource Pack
Machine Heart
Machine Heart
May 6, 2026 · Artificial Intelligence

Can Adaptive Guidance Unlock Small Model Reasoning? Introducing G²RPO‑A

The paper identifies reward sparsity as the core obstacle for small language models in reinforcement‑learning‑based reasoning, proposes G²RPO‑A which injects high‑quality thinking trajectories and dynamically adjusts guidance length, and demonstrates large accuracy gains on math and code benchmarks such as Qwen3‑1.7B improving from 50.96 % to 67.21 % on MATH500 and from 46.08 % to 75.93 % on HumanEval.

G²RPO‑ASmall language modelsadaptive guidance
0 likes · 10 min read
Can Adaptive Guidance Unlock Small Model Reasoning? Introducing G²RPO‑A
Machine Heart
Machine Heart
May 6, 2026 · Artificial Intelligence

PromptEcho: Leveraging Frozen Multimodal Models for High‑Quality Text‑to‑Image Rewards Without Labels

PromptEcho computes a continuous reward for text‑to‑image generation by measuring how well a frozen vision‑language model can reconstruct the original prompt from the generated image, eliminating the need for annotated data or a trained reward model and outperforming prior methods across multiple benchmarks.

PromptEchobenchmarkdense captioning
0 likes · 10 min read
PromptEcho: Leveraging Frozen Multimodal Models for High‑Quality Text‑to‑Image Rewards Without Labels
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 5, 2026 · Artificial Intelligence

LLMBeginner: A Project‑Based Roadmap for Zero‑Base Mastery of Large Language Models

The LLMBeginner project from the MLNLP community offers a staged, project‑oriented learning path—covering big‑picture concepts, deep learning and reinforcement learning fundamentals, LLM theory and practice, and agent development—to guide beginners from fragmented resources to systematic mastery, with both concise and detailed versions hosted on GitHub.

AgentGitHubLLM
0 likes · 5 min read
LLMBeginner: A Project‑Based Roadmap for Zero‑Base Mastery of Large Language Models
Data Party THU
Data Party THU
May 4, 2026 · Artificial Intelligence

Understanding the Mathematical Foundations of Reinforcement Learning

This article provides a concise overview of a ten‑chapter reinforcement‑learning textbook, outlining the progression from basic concepts such as states and rewards to advanced algorithms like policy gradients and actor‑critic methods, and explains how each chapter builds on the previous ones.

Bellman equationMonte Carloactor-critic
0 likes · 11 min read
Understanding the Mathematical Foundations of Reinforcement Learning
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 2, 2026 · Artificial Intelligence

Real-World Large-Scale Test Shows Robots Learning While Deploying Outperform Baselines on Eight Tasks

The article presents the LWD (Learning While Deploying) framework, detailing its reinforcement‑learning‑driven data flywheel, the DIVL value‑evaluation and QAM policy‑optimization modules, and experimental results where a dual‑arm robot improves success rates by up to 17% and reduces cycle time by 23.75 seconds across eight real‑world tasks, surpassing strong baselines.

DIVLData FlywheelLWD
0 likes · 12 min read
Real-World Large-Scale Test Shows Robots Learning While Deploying Outperform Baselines on Eight Tasks
AI Explorer
AI Explorer
May 2, 2026 · Industry Insights

AI Industry Highlights May 2, 2026: Funding Surge, New Tools, and Research Breakthroughs

In May 2026, the AI sector saw a 77% rise in capital spending by the four biggest tech firms, Meta's acquisition of robot startup ARI, reinforcement‑learning advances boosting LLM inference, OpenAI's ChatGPT Images 2.0 launch, Tencent's Hy‑MT model outperforming Google, Microsoft's legal‑AI assistant, a 400B model running on iPhone, and notable research from CMU and independent scholars.

AI investmentCMU researchLarge Language Models
0 likes · 5 min read
AI Industry Highlights May 2, 2026: Funding Surge, New Tools, and Research Breakthroughs
Machine Heart
Machine Heart
May 1, 2026 · Artificial Intelligence

From PPO to MaxRL: The Evolution of Reinforcement Learning for LLM Inference

This article surveys the rapid evolution of reinforcement‑learning algorithms for large‑language‑model inference from early REINFORCE and PPO to newer approaches such as GRPO, RLOO, DAPO, CISPO, DPPO, ScaleRL and MaxRL, highlighting their design motivations, mathematical formulations, empirical trade‑offs and open research challenges.

GRPOLLMMaxRL
0 likes · 27 min read
From PPO to MaxRL: The Evolution of Reinforcement Learning for LLM Inference
Machine Heart
Machine Heart
Apr 30, 2026 · Artificial Intelligence

Why GPT‑5 Models Keep Talking About Goblins: RL Reward Leakage Uncovered

The article analyzes how DeepSeek’s "极" bug and OpenAI’s recurring "goblin" output stem from unclean training data and an unintended reinforcement‑learning reward bias, showing how a persona‑specific habit leaked into general model behavior and how engineers responded.

GPT-5Goblin bugLarge Language Models
0 likes · 8 min read
Why GPT‑5 Models Keep Talking About Goblins: RL Reward Leakage Uncovered
Machine Heart
Machine Heart
Apr 30, 2026 · Artificial Intelligence

How LWD Redefines Embodied AI Training with Fleet‑Scale Reinforcement Learning

LWD (Learning While Deploying) introduces a distributed multi‑robot reinforcement‑learning framework that continuously improves VLA policies during real‑world deployment, leveraging DIVL, QAM, dynamic n‑step TD and an asynchronous actor‑learner architecture to achieve over 90% success on five‑minute tasks and outperform traditional behavior‑cloning, HG‑Dagger and RECAP baselines.

Distributed TrainingLWDVLA
0 likes · 13 min read
How LWD Redefines Embodied AI Training with Fleet‑Scale Reinforcement Learning
PaperAgent
PaperAgent
Apr 30, 2026 · Artificial Intelligence

How Agentic AI is Redefining World Modeling

The article reviews the paper "Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond", introducing a two‑axis framework (capability levels L1‑L3 and law domains) to map diverse world‑modeling systems, highlighting that most current systems stall at L1, that explicit law encoding is crucial for long‑term stability, and that L3 represents the ultimate, self‑evolving model.

AI agentsAI researchSimulation
1 likes · 6 min read
How Agentic AI is Redefining World Modeling
Architect's Must-Have
Architect's Must-Have
Apr 29, 2026 · Artificial Intelligence

Deep Dive into Hermes Agent: The Memory Architecture That Makes AI Smarter

This article provides a comprehensive technical analysis of Hermes Agent, detailing its layered memory system, persistent knowledge storage, skill generation, tool registry, prompt assembly, security model, deployment options, and how these components enable AI agents to continuously learn and improve their performance over time.

AI memoryAutonomous AgentsHermes Agent
0 likes · 52 min read
Deep Dive into Hermes Agent: The Memory Architecture That Makes AI Smarter
SuanNi
SuanNi
Apr 28, 2026 · Artificial Intelligence

ASI‑EVOLVE: AI Designs AI and Beats Human SOTA by Almost Three‑Fold

The open‑source ASI‑EVOLVE framework lets AI autonomously design AI across model architecture, data curation, and reinforcement‑learning algorithms, achieving up to three times the human‑level state‑of‑the‑art performance and demonstrating cross‑domain gains in drug‑target prediction.

AI-driven AIASI-EVOLVECross-domain AI
0 likes · 12 min read
ASI‑EVOLVE: AI Designs AI and Beats Human SOTA by Almost Three‑Fold
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Apr 28, 2026 · Artificial Intelligence

Can Reasoning Models Keep Improving? TEMPO Uses EM to Stop Reward Drift

The paper introduces TEMPO, a test‑time training framework inspired by the Expectation‑Maximization algorithm, which alternates policy optimization (M‑step) with Critic calibration (E‑step) to prevent reward‑signal drift, and demonstrates on Qwen3 and OLMO3 models that it continuously improves reasoning performance and maintains output diversity beyond the saturation point of existing TTT methods.

EM algorithmLarge Language ModelsTest-Time Training
0 likes · 14 min read
Can Reasoning Models Keep Improving? TEMPO Uses EM to Stop Reward Drift
AI2ML AI to Machine Learning
AI2ML AI to Machine Learning
Apr 28, 2026 · Artificial Intelligence

Which of the Three Types of AI Agents Are You Building?

The article classifies today’s booming AI agents into three categories—foundation‑model RL agents, OpenClaw‑style autonomous agents, and ontology‑driven agents—detailing their architectures, key components, comparative strengths, and how they converge toward the envisioned L4/L5 AGI stages.

AI agentsLLMMultimodal
0 likes · 9 min read
Which of the Three Types of AI Agents Are You Building?
Machine Heart
Machine Heart
Apr 28, 2026 · Artificial Intelligence

Can LLMs Answer More Accurately While Writing Less? Introducing SHAPE’s Reasoning Tax

The SHAPE framework (Stage‑aware Hierarchical Advantage via Potential Estimation) adds a milestone‑based “reasoning tax” to large language model inference, providing step‑wise correctness signals and penalizing verbosity, which yields an average 3% accuracy gain and a 30% reduction in token consumption across multiple math‑reasoning benchmarks.

ACL 2026LLMMathematical Reasoning
0 likes · 10 min read
Can LLMs Answer More Accurately While Writing Less? Introducing SHAPE’s Reasoning Tax
Machine Heart
Machine Heart
Apr 28, 2026 · Artificial Intelligence

World’s First Open‑Source Large Model for Real‑World Medical Video Understanding

The article introduces the globally first open‑source large model uAI‑NEXUS‑MedVLM, built on the MedVidBench dataset and the MedGRPO training framework, which together overcome data scarcity, evaluation gaps, and task specialization challenges in surgical video AI, achieving state‑of‑the‑art performance across eight benchmark tasks.

AI in SurgeryMedVidBenchMedical Video Understanding
0 likes · 18 min read
World’s First Open‑Source Large Model for Real‑World Medical Video Understanding
PMTalk Product Manager Community
PMTalk Product Manager Community
Apr 28, 2026 · Artificial Intelligence

First Principle for Agent Product Managers: Choosing Between Single Agent, Multi‑Agent Collaboration, and Workflow

The article presents a decision framework for AI product managers, mapping workflow determinism and context certainty to four technical patterns—traditional RPA + AI, single Agent + RAG/knowledge graph, end‑to‑end RL Agent, and multi‑Agent collaboration—each with concrete use‑case examples and selection guidelines.

AI agentsRPARetrieval-Augmented Generation
0 likes · 6 min read
First Principle for Agent Product Managers: Choosing Between Single Agent, Multi‑Agent Collaboration, and Workflow
360 Tech Engineering
360 Tech Engineering
Apr 28, 2026 · Artificial Intelligence

How 360 AI Institute Boosted Airline Translation Accuracy from 70% to 96%

The 360 AI Research Institute tackled the zero‑tolerance translation demands of airline maintenance by building a specialized parallel corpus and applying RAG‑enhanced, SFT‑fine‑tuned, and RL‑reinforced models, raising Chinese‑to‑English translation accuracy from 70% to 96% and enabling a one‑month rollout.

AI translationRAGSFT
0 likes · 5 min read
How 360 AI Institute Boosted Airline Translation Accuracy from 70% to 96%
Machine Heart
Machine Heart
Apr 27, 2026 · Artificial Intelligence

ACL 2026: Unveiling a Predictive Scaling Law for Reinforcement Learning Fine‑Tuning of Large Models

The paper presents a systematic empirical study that derives a power‑law scaling formula for reinforcement‑learning‑after‑training of large language models, demonstrating accurate inter‑ and intra‑model performance prediction, learning‑efficiency saturation, data‑reuse benefits, and cross‑architecture validity.

Data ReuseLLaMA-3Large Language Models
0 likes · 11 min read
ACL 2026: Unveiling a Predictive Scaling Law for Reinforcement Learning Fine‑Tuning of Large Models
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Apr 25, 2026 · Artificial Intelligence

From Classic Multi-Agent Paradigms to Future Large-Foundation-Model-Driven Systems

This review surveys classic multi-agent systems and the emerging large-foundation-model-driven MAS paradigm, comparing their architectures, perception, communication, decision-making and control, and discusses how integrating LFMs enables semantic reasoning, greater adaptability, and new research challenges.

Large Foundation Modelsagentic AIcollaborative AI
0 likes · 8 min read
From Classic Multi-Agent Paradigms to Future Large-Foundation-Model-Driven Systems
Alibaba Cloud Developer
Alibaba Cloud Developer
Apr 24, 2026 · Artificial Intelligence

How Hermes Agent Achieves Self‑Evolution: A Deep Dive into Prompt, Context, and Harness Design

This article provides a detailed technical analysis of Hermes Agent, explaining how its dynamic skill generation and reinforcement‑learning loop enable true self‑evolution, and examines the prompt engineering, context compression, memory architecture, harness mechanisms, error handling, and plugin ecosystem that differentiate it from OpenClaw and Claude Code.

Context CompressionHermes AgentPrompt Engineering
0 likes · 41 min read
How Hermes Agent Achieves Self‑Evolution: A Deep Dive into Prompt, Context, and Harness Design
Bighead's Algorithm Notes
Bighead's Algorithm Notes
Apr 22, 2026 · Artificial Intelligence

How DeepAries’s Adaptive Rebalancing Timing Boosts Portfolio Returns

DeepAries is a novel deep reinforcement‑learning framework that jointly learns when to rebalance a portfolio and how to allocate assets by combining a Transformer‑based state encoder with PPO, and extensive experiments on four major markets show it significantly outperforms fixed‑frequency baselines in risk‑adjusted return, transaction cost, and drawdown.

DeepAriesPPOPortfolio Management
0 likes · 15 min read
How DeepAries’s Adaptive Rebalancing Timing Boosts Portfolio Returns
AntTech
AntTech
Apr 22, 2026 · Artificial Intelligence

How Multi‑Agent MCTS and Information‑Gain Rewards Are Transforming Mobile GUI and Search Agents

This article reviews two recent ICLR 2026 papers—M²‑Miner, a multi‑agent Monte‑Carlo Tree Search framework for low‑cost mobile GUI data mining, and IGPO, an information‑gain‑based reinforcement‑learning method that provides dense rewards for multi‑turn search agents—detailing their designs, experiments, and open‑source releases.

GUI Data MiningInformation GainLLM Agents
0 likes · 8 min read
How Multi‑Agent MCTS and Information‑Gain Rewards Are Transforming Mobile GUI and Search Agents
Machine Heart
Machine Heart
Apr 21, 2026 · Artificial Intelligence

Monet Enables Multimodal Models to Perform Human‑like Abstract Visual Thinking

Monet introduces a training paradigm that lets multimodal large language models reason directly in a continuous latent visual space, replacing external tool calls with implicit visual embeddings, and demonstrates significant gains on both in‑distribution perception tasks and out‑of‑distribution abstract visual reasoning through a three‑stage supervised fine‑tuning and a novel visual‑latent policy optimization.

Latent EmbeddingMLLMMultimodal
0 likes · 15 min read
Monet Enables Multimodal Models to Perform Human‑like Abstract Visual Thinking
AIWalker
AIWalker
Apr 20, 2026 · Artificial Intelligence

How VA‑π Bridges Tokenizers and Autoregressive Generators for Pixel‑Perfect Images

VA‑π introduces a lightweight post‑training framework that uses variational inference and reinforcement learning to align tokenizers with visual autoregressive generators, achieving dramatic quality gains, extreme training efficiency, and robust pixel‑level reconstruction across diverse image generation tasks.

Autoregressive ModelsPixel Alignmentpost-training
0 likes · 14 min read
How VA‑π Bridges Tokenizers and Autoregressive Generators for Pixel‑Perfect Images
Data Party THU
Data Party THU
Apr 20, 2026 · Artificial Intelligence

How MemPO Uses Reinforcement Learning to Turn Agent Memory into a Trainable Policy

MemPO introduces a self‑memory policy optimization framework that lets long‑horizon LLM agents autonomously manage and refine their memory via reinforcement learning, using global‑trajectory and informative‑memory advantage estimates, achieving up to 25.98% F1 gain and 73% token reduction on benchmark tasks.

LLMLong-horizon AgentsMemPO
0 likes · 8 min read
How MemPO Uses Reinforcement Learning to Turn Agent Memory into a Trainable Policy
Baidu Maps Tech Team
Baidu Maps Tech Team
Apr 20, 2026 · Artificial Intelligence

How Baidu Maps Reinvents LBS Search with Multi‑Agent AI and RL

Facing the shift from keyword indexing to generative AI, Baidu Maps overhauled its LBS architecture by introducing a native multi‑agent system, context‑engineering (ACE) framework, and reinforcement‑learning alignment, enabling dynamic routing, knowledge evolution, and a 36% boost in planning compliance while maintaining zero‑tolerance for factual errors.

AI agentsContext EngineeringLLM
0 likes · 10 min read
How Baidu Maps Reinvents LBS Search with Multi‑Agent AI and RL