CUA-Master-27B: Self-Evolving 27B Agent Rivals GPT-5.6 with 28% Faster Execution

CUA-Master-27B, a 27B-parameter computer-use agent from CUHK MMLab and JD Research, learns from software tutorial videos via a dual recursive framework, achieving 43.9 on WeaveBench (near GPT-5.6's 44.0) with 28% less execution time, and 25% pass rate on Agents' Last Exam with 34-36% speedups over Kimi-K3 and Qwen-3.8-Max.

PaperAgent
PaperAgent
PaperAgent
CUA-Master-27B: Self-Evolving 27B Agent Rivals GPT-5.6 with 28% Faster Execution

Benchmark Results: 27B Model Approaches Flagship Performance

CUA-Master-27B is a 27B-parameter computer-use agent (CUA) developed by researchers from CUHK MMLab and JD Exploration Research Institute. It employs a dual recursive iteration framework that learns from real-world tutorial videos. Across four core benchmarks, the model delivers competitive scores while significantly reducing execution time and steps.

WeaveBench : 43.9 score vs. GPT-5.6-Luna's 44.0; average execution time dropped from 47 minutes to 34 minutes ( ~28% reduction ).

Agents' Last Exam : 25.0% full-task pass rate, on par with Kimi-K3 and Qwen-3.8-Max; average time reduced by ~34% and ~36% respectively.

Cross-platform : WindowsAgentArena 56.2, MacOSWorld 43.0, MacAgentBench 59.9.

The model achieves the Pareto frontier on the score–execution trade-off across all four benchmarks.

Benchmark comparison table
Benchmark comparison table
Pareto frontier visualization
Pareto frontier visualization

Dual Recursive Self-Improvement Framework

The system builds a scalable data flywheel that connects open-world knowledge acquisition, controllable task construction, real-environment execution, and model training.

Inner Loop: From Real Workflows to Capability Primitives

High-quality data originates from public software tutorial videos covering 8 domains, 36 subdomains, and 650+ software applications . Videos are filtered and segmented; a dual-path reconstruction using semantic cues and visual changes converts unstructured demonstrations into reusable seed tasks . These tasks are further decomposed into capability primitives containing preconditions, environment requirements, and verification conditions. Primitives are then recombined by complexity and software scope to generate new executable, verifiable tasks.

The inner-loop flywheel:

Real workflows → Seed tasks → Reusable capability primitives → Cross-application complex tasks → Collected execution trajectories → Next iteration
Inner-loop data flywheel diagram
Inner-loop data flywheel diagram

Outer Loop: Model Feedback Guides Data Collection

The outer loop closes the cycle between model training and data acquisition: weak model performance triggers targeted exploration of relevant software, workflows, and task difficulties.

Open-world corpus collection → CUA data construction → Model training improvement → Model feedback → Next iteration

This dual-layer recursive improvement framework uses three SFT stages totaling ~115K samples and 12K high-quality RL samples.

CUA-Master overview
CUA-Master overview
Model architecture
Model architecture
8 data categories
8 data categories

Hybrid GUI-CLI Action Space for Efficiency

Human computer use fluidly switches between GUI (visual inspection, window interaction) and CLI (batch file processing, structured computation). CUA-Master unifies both in a single action space, allowing the model to choose the appropriate modality per step. This hybrid mode reduces execution steps compared to GUI-only, benefiting long-horizon tasks. Examples include batch grading answer sheets and entering results into spreadsheets, processing documents and completing web forms, and combining professional visualization software for data verification.

GUI-CLI hybrid action space illustration
GUI-CLI hybrid action space illustration

Training Data Mechanisms: Diversity, Controllability, Reliability

The framework addresses three core challenges in CUA training data.

Diversity via Capability Primitive Composition

Extracting primitives from real tutorial videos and composing them continuously expands task types. t-SNE visualization shows generated tasks cover existing CUA dataset distributions and extend into sparser regions.

Controllability via K and N Parameters

Task difficulty is precisely controlled along two dimensions: K (number of composed capability primitives) and N (number of involved applications). Preconditions, dependencies, and verification conditions enable construction of tasks ranging from single-app simple operations to cross-app complex workflows.

Reliability via Snapshot Rollback Retry

Long tasks often fail due to local errors. A feedback-guided snapshot rollback mechanism locates the failure node, rolls back to the latest valid snapshot, and re-executes only the failed segment instead of restarting entirely.

Data mechanisms overview
Data mechanisms overview

Training Details and Resources

The paper reports three SFT stages accumulating ~115K training samples and 12K high-quality RL samples. The base model is Qwen-2.5-27B (implied by comparisons). The model, code, and paper are publicly available:

CUA-Master: Scaling Computer-use Agents through Open-World Recursive Improvements
https://arxiv.org/pdf/2611.03126
https://github.com/xlyu0106/CUA-Master.git
https://huggingface.co/yxl66666/CUAMaster-27B
Original Source

Signed-in readers can open the original source through BestHub's protected redirect.

Sign in to view source
Republication Notice

This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactadmin@besthub.devand we will review it promptly.

Benchmark EvaluationSelf-Evolving AgentsComputer-Use AgentsAgent Training DataCUA-MasterDual Recursive FrameworkGUI-CLI HybridTutorial Video Learning
PaperAgent
Written by

PaperAgent

Daily updates, analyzing cutting-edge AI research papers

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.