Tagged articles
GUI Agent
14 articles · Page 1 of 1
Alipay's xUI technology stack powers the 'Abao' AI agent with streaming multimodal communication via MoQ, generative UI rendering across three generations (Markdown, HTML, A2UI), on-device agent execution via GUI/TUI/Workflow, and cross-agent collaboration through AHA protocol, enabling asynchronous, companion-style interactions across devices.
A2UIAgentic AIAlipay xUI
0 likes · 22 min read

MobileForge introduces an annotation‑free adaptation loop for mobile GUI agents that combines the MobileGym data‑generation platform with the HiFPO hierarchical feedback‑guided policy optimizer, achieving near‑state‑of‑the‑art performance on AndroidWorld and cross‑domain MobileWorld while eliminating manual task labeling and reward design.
GUI AgentGUI-Owl-1.5-8BHiFPO
0 likes · 19 min read

MobileForge introduces an annotation‑free pipeline for adapting mobile GUI agents, combining MobileGym’s exploration‑to‑task generation with HiFPO’s hierarchical feedback‑guided policy optimization, achieving up to 77.6% Pass@3 on AndroidWorld and notable cross‑domain gains without any human‑written tasks or demonstrations.
GUI AgentGUI-OwlHierarchical Feedback
0 likes · 18 min read

Trip.com built the "慧鉴天工" system that combines a GUI Agent, multi‑agent LQA algorithms, OODA‑loop architecture, and a knowledge‑graph‑enhanced pipeline to automate page collection, multilingual text extraction, and quality inspection across 31 languages, achieving over 90% cost reduction and 70%+ detection accuracy.
GUI AgentOODA LoopQwen 3.6
0 likes · 21 min read

AutoWebWorld introduces a finite‑state‑machine‑driven pipeline that synthesizes verified web‑GUI trajectories at an average cost of only $0.04 each, producing longer interaction sequences, scaling efficiently, and demonstrably improving large‑language‑model agents on WebVoyager and grounding benchmarks.
AutoWebWorldData GenerationFinite State Machine
0 likes · 13 min read

Xiaomi’s AI team extracted 5 billion video frames to create the world’s largest open‑source GUI dataset, demonstrated that a 3 B‑parameter model can reduce inference tokens by 71% while surpassing larger models, and presented a suite of ICML 2026 papers covering data scaling, benchmarking, reasoning, multimodal perception, and training stability for GUI agents and other AI tasks.
DatasetGUI Agentbenchmarking
0 likes · 21 min read

During the 2026 Spring Festival promotion, Xiaohongshu replaced manual UI testing with a three‑layer AI‑driven GUI Agent that executed over 43,000 runs across 106 devices and 128 scenarios, achieving 58% automation, 82% AI‑generated case adoption, 68% bug recall, 98% stability and roughly $1 per test case while drastically cutting token costs.
AI codingCode-as-ActionCost Optimization
0 likes · 23 min read

Mano‑P 1.0 is a pure‑vision GUI agent that runs locally on Apple M4 devices, achieves SOTA on 13 multimodal benchmarks, offers zero‑cloud data handling, and introduces a three‑stage open‑source roadmap that reshapes personalized AI and end‑to‑end GUI automation.
GUI AgentMano-PPersonalized AI
0 likes · 17 min read

H Company’s new Holo3 series delivers a visual language model that outperforms GPT‑5.4 on the OSWorld‑Verified benchmark with a 78.85% score while costing only about one‑tenth as much, offering both a flagship API‑only version and an open‑source lightweight variant optimized for GUI agents.
AI benchmarkGUI AgentHolo3
0 likes · 4 min read

In a live discussion hosted by Prof. Yang Jian with experts Zhang Xi and Cui Chen, the panel explores the essential abilities of mature GUI agents, the role of multimodal models in visual understanding, the transfer of code‑agent techniques to GUI tasks, edge‑device performance trade‑offs, complex planning, tool ecosystems, deployment challenges, and future breakthrough scenarios.
Agentic AICode AgentGUI Agent
0 likes · 22 min read


AntTechAug 19, 2025 · Artificial Intelligence
Ant Group's open‑source native GUI agent UI‑Venus leverages multimodal large‑model and reinforcement‑learning techniques to outperform prior models on grounding and navigation benchmarks, while using a high‑quality data pipeline and a self‑evolving alignment mechanism to push the limits of GUI automation.
GUI AgentSOTAbenchmark
0 likes · 7 min read

This article introduces UI‑TARS, a multimodal visual model combined with the Model Context Protocol (MCP) to build next‑generation cross‑platform autonomous GUI agents, detailing its architecture, workflow, code examples, incremental inference, applications, challenges, and future research directions.
AIGUI Agentautomation
0 likes · 20 min read

The article presents UI‑TARS, a native GUI‑agent model that combines multimodal large‑language models with the open‑source Midscene.js framework to enable more accurate, token‑efficient, and privacy‑preserving UI automation, while discussing its architecture, advantages, limitations, and integration steps.
GUI AgentMidscene.jsUI automation
0 likes · 11 min read

This article explains why GUI agents are needed, defines their multimodal capabilities, walks through a high‑level automation scenario, details the architecture of large‑model‑driven GUI agents, highlights recent open‑source projects, and compares them with traditional RPA solutions.
AI automationGUI AgentHuman-Computer Interaction
0 likes · 10 min read
