BestHub
Sign in
Tagged articles

GUI automation

9 articles · Page 1 of 1
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Mar 12, 2026 · Artificial Intelligence

LongHorizonUI: A Unified Robust Framework for Long‑Horizon GUI Agent Automation

LongHorizonUI tackles the steep success‑rate drop of GUI agents on tasks longer than 10‑15 steps by introducing three tightly coupled modules—enhanced perception, deep reflective decision, and compensatory execution—and validates the approach on the new LongGUIBench benchmark with consistent performance gains across both app and game scenarios.

BenchmarkGUI automationICLR 2026
0 likes · 12 min read
LongHorizonUI: A Unified Robust Framework for Long‑Horizon GUI Agent Automation
PaperAgent
PaperAgent
Dec 10, 2025 · Artificial Intelligence

How AI Agents Like UFO, Mobile-Agent, and UI-TARS Are Shaping 2025 Smartphones

The article examines the underlying GUI‑Agent technologies behind the 2025 “Doubao” smartphone, comparing Microsoft’s UFO series, Alibaba’s Mobile‑Agent v2/v3, and ByteDance’s UI‑TARS, detailing their model foundations, input modalities, action spaces, planning mechanisms, learning strategies, open‑source status, and multi‑agent frameworks.

AI agentsGUI automationOpen-source
0 likes · 8 min read
How AI Agents Like UFO, Mobile-Agent, and UI-TARS Are Shaping 2025 Smartphones
Network Intelligence Research Center (NIRC)
Network Intelligence Research Center (NIRC)
Nov 4, 2025 · Artificial Intelligence

SEAgent: A Self‑Evolving Computer Agent that Learns Software Use Autonomously

SEAgent introduces a self‑evolving framework that enables a GUI agent to master unfamiliar software through autonomous exploration and experience learning, leveraging a curriculum generator, a world‑state model, and GRPO‑based reinforcement with adversarial imitation, achieving state‑of‑the‑art performance on OSWorld.

GUI automationSEAgentautonomous learning
0 likes · 6 min read
SEAgent: A Self‑Evolving Computer Agent that Learns Software Use Autonomously
Software Engineering 3.0 Era
Software Engineering 3.0 Era
Mar 14, 2025 · Artificial Intelligence

From J.A.R.V.I.S. to Real AI Agents: A Must‑Read Guide to Modern GUI Agents

This article provides a comprehensive overview of AI agents, focusing on GUI‑based agents, their definitions, classifications, core capabilities, recent research such as OpenAI's ComputerUse, SpiritSight and MobileFlow, practical applications, technical and security challenges, and future development directions.

AI agentsComputerUseGUI automation
0 likes · 16 min read
From J.A.R.V.I.S. to Real AI Agents: A Must‑Read Guide to Modern GUI Agents
ByteDance SE Lab
ByteDance SE Lab
Aug 21, 2023 · Artificial Intelligence

How Fastbot Uses Reinforcement Learning for Faster Android GUI Testing

Fastbot is a reusable, model‑based Android GUI testing tool that leverages reinforcement‑learning techniques to learn from previous test runs, accelerating coverage and crash detection through a two‑phase workflow, probabilistic and learning‑based event selection, and provides configurable custom events, widget blocking, and tree‑pruning features.

GUI automationandroid testingfastbot
0 likes · 16 min read
How Fastbot Uses Reinforcement Learning for Faster Android GUI Testing
360 Quality & Efficiency
360 Quality & Efficiency
Jun 28, 2019 · Operations

Using Sikuli for GUI Automation: Installation, Python Integration, and Practical Tips

This article introduces Sikuli, an image‑based GUI automation tool, explains its origins, provides download links, details installation steps, demonstrates Python integration via the Lackey library and SikuliX API, shares useful code snippets, and highlights common pitfalls and overall considerations for test automation.

GUI automationLackeyPython
0 likes · 6 min read
Using Sikuli for GUI Automation: Installation, Python Integration, and Practical Tips