Claude Code Lets AI Control Your Computer: Full‑Terminal, Unattended Development
Claude's new Computer Use CLI lets the AI launch, debug, fix and test applications entirely from the terminal, acting as an all‑round test engineer, while offering macOS‑only support, token‑usage concerns, robust security controls, and a rapid update cadence that hints at fully unattended development pipelines.
Claude Code Computer Use CLI
Claude’s new “Computer Use” command‑line interface (CLI) enables the model to launch the application under development, reproduce bugs, apply fixes, and run tests without leaving the terminal.
Demonstrated scenarios
Native app build verification : after writing Swift code, Claude compiles, launches the app, and clicks every UI control to verify functionality without mouse interaction.
End‑to‑end UI testing : Claude walks through an Electron app’s registration flow, clicks each step, and captures screenshots as evidence.
Visual layout debugging : when instructed that a modal is truncated in a small window, Claude resizes the window, reproduces the bug, screenshots it, and patches the CSS.
Driving GUI tools : design tools, hardware control panels, and iOS simulators that lack CLI support can be operated automatically.
Security safeguards
Global single‑session lock ensures only one Claude session controls the computer at a time.
Application‑level authorization prompts appear for each new software before Claude can act.
Permission tiers: browsers and trading platforms are read‑only; IDEs and terminals are click‑only; other apps may receive full control.
Press Esc or Ctrl+C to stop all actions immediately.
The terminal window is excluded from screenshots, preventing Claude from seeing typed input.
Claude hides other applications while working and restores the original window layout afterward.
Current limitations
macOS‑only; Windows and Linux are not supported.
“Computer Use” consumes a large token quota, raising cost concerns.
Release cadence
From 1 February to 23 March (52 days) Anthropic shipped 73 product features. The “Claude Code” update marked the 76th change in a 60‑day sprint.
Key dates:
25 March – “Claude Code Auto mode” introduced, allowing Claude to make permission decisions and execute actions after a security check.
26 March – “Work Tools” added mobile support for controlling Figma or Canvas on phones.
27‑30 March – “Claude Code Computer Use” released, combining Auto mode with the CLI to enable a potentially fully unattended development pipeline (code generation, testing, fixing).
Reference links
https://x.com/claudeai/status/2038663014098899416
https://code.claude.com/docs/en/computer-use
https://x.com/PawelHuryn/status/2036419947149119742
Machine Learning Algorithms & Natural Language Processing
Focused on frontier AI technologies, empowering AI researchers' progress.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.