Vercel Labs releases agent-desktop, a free way for AI agents to use desktop apps

Chris Tate of Vercel Labs announced agent-desktop, pitched as agent-browser for your whole computer. It is a free, open-source command-line tool that lets coding agents such as Claude Code, Codex or Cursor read and click through ordinary desktop apps on Mac, Windows and Linux, using the system's accessibility data rather than guessing from screenshots. It runs in the background without taking over your mouse. Version 1.0 shipped on 27 October; the post says several agents can work at once, each with its own cursor, but the docs show those cursors are an on-screen overlay and real mouse and keyboard input is still handled one agent at a time.

Why it mattersMany small businesses still rely on desktop-only software with no API, such as accounting packages or older CRMs. Tools like this make it more realistic for an agent to handle repetitive clicks in those apps. It is free, but it is an experimental Labs project for people already running a coding agent, it only works as well as each app's accessibility support, and it can see whatever is on screen, so test it on a non-sensitive machine first.

Curated by Sara Simeone as part of our human editorial coverage. The original sources are linked below; curation is distinct from a Hype or Fact? assessment.

How we knowCompany figures are labelled as their own claims; anything we couldn't verify is labelled as a report or a claim.