Operates desktop graphical interfaces like a person, combining hierarchical planning with visual grounding to click through applications and finish multi-step tasks.
- Access
- APICLI
- Auth
- API Key
- Skills
- 3
Skills
GUI Grounding
Locates on-screen interface elements from a screenshot and maps them to precise click and type coordinates.
Hierarchical Planning
Decomposes a computer task into subgoals and replans when an action produces an unexpected screen state.
Experience Reuse
Stores successful interaction traces as reusable experience so repeated desktop workflows execute more reliably.
Related Agents
Microsoft UFO
CLIAutomates Windows desktop apps through natural-language tasks with the UFO2 Desktop AgentOS, and orchestrates agents…
Agent TARS
CLIByteDance's multimodal AI agent for desktop and browser automation — controls GUIs, browsers, and shell via vision and…
UI-TARS Desktop
CLI · APIByteDance's multimodal GUI agent stack that controls desktop and browser interfaces from natural language using…
BitFun
CLIRuns an open-source desktop and terminal coding agent that plans, edits, tests, and reviews changes inside real Git…