OpenGCUA rebuilds the computer-use agent stack in the open, motivated by the observation that frontier systems like GPT-6 Astra's computer use are closed. Its core idea is to let the model choose between visual GUI actions and direct code execution, so intermediate results can steer later steps; it also proposes harness-to-model decision transfer, moving selected observation and task-state decisions out of fixed harness rules and into the model itself. The authors report that on OSWorld-v2 their full configuration improves task scores across all eight evaluated models (including GPT-6 Astra and Claude Opus 5), raising mean partial score by +19.6 points and cutting reported steps per task by 53.0% on average versus batched GUI-only execution. Alongside the implementation and prompts they release evaluation trajectories from all eight models, plus early versions of a real-device harness and a cross-device SDK covering computers, mobiles, and browsers; on four real macOS tasks their harness shows selected Qwen3.8-Max runs use 19.4 times as many reported reasoning tokens as GPT-6 Astra, which they highlight as a gap in real-device execution efficiency.
- 99 stars/7d
- 0 citations
- 315 upvotes
arXiv · Tongyi-MAI/OpenGCUA