Best AI Agent Papers

Best AI Agent Papers · 2026-W41

Ranking window: 2026-07-13 – 2026-10-10 Frozen on 2026-10-11

3

A survey of self-improving agents: how a foundation model plus scaffold turns experience into capability

This survey decomposes a self-improving agent into a foundation model and an operational scaffold of prompts, memory, tools and control logic, then defines improvement as a self-induced update operator that converts experience into accumulated capability with minimal human input. It organizes the growing literature by update target and driving signal, from prompt and memory edits to weight-level self-modification.

  • 18 stars/7d
  • 9 citations
  • 35 upvotes
5

ABot-World-0: an action-conditioned world model streaming interactive 720p worlds on a single desktop GPU

ABot-World-0 is an action-conditioned video world model trained on multi-source data from AAA games, simulation engines and internet videos, controlled through raw keyboard input with reference-character memory for consistent third-person rollouts. The authors report streaming 720p at up to 16 FPS on one RTX 5090 with 1.2s action-to-first-frame latency, targeting real-time long-horizon closed-loop interaction.

  • 5 stars/7d
  • 6 citations
  • 313 upvotes
6

SEED: agents that distill their own completed trajectories into reusable skills during RL

SEED converts an agent's own completed on-policy trajectories into natural-language hindsight skills and distills the behavioral shift they induce back into the policy, producing a dense token-level training signal alongside outcome-based RL. The authors report gains in sample efficiency, final performance and generalization to unseen text- and vision-based agentic tasks.

  • 7 stars/7d
  • 7 citations
  • 107 upvotes
7

nanoMuse: an open-source personal agent that lives on your phone and computer, with memory you can actually read

After Meta's closed Muse demo showed what a single-person agent with lasting memory could look like, this report reconstructs how Muse is built from public sources, then ships nanoMuse as its GPL-3.0 open counterpart: one agent across the devices you own, sharing a single conversation over a relay anyone can self-host. Every action passes a Sentinel gate before it executes, memory is stored as plain files the owner can read, and the underlying model is the user's choice.

  • 774 stars/7d
  • 0 citations
  • 98 upvotes
8

Raven: an open ecosystem that builds, evolves and orchestrates agent harnesses for long-horizon tasks

Raven argues that hand-crafted agent harnesses are too domain-coupled to scale with long-horizon, cross-domain workloads. It treats each model–harness pair as a composable unit of intelligence: a Host Agent decomposes goals and coordinates specialized sub-agents, a host archive and EverOS retain experience across tasks, and Skill Forge turns that experience into reusable procedures — with theory on expanding reliable task coverage under one resource budget.

  • 252 stars/7d
  • 0 citations
  • 493 upvotes
10

Ouroboros: a coding agent that evolves its own tools, prompts and core through reviewed commits

Ouroboros is a self-developing coding-agent harness whose tools, prompts, context assembly and even core implementation improve through reviewed commits that become its later runtime, with two evolution modes: recursive free evolution and experience-driven core evolution. The authors also report a 161-day live deployment across seven human communication surfaces, arguing safety guardrails must stay authoritative while the agent rewrites its own code.

  • 32 stars/7d
  • 2 citations
  • 92 upvotes
  • #1 osworld-verified
11

RRSI: regularizing recursive self-improvement so evolved agent harnesses survive out-of-distribution benchmarks

Iteratively editing an agent's harness (prompts, control flow, tooling, memory) can look like self-improvement while quietly overfitting the training tasks. RRSI regularizes both ends of the loop: the proposer works under a temporally annealed budget and is steered toward unexplored trajectories, while the selector uses a critic to screen benchmark-specific proposals and a pruner to drop edits that are too small, too expensive, or no longer useful. The authors report gains of up to 14.1 points on the evolved split and up to 4.7 points on five held-out benchmarks, with a harness that uses 30% fewer policy tokens.

  • 212 stars/7d
  • 0 citations
  • 172 upvotes
12

AutoDesign: a meta-harness optimizer that teaches a code agent to recursively improve how it designs posters

AutoDesign treats multimodal conference-poster generation as a long-horizon agentic process: a meta-harness optimizer reads rollout feedback and rewrites the harness the code agent runs on. On the authors' 100-paper PosterBench it scores above Claude Design, the learned harness lifts seven different code-agent configurations, and a fully autonomous loop makes 253 tool calls in 40 minutes for under $3.

  • 9 stars/7d
  • 3 citations
  • 63 upvotes
13

EvoOntology: a self-evolving semantic layer that lets data agents query heterogeneous data through an MCP server

EvoOntology tackles the agent-data gap: agents can see column names and file paths through generic tools, but not what the data actually means. It wraps an ontology (schema, content, and tool layers) as an MCP server the agent can query at runtime, uses a builder agent to construct it autonomously, and keeps refining it with attribution-guided edits that are only accepted after a paired evaluation against the backbone. The authors report consistent gains over strong baselines and hand-built semantic layers across three data-agent benchmarks and four LLM backbones.

  • 184 stars/7d
  • 0 citations
  • 126 upvotes

This week · Best AI Agent Papers