EvoClawBench: Benchmarking Agents' Ability to Learn Reusable Skills from Their Own Runs

Jul 14, 2026

EvoClawBench is a new benchmark designed to test whether AI agents can transform evidence from their own runs into reusable skills that improve future executions. The benchmark covers 100 tasks across coding, data, office, security, operations, and domain-document workflows, and supports multiple agent runtimes. Experiments with OpenClaw and nanobot show that the ability to learn reusable skills is selective and cost-sensitive: some models improve with skill learning, while others experience performance drops or collapse. This demonstrates that skill learning from experience is not an automatic benefit for agent systems.

Why it matters: This work isolates and rigorously tests a critical capability for autonomous agents—learning from their own experience—and shows that it is not guaranteed, informing the design of more robust agent systems.

Full story at: arXiv Machine Learning ↗