GameEngineBench: New Benchmark Tests Coding Agents on Real C++ Game Engine Tasks

Jul 16, 2026

Researchers have introduced GameEngineBench, a benchmark designed to evaluate coding agents on C++ implementation tasks within Unreal Engine 5 projects. The benchmark comprises 110 tasks sourced from nine real-world game repositories, covering a wide range of gameplay and engine-related challenges. The best-performing model achieved only 55.5% pass@1, and 31 tasks were not solved by any tested configuration, underscoring the difficulty of these tasks for current AI coding agents.

Why it matters: This benchmark highlights a significant gap in the ability of current coding agents to handle complex, integrated C++ development in real-time interactive environments, pointing to important limitations in AI-assisted software engineering.

Full story at: arXiv Software Engineering ↗