LLMs Fail to Generate Compilable Unity Game Scenes in Single Pass, Study Finds

Jul 14, 2026

A new preprint evaluates large language models' (LLMs) ability to generate Unity C# game scenes in a single pass, without iterative repair. Across 10,400 generations, none of the outputs compiled successfully. The study categorizes over 90,000 compiler errors, finding that most failures stem from invented or misused Unity APIs rather than general code structure, highlighting a key limitation in LLMs' domain-specific knowledge.

Why it matters: This work demonstrates a fundamental barrier to using LLMs for domain-specific code generation without iterative feedback, clarifying the gap between LLMs' general knowledge and practical software engineering needs.

Full story at: arXiv Software Engineering ↗