GEST-Engine: From Text to Fully-Annotated Synthetic Video via Explicit World Models

Jul 15, 2026

The GEST-Engine is a system that generates fully-annotated synthetic multi-actor video from natural language input by maintaining an explicit, inspectable world model represented as a Graph of Events in Space and Time (GEST). It produces frame-aligned RGB video, depth, segmentation, pose, and other annotations at zero marginal annotation cost. The system guarantees object permanence and temporal consistency, making it suitable for generating training data and evaluation benchmarks for video understanding.

Why it matters: GEST-Engine enables scalable production of richly annotated synthetic video with guaranteed consistency, potentially reducing reliance on manual annotation in video research.

Full story at: arXiv Computer Vision ↗