Apple-PI Benchmark Tests Video Models' Grasp of Physical Laws
Researchers introduce Apple-PI, a benchmark designed to evaluate video generation models based on their adherence to physical laws, rather than just output plausibility. The benchmark features 400 videos covering classical mechanics tasks and employs a three-stage protocol to diagnose where models fail in the reasoning process. Testing 11 models revealed that the best-performing model achieved a score of only 0.473, highlighting that current video models are not yet reliable law-grounded world simulators.
Why it matters: Apple-PI offers a new diagnostic tool to guide the development of video models toward genuine physical understanding, which is essential for applications that require accurate world simulation.
Full story at: arXiv Computer Vision ↗