VisualRepair: Dynamic Tool Calling and Region Focusing for Visual Software Issue Repair

Jul 16, 2026

VisualRepair is a new framework for automated program repair that leverages multimodal large language models (MLLMs) to incorporate visual information from bug screenshots. It introduces image type-aware tool calling and dynamic region focusing to improve fault localization and patch generation. On the SWE-bench Multimodal benchmark, VisualRepair resolves 196 test set instances, outperforming the best baseline by 10 instances.

Why it matters: This work demonstrates a meaningful advance in automated program repair by effectively integrating visual information from bug reports, addressing challenges in modern software with graphical interfaces.

Full story at: arXiv Software Engineering ↗