DM-KG: A Structured Knowledge Graph Framework Improves Spatial Reasoning in Vision-Language Models for Street View Imagery

Jul 15, 2026

A new framework called DM-KG introduces a structured knowledge graph to enhance spatial reasoning in vision-language models (VLMs) applied to street view imagery. By extracting and encoding directional and metric relationships between entities from 2D images, DM-KG significantly reduces distance estimation and direction judgment errors on spatial question-answering benchmarks.

Why it matters: This work offers a notable advance in improving the spatial cognition of VLMs, addressing a key limitation for their deployment in geospatial and geographic visual question answering tasks.

Full story at: arXiv Computer Vision ↗