Instance-Enriched Semantic Maps Improve Visual Language Navigation

Jul 15, 2026

A new framework called Instance-Enriched Semantic Maps (IESM) has been proposed for Visual Language Navigation (VLN). IESM uses 2.5D maps with instance-level object details and LLM-based query processing, enabling more robust navigation in complex indoor environments. The method achieves approximately 96% storage reduction compared to 3D scene graphs, and demonstrates over 17% improvement in object retrieval and over 23% in navigation success rates compared to baseline methods.

Why it matters: This work represents a significant advance in efficient and robust robot navigation using natural language instructions in complex environments.

Full story at: arXiv Robotics ↗