JOP-VLN: Joint On-and-Off Policy Learning for Vision-and-Language Navigation

Jul 16, 2026

Researchers introduce JOP-VLN, a framework that integrates imitation learning and reinforcement learning for vision-and-language navigation tasks. The method employs a three-stage training pipeline, combining off-policy imitation learning, DAgger-based exploration, and joint on-and-off policy learning. JOP-VLN achieves success rates of 69.9% on the VLN-CE R2R benchmark and 68.0% on RxR, setting a new state-of-the-art on R2R.

Why it matters: This work demonstrates a significant advance in vision-and-language navigation by effectively bridging imitation and reinforcement learning paradigms, resulting in improved navigation performance.

Full story at: arXiv Robotics ↗