← Back to brief

Source archive

arXiv Robotics

arXiv's cs.RO (Robotics) category covers research on physical and simulated robots, including how AI models are used for perception, planning, and control in embodied systems.

56 AISurfing briefingsVisit official source ↗

Briefings where arXiv Robotics is the primary source

ResearchOfficialarXiv Robotics

Kepler-Encoder-v0.1: A Multimodal Embedding Model That Fuses Robot State and Vision

Researchers present Kepler-Encoder-v0.1, a multimodal encoder that fuses vision, proprioception, and force/torque data into a shared latent space using cross-attention and self-supervised learning. At inference, only vision is used, yet the latent representation recovers force and end-effector state information better than vision-only baselines, particularly in scenarios where visual input is limited. The encoder generalizes across four different robots, and its latent can serve as a training-free invalid-state monitor.

Why it matters: This work demonstrates that incorporating robot state during training enables vision-only representations to capture information about force and contact, potentially improving robot perception and safety without extra sensors at runtime.

Jul 16, 2026

ResearchOfficialarXiv Robotics

Agile perceptive multi-skill locomotion for quadrupedal robots in the wild

Researchers introduce APT-RL, a unified framework that enables quadrupedal robots to perform agile, multi-skill locomotion in complex environments using only onboard sensors and computation. The system allows robots to autonomously transition between different gaits and traverse obstacles such as stairs, hurdles, gaps, and uneven terrain, achieving peak speeds of up to 6 meters per second in real-world tests. The approach leverages large-scale motion datasets and reinforcement learning to train robust, transferable locomotion skills.

Why it matters: This work demonstrates a significant advance in quadrupedal robot autonomy, enabling high-speed, versatile navigation of unstructured environments without reliance on external computation.

Jul 16, 2026

ResearchOfficialarXiv Robotics

JOP-VLN: Joint On-and-Off Policy Learning for Vision-and-Language Navigation

Researchers introduce JOP-VLN, a framework that integrates imitation learning and reinforcement learning for vision-and-language navigation tasks. The method employs a three-stage training pipeline, combining off-policy imitation learning, DAgger-based exploration, and joint on-and-off policy learning. JOP-VLN achieves success rates of 69.9% on the VLN-CE R2R benchmark and 68.0% on RxR, setting a new state-of-the-art on R2R.

Why it matters: This work demonstrates a significant advance in vision-and-language navigation by effectively bridging imitation and reinforcement learning paradigms, resulting in improved navigation performance.

Jul 16, 2026

ResearchOfficialarXiv Robotics

COLMAR: Cooperative View Policy Learning for Multi-Agent Active 3D Reconstruction

COLMAR is a cooperative view policy learning framework designed for multi-agent active 3D reconstruction. It introduces shared policy optimization and reconstruction-aware objectives to improve coordination among agents, reducing redundant observations and enhancing coverage. Experiments on the GLEAM and Replica datasets show that COLMAR achieves up to 54% higher reconstruction accuracy and 49% greater coverage compared to baseline methods.

Why it matters: Improving coordination in multi-agent 3D reconstruction can significantly enhance the efficiency and quality of autonomous exploration and mapping systems.

Jul 16, 2026

ResearchOfficialarXiv Robotics

Agentic Reinforcement Learning Framework Improves Robotic Manipulation Robustness

A new agentic reinforcement learning framework enables robots to restore effective execution in manipulation tasks by making high-level decisions based on recent execution history. The approach introduces runtime metrics to assess execution quality and triggers recovery mechanisms when deviations occur. Evaluated on the LIBERO benchmark, the method achieves up to 13.7% higher success rates under standard conditions and up to 39.2% under disturbance conditions, demonstrating improved robustness.

Why it matters: Improving execution robustness in robotic manipulation is crucial for reliable performance in uncertain and dynamic environments.

Jul 16, 2026

ResearchOfficialarXiv Robotics

EgoHTR: Egocentric 4D Dataset for Human Terrain Traversal

Researchers have introduced EgoHTR, a dataset comprising 55 egocentric 4D human motion sequences recorded in complex, real-world terrains using wearable sensors and a portable 3D scanner. The dataset includes over 150,000 frames and is evaluated against motion-capture ground truth, demonstrating high accuracy. The authors also show that the dataset can be used to train perceptive locomotion policies, with successful hardware deployment on a Unitree G1 humanoid robot for reconstructed reference motions.

Why it matters: EgoHTR provides a novel resource for developing and benchmarking context-aware locomotion in humanoid robots navigating unstructured environments.

Jul 16, 2026

ResearchOfficialarXiv Robotics

Ordinal Stage-State Interface Outperforms Text in VLA Continuation Fine-Tuning

A preprint studying the LIBERO-10 robotics benchmark compares three ways of providing stage information to a VLA (Vision-Language-Action) policy: full-task instruction, current-stage text, and ordinal stage-state. Results show that while full-task instruction achieves the highest mean success rate (57.45%) under direct fine-tuning, the ordinal stage-state interface outperforms both alternatives under continuation fine-tuning, achieving 53.75% mean success rate and exceeding the others in all paired runs.

Why it matters: This work demonstrates that the effectiveness of explicit stage information in VLA policy fine-tuning depends on both the interface representation and the training setup.

Jul 16, 2026

ResearchOfficialarXiv Robotics

Topology-Agnostic Mesh Reconstruction of Deformable Objects from Sparse Touch

Researchers have developed a topology-agnostic estimator that reconstructs the full mesh of deformable objects—such as rope, cloth, and soft bodies—using only a few touch inputs and no visual data. The method employs a permutation-invariant cross-attention architecture and achieves a roughly two-thirds reduction in reconstruction error compared to non-learned baselines. Additionally, the approach leverages deep-ensemble uncertainty to guide the selection of subsequent touch points, further improving reconstruction accuracy, especially in challenging scenarios with self-occlusion.

Why it matters: This work advances robotic perception in vision-denied environments, enabling more reliable manipulation of deformable objects using sparse tactile information.

Jul 16, 2026

ResearchOfficialarXiv Robotics

VAMP-MR: Vector-Accelerated Motion Planning for Multi-Robot Arms

Researchers have introduced VAMP-MR, a suite of motion planners for multi-robot-arm systems that combine classical planning algorithms with vectorized collision-checking using CPU SIMD instructions. The approach achieves up to two orders of magnitude speedup in both motion planning and execution postprocessing for multi-arm manipulation tasks. The implementation is open-sourced to facilitate further research and development in the field.

Why it matters: This work enables near real-time, collision-free motion planning for multi-robot-arm systems, which could significantly impact industrial automation and robotics research.

Jul 16, 2026

ResearchOfficialarXiv Robotics

Semantic Anchoring Improves Generalization in Vision-Language-Action Models

A new method for Vision-Language-Action (VLA) models preserves semantic structure during fine-tuning by anchoring action representations to a semantic manifold. This plug-and-play approach prevents degradation that typically harms generalization, and is validated across multiple VLA backbones on both simulation and real-world robotics benchmarks. The method achieves up to +18.7% improvement on real-world in-distribution tasks and +21.5% on out-of-distribution generalization, without altering the deployed model.

Why it matters: Improving generalization in VLA models addresses a key challenge for deploying robotics systems in diverse, real-world environments.

Jul 16, 2026

ResearchOfficialarXiv Robotics

Layered Risk Mapping Improves Safety for Autonomous Wheelchairs in Field Hospitals

Researchers have developed a layered risk mapping framework for autonomous wheelchairs operating in expeditionary medical facilities, integrating terrain slope, obstacles, and semantic traversability using a Noisy-OR probabilistic model. Simulation results show that this approach reduces collision rates from over 73% to under 32% and more than doubles obstacle clearance compared to risk-unaware methods. Real-world tests on a commercial wheelchair across various mission profiles confirmed that the system meets planning requirements in both indoor and outdoor settings.

Why it matters: This work offers a significant advance in safe autonomous patient transport in challenging, unstructured medical environments, potentially reducing infection risk and staff workload during surges.

Jul 16, 2026

ResearchOfficialarXiv Robotics

Anchor-Align: New Method Improves VLA Robot Policy Generalization

Researchers have introduced Anchor-Align, a method that enhances behavior cloning finetuning for vision-language-action (VLA) robot policies by adding two objectives: Vision-Language Anchoring to prevent representation drift and Language-Action Alignment to improve action prediction. Tested on a physical xArm7 robot, Anchor-Align increased real-world success rates from 28% to 54% and from 37% to 60% across two VLA architectures. In simulation, the method also showed consistent improvements in handling out-of-distribution perturbations, perceptual robustness, and long-horizon control tasks.

Why it matters: Anchor-Align addresses key limitations in VLA policy finetuning, offering a practical solution that significantly improves generalization and robustness in real and simulated robotic tasks.

Jul 16, 2026

ResearchOfficialarXiv Robotics

WANDA: Synthetic Data Engine Enables Open-World Mobile Manipulation from One Demonstration

Researchers present WANDA, a synthetic data engine that generates extensive training data from a single human demonstration for open-world mobile manipulation. WANDA reconstructs scenes and robot-object interaction trajectories, rearranges them into diverse spatial configurations, and synthesizes photo-realistic observations. Policies trained with WANDA demonstrate long-horizon robustness and generalization across different environments and robot embodiments in both simulation and real-world tasks.

Why it matters: WANDA could significantly reduce the human effort required to train generalist mobile manipulation robots, potentially accelerating their practical deployment.

Jul 16, 2026

ResearchOfficialarXiv Robotics

GPUSimBench Reveals Hidden Limits in GPU-Accelerated Simulators for Embodied AI

A new benchmark, GPUSimBench, systematically evaluates GPU-accelerated simulators used in embodied AI, such as Isaac Lab and Genesis, uncovering critical trade-offs between scalability, physical fidelity, and computational determinism. The study demonstrates that as simulation throughput increases, non-determinism and variability across parallel environments become significant, with four distinct regimes of stochasticity identified. These findings suggest that current GPU-based simulators may compromise reproducibility in large-scale robot learning unless explicit constraints are imposed.

Why it matters: Understanding and addressing non-determinism in GPU-accelerated simulators is essential for ensuring reliable and reproducible training in large-scale embodied AI systems.

Jul 16, 2026

ResearchOfficialarXiv Robotics

HRIBench: New Benchmark for Human-Robot Interaction Reveals Gaps in Current Robot Policies

Researchers have introduced HRIBench, a benchmark designed to evaluate vision-language-action (VLA) models in collaborative human-robot interaction scenarios. HRIBench features 13 tasks and over 650 episodes, focusing on intent understanding, temporal coordination, and safety in shared agency settings. Evaluations show that current robot policies such as GR00T and pi0.5 perform well in manipulation but struggle significantly with collaborative and interaction-centric tasks. Fine-tuning on HRIBench data improves collaborative performance, and simulation data from the benchmark has been shown to enhance real-world task success rates for robots.

Why it matters: HRIBench exposes critical shortcomings in current robot policies for real-world collaboration and provides a new tool for advancing interaction-aware robot learning.

Jul 16, 2026

ResearchOfficialarXiv Robotics

LapSurgie: Humanoid Robots Perform Laparoscopic Surgery via Teleoperation

Researchers have introduced LapSurgie, described as the first humanoid-robot-based laparoscopic teleoperation framework. The system uses an inverse-mapping strategy to control standard surgical tools without requiring additional setup, and a user study provides initial evidence of its effectiveness.

Why it matters: This work suggests a potential path to expanding access to minimally invasive surgery in underserved regions by enabling humanoid robots to operate in existing operating rooms without infrastructure changes.

Jul 15, 2026

ResearchOfficialarXiv Robotics

PREC: A Framework for Deployable Human Preference Alignment in Robotics

Researchers introduce PREC, a framework that clusters users by preference to learn representative reward models from sparse and noisy feedback. In simulated locomotion tasks, PREC groups users into preference-coherent clusters more accurately than baseline methods and improves social welfare metrics compared to both single shared-policy and per-user alignment approaches.

Why it matters: This work proposes a practical solution for aligning robot policies with diverse human preferences, addressing challenges of sparse and noisy feedback and reducing deployment validation burden.

Jul 15, 2026

ResearchOfficialarXiv Robotics

MAMMOTH: Multi-Modal End-to-End Policy for Robust Off-Road Navigation

Researchers present MAMMOTH, a unified end-to-end navigation policy that integrates RGB, thermal, 3D point cloud, and ego velocity data for autonomous off-road navigation. The system employs a modality dropout training scheme to ensure robustness to missing sensor inputs and uses a diffusion policy for safer, terrain-aware trajectory planning. Real-world experiments demonstrate improved collision avoidance, terrain-aware planning, and generalization to missing modalities, including during night-time operation.

Why it matters: This work advances autonomous off-road navigation by enabling robust performance even when some sensors fail or degrade, addressing a key challenge in the field.

Jul 15, 2026

ResearchOfficialarXiv Robotics

Instance-Enriched Semantic Maps Improve Visual Language Navigation

A new framework called Instance-Enriched Semantic Maps (IESM) has been proposed for Visual Language Navigation (VLN). IESM uses 2.5D maps with instance-level object details and LLM-based query processing, enabling more robust navigation in complex indoor environments. The method achieves approximately 96% storage reduction compared to 3D scene graphs, and demonstrates over 17% improvement in object retrieval and over 23% in navigation success rates compared to baseline methods.

Why it matters: This work represents a significant advance in efficient and robust robot navigation using natural language instructions in complex environments.

Jul 15, 2026

ResearchOfficialarXiv Robotics

TrustVLA: Mechanism-Guided Defense Against Backdoors in Vision-Language-Action Models

Researchers introduce TrustVLA, an inference-time defense designed to detect and mitigate backdoor attacks in Vision-Language-Action (VLA) models. TrustVLA identifies abnormal evidence evolution and localizes compact causal footprints associated with visual triggers, enabling recovery of clean behavior without retraining. The method operates using only a small clean calibration set and demonstrates reduced attack success while maintaining clean-task performance.

Why it matters: This work provides a practical, retraining-free defense against backdoor attacks in VLA models, addressing a significant security risk in robotics applications.

Jul 15, 2026