DenseReward: Dense Reward Learning via Failure Synthesis for Robotic Manipulation

Jul 15, 2026

DenseReward is a dense robotic reward model designed to overcome the limitations of current vision-language reward models in reinforcement learning for robotics. By introducing an automated pipeline that synthesizes diverse, physically realistic failure trajectories in simulation, DenseReward enables fine-grained, frame-level reward prediction from visual observations and language instructions. Experimental results indicate that DenseReward outperforms existing models in both simulated and real-world robotic manipulation tasks, and provides effective reward signals for reinforcement learning and model predictive control.

Why it matters: This work addresses a major challenge in robotic reinforcement learning by enabling dense, informative reward signals without requiring costly human labeling, potentially accelerating progress in autonomous robot learning.

Full story at: arXiv Robotics ↗