hm3d-6e476541·2 events·first seen Aliases: HM3D
A new arXiv paper proposes a context-conditioned safety critic that learns adaptive clearance preferences for ranking diffusion-based trajectory proposals in indoor robot navigation. The critic decomposes into safety, efficiency, and distance-constraint matching terms, trained with privileged ESDF geometry in simulation and distilled into a perception-only selector via teacher-student learning. The method achieves top success rate and SPL on PointGoal navigation benchmarks (HM3D, MP3D) and transfers zero-shot to a Unitree G1 humanoid robot without task-specific tuning.
This paper addresses the failure modes of curiosity-driven RL in complex 3D environments, where agents revisit forgotten states and get trapped in local loops due to lacking spatial persistence and episodic memory. The authors combine an online 3D reconstruction as a persistent world model with a sequence-model policy over RGB observations to maintain episodic trajectory context. Trained purely via intrinsic curiosity on HM3D, the agent outperforms RL-based active mapping baselines and zero-shot generalizes to Gibson and AI-generated environments. The approach also enables efficient downstream task adaptation for apple picking and image-goal navigation.