sim-to-real transfer
sim-to-real-transfer-186c4b55·3 events·first seen 1mo agoAliases: sim-to-real transfer
Co-occurring entities
More like this (12)
Recent events (3)
Generalizing from Simulation: OpenAI Sim-to-Real Robotics Transfer
OpenAI published results on sim-to-real transfer for robot controllers, demonstrating that policies trained entirely in simulation can be deployed on physical robots and respond to unplanned environmental changes. The work represents a shift from open-loop to closed-loop control systems in robotics. This is a 2017 research milestone predating current frontier model work but relevant to the historical trajectory of OpenAI's robotics program.
Sim-to-real transfer of robotic control with dynamics randomization
OpenAI published research on transferring robotic control policies trained in simulation to real-world robots using dynamics randomization. The technique involves varying physical parameters during simulation training so that the real world appears as just another variation, enabling zero-shot sim-to-real transfer. This was an early foundational contribution to the sim-to-real robotics research thread.
Scaling Up Reinforcement Learning for Traffic Smoothing: A 100-AV Highway Deployment
Berkeley AI Research (BAIR) deployed 100 RL-controlled autonomous vehicles into real rush-hour highway traffic on Interstate 24 near Nashville to dampen stop-and-go waves and reduce fuel consumption. The RL controllers were trained in data-driven simulations built from real highway trajectory data, using only local sensor inputs (speed, lead vehicle speed, gap) to enable decentralized deployment on standard vehicles. Reward design balanced wave smoothing, energy efficiency, safety, comfort, and adherence to human driving norms. The paper documents the sim-to-real transfer challenges encountered during this large-scale field experiment.