OpenAI Releases Full Version of Gym Retro with 1,000+ Games
OpenAI has released the full version of Gym Retro, a reinforcement learning research platform supporting over 1,000 games across multiple emulators. This expands the previously public release of ~70 Atari and ~30 Sega games. OpenAI is also releasing the tooling used to add new games to the platform, enabling community expansion.
Related guides (3)
Related events (8)
OpenAI Gym Beta Release
OpenAI released the public beta of OpenAI Gym, a toolkit for developing and comparing reinforcement learning algorithms. The toolkit includes a suite of environments ranging from simulated robots to Atari games, along with a site for comparing and reproducing results. This represented a significant early infrastructure contribution to the RL research community.
Safety Gym: OpenAI Releases RL Safety Constraint Benchmark Suite
OpenAI released Safety Gym, a suite of environments and tools designed to measure progress in training reinforcement learning agents that respect safety constraints during training. The toolkit targets the challenge of constrained RL, where agents must optimize objectives without violating specified safety boundaries. This represents an early formal effort by OpenAI to provide standardized benchmarking infrastructure for safe RL research.
OpenAI Releases CoinRun Environment for Measuring RL Generalization
OpenAI released CoinRun, a procedurally generated platformer training environment designed to measure reinforcement learning agents' ability to generalize to novel situations. The environment is positioned as simpler than Sonic the Hedgehog benchmarks but still challenging enough to expose generalization failures in state-of-the-art RL algorithms. It addresses a longstanding puzzle in RL research around overfitting to training environments versus true generalization.
OpenAI Releases Most Capable Open-Weights Models
OpenAI has released what it describes as its most capable open-weights models, framing the move as a major step toward broader AI accessibility. The announcement emphasizes openness, flexibility, and global reach as core motivations. This marks a significant shift in OpenAI's historically closed model distribution strategy.
OpenAI Releases Universe: A Platform for Training AI Across Games, Websites, and Applications
OpenAI released Universe, a software platform designed to measure and train AI general intelligence across a broad range of environments including games, websites, and other applications. The platform aims to expose AI agents to the world's supply of software as training and evaluation environments. This represented an early effort to develop general-purpose AI agents capable of operating across diverse real-world interfaces.
OpenAI Releases Neural MMO: Massively Multiagent RL Game Environment
OpenAI released Neural MMO, a massively multiagent game environment designed for reinforcement learning research. The platform supports a large and variable number of agents operating within a persistent, open-ended task structure. The environment is designed to encourage emergent behaviors including better exploration, divergent niche formation, and improved overall agent competence through multi-species competition.
Ingredients for robotics research
OpenAI released eight simulated robotics environments and a Baselines implementation of Hindsight Experience Replay (HER), developed over the prior year for internal research. These environments were used to train models that transfer to physical robots. The release also included a set of research requests to guide community contributions in robotics.
OpenAI Five Defeats Amateur Human Teams at Dota 2
OpenAI announced that OpenAI Five, a team of five neural networks trained via self-play, has begun defeating amateur human teams at Dota 2. This represented an early milestone in applying reinforcement learning to complex, long-horizon multi-agent environments. The system was trained using large-scale distributed RL, demonstrating that neural networks could coordinate in real-time strategy games without hand-crafted rules.