SGD

Reptile: A Scalable Meta-Learning Algorithm from OpenAI

OpenAI introduced Reptile, a meta-learning algorithm that works by repeatedly sampling tasks, running stochastic gradient descent, and updating initial parameters toward the task-specific learned parameters. It is mathematically related to first-order MAML but requires only black-box access to standard optimizers like SGD or Adam. The algorithm is positioned as computationally efficient and comparably performant to MAML-based approaches.