Almanac
technique

Reptile

techniqueactivereptile-bee13233·2 events·first seen 28d ago

Aliases: Reptile

Co-occurring entities

More like this (12)

Recent events (2)

5Openai Blog·28d ago·source ↗

Reptile: A Scalable Meta-Learning Algorithm from OpenAI

OpenAI introduced Reptile, a meta-learning algorithm that works by repeatedly sampling tasks, running stochastic gradient descent, and updating initial parameters toward the task-specific learned parameters. It is mathematically related to first-order MAML but requires only black-box access to standard optimizers like SGD or Adam. The algorithm is positioned as computationally efficient and comparably performant to MAML-based approaches.

5Openai Blog·28d ago·source ↗

On First-Order Meta-Learning Algorithms

OpenAI published research on first-order meta-learning algorithms, presenting simplified variants of MAML (Model-Agnostic Meta-Learning) that omit second-order derivatives while retaining competitive performance. The work demonstrates that first-order approximations are surprisingly effective for few-shot learning tasks. This contributed to the broader understanding of gradient-based meta-learning efficiency and scalability.