technique

distributed training

techniqueactivedistributed-training-abe09bad·1 events·first seen 28d ago

Aliases: distributed training

Co-occurring entities

large language models computer vision Jack Clark Import AI

More like this (12)

collaborative distributed training large-batch training Training Cluster as a Service large neural network training self-training adversarial training machine teaching Federated Learning distributed optimization test-time training Random Network Distillation generative post-training

Recent events (1)

4Import Ai·28d ago·source ↗

ImportAI 449: LLMs training other LLMs; 72B distributed training run; computer vision is harder than generative text

Import AI issue 449 covers several AI/ML developments including LLMs being used to train other LLMs, a 72B parameter distributed training run, and analysis of why computer vision remains harder than generative text. The newsletter also touches on potential political implications of AI progress. As a tier-2 commentary source, this aggregates and contextualizes multiple technical developments across the AI landscape.

Training Infrastructure Frontier Model Releases large language models computer vision Jack Clark +4 more