technique

ensemble distillation

techniqueactiveprovisionalensemble-distillation-0d03355f·1 events·first seen 15d ago

Aliases: ensemble distillation

Co-occurring entities

Transformers Google AlphaGenome convolutional neural network T-cell acute lymphoblastic leukemia

More like this (12)

Generalized Distillation distillation Weak-to-Strong Distillation Model Distillation Self-Distillation on-policy distillation distilabel knowledge distillation distillation attacks Rank-to-Distill On-Policy Co-Distillation On-Policy Distillation (OPD)

Recent events (1)

7The Batch·15d ago·source ↗

Google's AlphaGenome Interprets Non-Coding DNA That Regulates Genetic Expression

Google has released AlphaGenome, an open-weights model that interprets the ~98% of human and mouse genomes that regulate gene expression rather than coding for proteins. The model takes up to 1 million DNA base pairs as input and outputs roughly 6,000 human and 1,000 mouse gene properties, using a CNN-transformer-CNN architecture trained via ensemble distillation from 64 pretrained models. Across 50 evaluations, AlphaGenome matched or exceeded prior models in 47 cases, and correctly predicted expression changes associated with T-cell acute lymphoblastic leukemia. Weights, API, and inference code are freely available for noncommercial use.

Open Weights Progress Multimodal Progress Transformers ensemble distillation Google +3 more