other
transcriptomic foundation models
otheractiveprovisional
transcriptomic-foundation-models-4b7753f0·1 events·first seen 16d agoAliases: transcriptomic foundation models
Co-occurring entities
More like this (12)
single-cell foundation modelfoundation modelsTime Series Foundation ModelsmRNA Language Model10x Genomicsprotein language modelsTabular Foundation Models (TFMs)generative modelsNeural Surrogate ModelsSpeaking the Language of Science: Toward a General-Purpose Generative Foundation Model for the Natural SciencesMAI-Transcribe-1RNA sequencing
Recent events (1)
TxFM: Masked Autoencoding Foundation Model for RNA-seq Gene Expression Representation
The paper introduces TxFM, a self-supervised masked autoencoder model for transcriptomic (RNA-seq) data representation learning, trained on a curated 1.4M-sample corpus called DiverseRNA-1.4M. TxFM outperforms existing transcriptomic foundation models trained on datasets over 100x larger, addressing the known problem of deep models underperforming linear baselines on gene expression data. The work provides ablation studies identifying critical architecture choices and argues that careful data curation combined with inductive self-supervised learning is sufficient for strong transfer performance in transcriptomics.