DiScoFormer

Allen AI introduces DiScoFormer: unified transformer for density estimation and score functions

Allen AI presents DiScoFormer, a single transformer architecture capable of jointly estimating probability densities and score functions across different distributions. The work is published on the Hugging Face blog, suggesting an accompanying model or code release. Unifying density and score estimation in one model has implications for generative modeling, diffusion models, and probabilistic inference.