paper

Multi-Task Bayesian In-Context Learning

paperactiveprovisionalmulti-task-bayesian-in-context-learning-ba9d0172·1 events·first seen 47h ago

Aliases: Multi-Task Bayesian In-Context Learning

Co-occurring entities

More like this (12)

In-Context Multiple Instance Learning Multi-Task Learning in-context learning Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation Latent Context Language Models In-Context Reward Adaptation When English Isn't the Best Teacher: Source Language Effects in Cross-Lingual In-Context Learning Sparse Subspace-to-Expert Sharing for Task-Agnostic Continual Learning Contextual Retrieval Multimodal Learning Observe-and-Act Adaptive Context Selection Multiple Instance Learning (MIL)

Recent events (1)

5arXiv · cs.LG·47h ago·source ↗

Multi-Task Bayesian In-Context Learning for Amortized Hierarchical Inference

A new arXiv preprint introduces a multi-task in-context learning framework for amortized hierarchical Bayesian predictive inference, representing prior information as a prefix of in-context datasets fed to a transformer. The model learns to adapt predictions across families of priors, addressing the brittleness of prior-data fitted models under distribution shift. On evaluations including out-of-meta-distribution priors and high-dimensional latent structures, the method matches oracle Bayesian predictors while being orders of magnitude faster, with a real-world spatiotemporal temperature prediction demonstration.

Evaluation and Benchmarking Multi-Task Bayesian In-Context Learning Prior-Data Fitted Networks