technique
instruction-based multitask pretraining
techniqueactive
instruction-based-multitask-pretraining-39bd1e66·1 events·first seen 1mo agoAliases: instruction-based multitask pretraining
Co-occurring entities
More like this (12)
Unsupervised Pre-trainingContrastive Pre-trainingtemporally ordered pre-trainingcontrastive vision-language pretraininginstruction tuningMulti-Task Learningmultimodal pretrainingVideo PreTraining (VPT)machine teachingInstructGPTSelf-Supervised PretrainingContrastive Language-Image Pretraining (CLIP)
Recent events (1)
OFA: Towards Building a One-For-All Unified Multimodal Pretrained Model
Alibaba's Qwen team introduces OFA (One-For-All), a unified multimodal pretrained model designed to handle both understanding and generation tasks across multiple modalities within a single framework. The model is pretrained using instruction-based multitask pretraining to endow it with diverse capabilities. This work was published in late 2022 as part of the broader wave of generalist multimodal models. It represents an early effort toward a single model architecture capable of spanning vision, language, and cross-modal tasks.