Match Task to Objective (MTO)

Match Task to Objective (MTO) framework for aligning fine-tuning and prompt-tuning strategies with encoder-decoder pre-training objectives

A new arXiv preprint introduces the Match Task to Objective (MTO) framework, which systematically aligns fine-tuning and prompt-tuning strategies with the pre-training objectives of encoder-decoder language models. The work focuses on commonsense knowledge retrieval and generation tasks, reporting over 120% performance gains versus conventional methods in few-shot settings. The framework includes automated methods for preparing task-related data via unsupervised adaptation and novel template design for soft prompt engineering.