matryoshka-representation-learning-de3aba0d·2 events·first seen Aliases: Matryoshka Representation Learning
Researchers introduce CAMMAR, a representation learning framework that organizes Arabic language meaning into nested lexical, cultural, and metaphorical embedding subspaces using a staged semantic curriculum inspired by Al-Jurjani's classical theory of nazum. The framework addresses 'semantic smearing' in current Arabic LMs and yields a training-free geometric metaphoricity measure. On a new span-annotated Arabic metaphor dataset, the geometric readout achieves AUC up to 0.84 and correctly ranks figurative over literal counterparts in 82.6% of pairs under paired supervision, though performance collapses to chance under unsupervised domain contrast alone.
This Hugging Face blog post introduces Matryoshka Representation Learning (MRL), a technique for training embedding models that encode information at multiple granularities within a single vector. The approach allows truncating embeddings to smaller dimensions without significant loss in retrieval quality, enabling flexible trade-offs between storage/compute costs and accuracy. The post covers training, evaluation, and practical usage of Matryoshka embedding models via the Sentence Transformers library.