technique
Contrastive Pre-training
techniqueactive
contrastive-pre-training-260140f5·1 events·first seen 28d agoAliases: Contrastive Pre-training
Co-occurring entities
More like this (12)
contrastive vision-language pretrainingContrastive Language-Image Pretraining (CLIP)contrastive learningContrastive SearchUnsupervised Pre-traininginstruction-based multitask pretrainingtemporally ordered pre-trainingVideo PreTraining (VPT)Self-Supervised PretrainingCORE (Contrastive Reflection)multimodal pretrainingTemporal Difference Learning
Recent events (1)
Text and Code Embeddings by Contrastive Pre-training
OpenAI published research on generating text and code embeddings using contrastive pre-training. The approach trains models to produce dense vector representations useful for semantic search, classification, and code retrieval tasks. This work underpins OpenAI's embeddings API offerings and represents an early public articulation of their embedding methodology.