ms-coco-cd79b25f·3 events·first seen Aliases: MS COCO, MS-COCO
Researchers introduce the Complex Social Behavior (CSB) dataset of 100 images depicting complex social interactions, used to evaluate nine vision-language models spanning 2017–2025 against human descriptions and a gold standard. MLLMs have largely closed the accuracy gap with top-ranked human descriptions and nearly eliminated most error types (object detection, recognition, hallucination, scene understanding), with spatial dependence errors being the notable remaining failure mode. The study also finds that MLLMs have eliminated the accuracy gap between simple MS-COCO scenes and complex social scenes, a gap that pre-MLLM models struggled with significantly.
TEVI is a framework that uses sparse autoencoders to disentangle CLIP image embeddings and a learned masking module to selectively reconstruct embeddings conditioned on a given caption, addressing the information imbalance between images and their captions. The approach improves image-text retrieval on both coarse-grained benchmarks (MS COCO, Flickr) and fine-grained long-caption benchmarks (IIW, DOCCI), with larger gains on richer captions. The work also shows improved robustness on the RoCOCO benchmark.
Researchers at Apple introduced Feature Auto-Encoder (FAE), a latent diffusion image generator that compresses DINOv2 vision encoder embeddings before learning to denoise them, then expands them back for decoding. The approach achieves comparable image quality to state-of-the-art diffusion models while training roughly 7x faster on ImageNet class-conditional generation. The key insight is that shrinking semantically rich vision embeddings reduces compute during diffusion training without sacrificing the representational benefits of large pretrained encoders.