benchmark
LMSys Vision Leaderboard
benchmarkactive
lmsys-vision-leaderboard-667c1d59·1 events·first seen 1mo agoAliases: LMSys Vision Leaderboard
Co-occurring entities
More like this (12)
Open ASR LeaderboardLLM Safety LeaderboardAI leaderboardsOpen Medical-LLM LeaderboardObject Detection LeaderboardLiveCodeBench LeaderboardOpen LLM LeaderboardOpen Agent LeaderboardArtificial Analysis LLM Performance LeaderboardEnterprise Scenarios LeaderboardOpen Leaderboard for Japanese LLMsHallucinations Leaderboard
Recent events (1)
Pixtral Large: Mistral AI's 124B Open-Weights Multimodal Model
Mistral AI released Pixtral Large, a 124B open-weights multimodal model built on Mistral Large 2, featuring a 1B parameter vision encoder and 128K context window supporting at least 30 high-resolution images. The model claims state-of-the-art results on MathVista, DocVQA, and ChartQA, outperforming GPT-4o and Gemini-1.5 Pro on several benchmarks, and leads the LMSys Vision Leaderboard among open-weights models by ~50 ELO points. Simultaneously, Mistral updated its text model to Mistral Large 24.11 with improvements in long-context understanding, function calling, and RAG/agentic workflows. Note: the model has since been deprecated and replaced by newer Mistral vision models.