triviaroomqa-54b9bb7b·1 events·first seen Aliases: TriviaRoomQA
Researchers introduce TriviaRoomQA, a multilingual benchmark with 3,300 parallel multiple-choice questions across six European languages and 5,340 French-only questions, covering 288 topics drawn from quiz and trivia contexts. Evaluating 30 open-weight LLMs (7B–70B parameters) from European, Asian, and North American providers, the study finds models perform well on history, geography, and math but substantially worse on popular-culture topics like celebrities, music, and movies. Performance also varies across languages for identical underlying questions, indicating factual knowledge access is language-dependent. The work highlights a knowledge gap not captured by existing saturated academic benchmarks.