Almanac
benchmark

Open ASR Leaderboard

benchmarkactiveopen-asr-leaderboard-f5ba47ea·2 events·first seen 1mo ago

Aliases: Open ASR Leaderboard

Co-occurring entities

More like this (12)

Recent events (2)

4Hugging Face Blog·1mo ago·source ↗

Adding Benchmaxxer Repellant to the Open ASR Leaderboard

Hugging Face describes measures taken to prevent benchmark gaming ('benchmaxxing') on the Open ASR Leaderboard by introducing private or held-out evaluation data. The post addresses the integrity of automatic speech recognition benchmarks, where models may be overfitted or tuned specifically to public test sets. This is part of a broader effort to maintain meaningful leaderboard rankings as ASR model submissions increase.

4Hugging Face Blog·28d ago·source ↗

Open ASR Leaderboard: Trends and Insights with New Multilingual & Long-Form Tracks

Hugging Face has updated its Open ASR Leaderboard to include new multilingual and long-form audio transcription evaluation tracks. The post analyzes trends across submitted automatic speech recognition models, providing comparative benchmarking data across languages and extended audio contexts. This expands the leaderboard's coverage beyond English short-form ASR to better reflect real-world deployment scenarios.