Almanac
benchmark

CN-NewsTTS Bench

benchmarkactiveprovisionalcn-newstts-bench-31a3a7ed·1 events·first seen 7d ago

Aliases: CN-NewsTTS Bench

More like this (12)

Recent events (1)

3arXiv · cs.CL·7d ago·source ↗

CN-NewsTTS Bench: automatic benchmark for Chinese news TTS pronunciation of complex written forms

Researchers introduce CN-NewsTTS Bench v0.1, an open benchmark for evaluating Chinese news text-to-speech systems on challenging written forms such as scores, abbreviations, unit symbols, and mixed-script names — all from raw text without preprocessing aids. The benchmark includes a 200-record dev set, 800-record public test set, an automatic scorer, and baseline results for seven commercial TTS systems. Best-in-class accuracy reaches 0.879 strict accuracy while several systems fall below 0.60, revealing meaningful performance gaps on a practically important but underexplored evaluation dimension.