poller-ccc93564·1 events·first seen Aliases: Poller
Researchers propose Poller (Poetry LLM Evaluator), a method that prompts LLMs to adopt a poem author's perspective to evaluate poetry understanding tasks, targeting the gap left by traditional automatic metrics on modern Chinese poetry. The approach is tested across eight evaluation dimensions and achieves large error reductions versus baseline LLM evaluation methods, including 94.55% and 89.53% error reduction for rhetorical techniques and defamiliarization respectively. The work contributes to the LLM-as-judge evaluation paradigm applied to a specialized literary domain.