listening-with-attention-entropy-guided-explainability-for-transformer-based-audio-models-624892ec·1 events·first seen Aliases: Listening with Attention: Entropy-Guided Explainability for Transformer-Based Audio Models
Researchers introduce LEAF-X (Listening with Entropy-guided Attention for Faithful explainability), a model-intrinsic XAI framework for transformer-based automatic speech recognition systems like Whisper. The method combines entropy-guided attention weighting, multi-layer attention rollout, and optional causal ablations to produce sparse token-to-frame attributions. Evaluations show 32% improved faithfulness and 35-39% stronger locality/sparsity compared to perturbation-based explainers and raw attention maps, enabling more auditable ASR.