technique
Faithfulness Evaluation
techniqueactiveprovisional
faithfulness-evaluation-d4d914c2·1 events·first seen 16d agoAliases: Faithfulness Evaluation
Co-occurring entities
More like this (12)
Quantifying Faithful Confidence Expression in Large Reasoning ModelsPlausibility EvaluationFaith-ShapEDIT: Evidence-Diagnosed Intervention Training for Rule-Faithful LLM GradingBeliefTrackFidelity Management & Research CompanyValueEvalTRUSTHelpfulness ConsistencyCybersecurity Task EvaluationEvaluation on the HubIFEval
Recent events (1)
Disagreeing Rationales: Rethinking Classification and Explainability Evaluation in Hate Speech Detection
This paper investigates human disagreement in token-level rationale annotations for hate speech detection, a dimension less studied than label disagreement. The authors unify diverse models, training strategies, loss functions, and evaluation metrics under a single protocol, systematically comparing hard and soft label/rationale representation spaces. Results show that both hard and soft metrics favor softer representations, suggesting that soft supervision better captures human reasoning variation in subjective NLP tasks. The work calls for rethinking evaluation frameworks for classification and explainability in subjective NLP.