benchmark
Sentiment Consistency
benchmarkactive
sentiment-consistency-2e934fb2·1 events·first seen 26d agoAliases: Sentiment Consistency
Co-occurring entities
More like this (12)
Social Gaze ConsistencyHelpfulness ConsistencySentiment NeuronSentiment AnalysisChain-of-Thought Self-ConsistencyConsistency Training Can Entrench Misalignmentconsistency trainingSetswana Sentiment DatasetLatent Consistency ModelsSelf-Consistency / Majority VotingDynamic-Probabilistic Consistency GapAspect-Based Sentiment Analysis
Recent events (1)
Political Consistency Training: Reducing Covert Political Bias in LLMs via RL
Researchers identify a phenomenon called 'covert political bias' in LLMs, where models handle politically paired topics asymmetrically across 7 identified technique categories. They propose two metrics—Sentiment Consistency and Helpfulness Consistency—to measure this asymmetry. To address it, they introduce Political Consistency Training (PCT), an RL-based method with complementary training paradigms that reduces covert bias while preserving overall helpfulness and generalizing to held-out benchmarks.