Entity · paper

Beyond Third-Person Audits: Situated Interaction Auditing for User-Centered LLM Bias Research

paperactivebeyond-third-person-audits-situated-interaction-auditing-for-user-centered-llm-bias-research-c382796f·1 events·first seen Jun 11, 2026

Aliases: Beyond Third-Person Audits: Situated Interaction Auditing for User-Centered LLM Bias Research

Co-occurring entities

Situated Interaction Auditing

More like this (12)

Situated Interaction Auditing Reason-Mediated Behavioral Models for Auditing LLM Social Simulators Revising Context, Shifting Simulated Stance: Auditing LLM-Based Stance Simulation in Online Discussions LLM Detection as an Intervention: Downstream Impact under Strategic User Behavior Inside the Unfair Judge: A Mechanistic Interpretability Account of LLM-as-Judge Bias Can LLMs Judge Better Than They Generate? Evaluating Task Asymmetry, Mechanistic Interpretability and Transferability for In-Context QA When the Judge Changes, So Does the Measurement: Auditing LLM-as-Judge Reliability AISPA: User-Centric System Prompt Auditing for Large Language Model Applications Security and Privacy Prompts in the Wild: What Users Ask LLMs and How LLMs Respond From Representations to Behaviors: Exploring the Person-Situation-Behavior Triad in LLMs The Masked Advantage: Uncovering Local-Language Access to Cultural Knowledge in LLMs Online Safety Monitoring for LLMs

Recent events (1)

5arXiv · cs.CL·Jun 11, 2026·source ↗

Situated Interaction Auditing: A user-centered framework for LLM bias research

Researchers propose Situated Interaction Auditing (SIA), a new framework for studying LLM bias from the perspective of the user rather than third-party demographic representation. The core insight is that bias can manifest in how a model treats its interlocutor — varying response quality, content, and tone based on implicit sociodemographic signals, writing style, or stated identity — rather than only in how it describes external groups. The paper demonstrates SIA through a case study intersecting gender and socioeconomic status signals across multiple task domains and outlines a research agenda for the approach.

Evaluation and Benchmarking AI Safety Research Beyond Third-Person Audits: Situated Interaction Auditing for User-Centered LLM Bias Research Situated Interaction Auditing