4arXiv cs.CL (Computation and Language)·
AIriskEval-edu: Platform for auditing pedagogical risks in AI-generated educational explanations
Researchers present AIriskEval-edu Demo, a platform that audits instructional explanations across five pedagogical risk dimensions including factual accuracy, ideological bias, and student-level appropriateness. The system integrates GPT-5.5 via API alongside a fine-tuned self-hosted Llama 3.1 8B evaluator, with the local model outperforming GPT-5.5 on most metrics. The platform targets K-12 educational contexts and supports both automated auditing of AI-generated explanations and real-time auditing of human-written content, offering institutions a privacy-preserving deployment option.
Related guides (4)
Related events (8)
Eticas AI Risk Taxonomy v2.0.0: Open infrastructure for operationalizing AI audits
Eticas presents a structured AI auditing framework that bridges risk cataloging to executable audit methodology, demonstrated end-to-end on PII leakage testing against GPT-4-0314. The taxonomy organizes 76 active subcategories across 10 categories with mappings to 18 external frameworks, and is published under CC BY 4.0 with SKOS/JSON-LD distributions. The key contribution is an operationalization layer that converts named risks into measurable, severity-graded findings — addressing a gap the authors identify across at least 74 existing AI risk taxonomies. The PII leakage demonstration shows disclosure rates ranging from 0% to 84% under adversarial conditioning, graded as SYSTEMIC severity.
SafetyKit scales risk agents with OpenAI's most capable models
SafetyKit, a content moderation and compliance platform, has integrated OpenAI's GPT-5 to power its risk-detection agents. The deployment targets content moderation accuracy and compliance enforcement, positioning itself as a replacement for legacy safety systems. This represents a production enterprise use case of GPT-5 in trust and safety workflows.
AI Safety via Debate
OpenAI proposes a safety technique in which two AI agents debate a topic and a human judge determines the winner, with the goal of making it easier for humans to supervise AI systems that may be more capable than themselves. The core intuition is that it is easier to verify a correct argument than to generate one, so a dishonest agent can be caught by an honest opponent. The paper introduces debate as a scalable oversight mechanism applicable to complex tasks where direct human evaluation is infeasible.
ResearchArena: Framework for evaluating sabotage and AI control in automated AI R&D
ResearchArena is a new evaluation framework for assessing AI control mechanisms in automated AI R&D pipelines, covering four long-horizon tasks including safety post-training, capabilities post-training, CUDA-kernel optimization, and inference-server optimization. The framework tests frontier agents on both sabotage (covert harmful modifications to submitted artifacts) and monitoring (detecting such sabotage), finding that sabotage hidden in training data is caught fewer than half the time. Monitors that can execute and probe artifacts perform better but still miss embedded sabotage through surface-level inspection, false explanations, or wrong test probes. The work is released as a modular open framework, directly relevant to the emerging challenge of safely deploying AI agents that automate AI research.
Automated Benchmark Auditing for AI Agents and Large Language Models (ABA)
The paper introduces Auto Benchmark Audit (ABA), an agentic framework that systematically audits AI benchmark tasks for issues such as ambiguous specifications, environment conflicts, and incorrect ground truths. Applied to 168 benchmarks across nine domains including NeurIPS publications, ABA identifies critical issues in over 25.7% of evaluated tasks. The authors demonstrate that filtering out flawed tasks materially shifts model rankings and improves average performance on SWE-bench Verified and Terminal-Bench 2 by 9.9% and 9.6% respectively, indicating that current benchmark scores are significantly distorted by task quality problems. The agentic tool and annotations are released publicly.
OpenAI Releases Teen Safety Policies for Developers via gpt-oss-safeguard
OpenAI has published prompt-based teen safety policies targeting developers who build on its models, specifically leveraging the gpt-oss-safeguard model to moderate age-specific risks. The release provides structured guidance and tooling for filtering or adjusting AI outputs in contexts where minors may be users. This represents an extension of OpenAI's safety infrastructure into the developer-facing layer, addressing regulatory and reputational pressure around youth-facing AI deployments.
OpenAI Launches ChatGPT Edu for Universities
OpenAI announced ChatGPT Edu, an affordable tier of ChatGPT designed specifically for university deployment. The offering aims to help higher education institutions responsibly integrate AI into campus life. This is a product launch targeting the academic sector with pricing and governance features suited for institutional use.
AI-Assisted Systematization for Evaluating GenAI Systems
This paper addresses a foundational gap in GenAI evaluation: the underspecification of broad, contested concepts like 'reasoning,' 'fairness,' or 'creativity.' The authors introduce a structured artifact called a 'concept spec' and a validation worksheet, then build two AI-assisted systematizers—a zero-shot approach and a multi-agent approach—to convert vague evaluation targets into measurable, structured accounts. They apply these tools to hate-based rhetoric and digital empathy, assessing the resulting specs on content validity and information recoverability. The work positions AI assistance as a scalable aid for the cognitively demanding process of evaluation design.