technique

misalignment detection

techniqueactivemisalignment-detection-af77b44a·1 events·first seen 28d ago

Aliases: misalignment detection

Co-occurring entities

chain-of-thought monitoring OpenAI OpenAI internal coding agents

More like this (12)

hidden misalignment emergent misalignment misalignment generalization AI alignment image manipulation detection ALIGN The Alignment Project human uncertainty alignment temporal glitch detection MedAlign deliberative alignment alignment auditing

Recent events (1)

7Openai Blog·28d ago·source ↗

How OpenAI Monitors Internal Coding Agents for Misalignment

OpenAI describes its use of chain-of-thought monitoring to detect misalignment in internally deployed coding agents. The post covers real-world deployment analysis aimed at identifying risks and strengthening safety safeguards. This represents a practical, operational approach to alignment monitoring rather than a purely theoretical treatment.

AI Safety Research Agent and Tool Ecosystem misalignment detection chain-of-thought monitoring OpenAI +2 more