zenodo-06f2023e·1 events·first seen Aliases: Zenodo
MedFailBench is a new open-source benchmark designed to identify which safety boundary a medical AI system failed, rather than measuring correctness. The v0.2.1 release contains 44 clinician-reviewed synthetic cases annotated by severity (1–5) and six safety gate types including missed urgent escalation, unsafe dosing, and evidence fabrication. The benchmark includes a HuggingFace leaderboard preview, a safety gate taxonomy, and an automated pipeline for archiving model-response screening runs, released under Apache-2.0 and CC-BY-4.0.