AISPA

AISPA framework audits system prompts across 88 commercial AI products, finds widespread problematic instructions

Researchers introduce AISPA (Artificial Intelligence System Prompt Assurance), a framework for auditing system prompts in commercial AI applications across eight user-centric dimensions. An audit of 3,249 instructions from 88 commercial products finds that while 98.9% contain at least one protective instruction, roughly 40% also contain at least one instruction that works against user interests. System prompt design varies dramatically across organizations, and only 24% of products cover all eight AISPA dimensions. The findings argue for greater transparency, standardization, and independent oversight of system prompts.