Almanac
Topic guide · In-depth

AI Regulatory Developments: From Voluntary Frameworks to Government Enforcement

Regulatory DevelopmentsIn-depthactive·v1 · live·generated 6d ago
TL;DRThe regulatory landscape for frontier AI has shifted from voluntary industry self-governance toward active government intervention — pre-deployment testing mandates, export controls, and military procurement battles. The central tension is no longer whether AI should be regulated, but who sets the rules, on what timeline, and whether safety restrictions are a feature or a liability when national security interests collide with commercial ones.

Key takeaways

  • The U.S. Department of War invoked 10 USC 3252 — a supply-chain risk designation previously reserved for foreign companies — against Anthropic after it refused to remove safeguards on autonomous weapons and mass domestic surveillance.
  • NIST's TRAINS task force (launched May 2026) marks the first structured U.S. pre-deployment evaluation regime for frontier models, with Google, Microsoft, xAI, Anthropic, and OpenAI voluntarily submitting models; a mandatory executive order was under consideration.
  • A Trump executive order signed June 2026 requires AI testing prior to frontier model releases, following an earlier White House halt on Anthropic's Mythos access expansion.
  • The EU AI Act's high-risk compliance deadline was delayed from August 2026 to December 2027 after industry lobbying, while a new ban on AI-generated CSAM was added.
  • California's SB 53 — the first mandatory frontier AI safety and transparency law in the U.S. — took effect January 1, 2026, prompting Anthropic to publish a Frontier Compliance Framework.
  • China's NDRC blocked Meta's $2.5B acquisition of Singapore-based Manus, asserting jurisdiction over AI technology developed by Chinese engineers regardless of corporate domicile.

What this area covers

AI regulatory developments encompass the full spectrum of government action affecting how frontier AI models are built, tested, deployed, and restricted: executive orders, export controls, military procurement decisions, state legislation, international treaty-equivalent frameworks, and voluntary industry governance that anticipates or shapes formal rules. The period covered by this bundle — roughly January 2025 through June 2026 — represents a decisive inflection from a largely permissive, self-regulatory era toward active, sometimes coercive government intervention.

Why it matters

Regulatory decisions determine which models can be deployed where, who can access them, and under what conditions. They set the floor for safety practices across the industry, create competitive asymmetries between labs willing and unwilling to accept government terms, and increasingly intersect with geopolitics — particularly the U.S.-China technology competition. For practitioners, the regulatory environment is no longer background noise; it is a direct constraint on product roadmaps, API access, and enterprise procurement.

How it evolved: three overlapping phases

Phase 1 — Voluntary self-governance (through mid-2025)

The dominant mode was labs publishing their own frameworks. Anthropic's Responsible Scaling Policy, first released in early 2025, introduced the AI Safety Level (ASL) ladder — modeled on U.S. biosafety standards — requiring progressively stricter controls as models approach capability thresholds for catastrophic harm. ASL-3 was activated for the first time in May 2025 with the Claude Opus 4 launch, on a precautionary basis: Anthropic could not rule out that Opus 4 crossed the CBRN-risk threshold, so it deployed Constitutional Classifiers to block end-to-end weapons-development workflows. OpenAI's parallel move was structural: converting to a Public Benefit Corporation in May 2025 to formalize its mission-driven mandate. Both moves were voluntary, but both were explicitly designed to anticipate regulatory requirements.

Phase 2 — State and international mandates crystallize (late 2025 – early 2026)

California's SB 53 — the first mandatory U.S. frontier AI safety law — took effect January 1, 2026. Anthropic responded with a Frontier Compliance Framework (FCF) mapping its existing RSP practices to SB 53's requirements for risk assessment, tiered capability evaluation, model-weight protection, and incident response. The FCF explicitly calls for a federal analog, signaling the lab's preference for a single national standard over a patchwork of state laws — a preference shared by the Trump Administration, which was simultaneously drafting a federal preemption proposal.

In Europe, the EU AI Act's high-risk compliance deadline was delayed from August 2026 to December 2027 after sustained industry lobbying and two influential competitiveness reports. The amendment simplified compliance burdens for smaller companies and adjusted personal data rules, but strengthened one area: a new ban on AI-generated sexually explicit images of children and non-consensual nude images. OpenAI's Frontier Governance Framework, published May 2026, was explicitly positioned to align with both EU and California requirements.

Phase 3 — Federal intervention and enforcement (2026)

The most consequential developments involve direct government coercion rather than rulemaking. Three threads converged:

The DoW standoff. In February 2026, the U.S. Department of War demanded Anthropic accept "any lawful use" of Claude and remove safeguards on two categories: mass domestic surveillance and fully autonomous weapons. Anthropic refused. The standoff escalated through a Trump Truth Social post threatening civil and criminal consequences, to Secretary Hegseth's formal supply-chain risk designation under 10 USC 3252 — a statute previously applied only to foreign companies. OpenAI, by contrast, signed a DoW contract allowing use "for all lawful purposes" with ambiguous carve-outs that CEO Sam Altman later described as rushed and subsequently renegotiated. The episode established a stark precedent: a U.S. AI lab's own usage policies can trigger a national-security designation, and the government is willing to use procurement leverage to override them.

Pre-deployment testing. The White House first halted Anthropic's expansion of Mythos access in May 2026, then supported the NIST TRAINS task force — a multi-agency body for evaluating frontier models against cybersecurity, biosecurity, and chemical weapons risks before public deployment. Google, Microsoft, xAI, Anthropic, and OpenAI voluntarily agreed to submit models, including versions with limited guardrails. A Trump executive order signed June 3, 2026 made pre-release testing mandatory for frontier model releases. This represents a sharp reversal from the administration's earlier deregulatory posture, driven in part by Anthropic's own disclosure that Claude Mythos Preview could autonomously exploit software vulnerabilities.

Export controls. On June 13, 2026, the U.S. government issued an export control directive requiring Anthropic to immediately disable Fable 5 and Mythos 5 for all foreign nationals, citing awareness of a jailbreak method. Anthropic complied while publicly disputing the standard applied — arguing that requiring perfect jailbreak resistance would halt all frontier model deployments industry-wide, since the demonstrated technique produces results already achievable by other publicly available models.

The geopolitical dimension

Regulatory developments cannot be understood without the U.S.-China technology competition as backdrop. Anthropic publicly identified three Chinese AI labs — DeepSeek, Moonshot AI, and MiniMax — as conducting coordinated, large-scale distillation attacks: over 16 million exchanges harvested through approximately 24,000 fraudulent accounts, targeting Claude's most differentiated capabilities. The White House acknowledged the distillation threat in an April 2026 memo, framing it as an adversarial national security concern. A separate gray-market API proxy ecosystem gives Chinese developers discounted access to U.S. models through methods ranging from terms-of-service violations to credit card fraud, with harvested API logs feeding back into training pipelines.

China's own regulatory posture is assertive in a different direction: the NDRC blocked Meta's $2.5 billion acquisition of Singapore-based Manus, asserting jurisdiction over AI technology developed by Chinese engineers regardless of corporate domicile. The ruling effectively ended the "Singapore strategy" used by Chinese AI startups to attract Western capital.

OpenAI separately documented PRC-linked influence operations using AI to target U.S. technology policy debates — including narratives around data centers, tariffs, and false claims about ChatGPT — adding an information-operations dimension to the regulatory picture.

Voluntary governance: what worked, what didn't

Anthropic's RSP v3.0, published February 2026, offers a candid self-assessment. The framework acknowledges that ASL-3 safeguards were successfully activated, that OpenAI and Google DeepMind adopted analogous frameworks, and that the RSP informed early AI policy. But it also acknowledges that multilateral coordination and government action at higher capability thresholds have not materialized as hoped. The new version refines the ASL framework and introduces measures for decision-making transparency — an implicit acknowledgment that voluntary commitments require external accountability mechanisms to be credible.

Emerging compliance surface areas

Beyond the headline confrontations, the bundle surfaces several emerging regulatory pressure points:

  • Agentic AI safety: The "Boiling the Frog" benchmark found a 44.4% aggregate attack success rate across nine models in multi-turn agentic scenarios, grounded in the EU AI Act's GPAI Code of Practice taxonomy. Agentic deployments are becoming a distinct regulatory category.
  • Algorithmic hiring: A study of 3 million applicants found significant racial disparities in algorithmic screening — 25.87% of Black applicants submitted to positions where the algorithm adversely impacted their group under U.S. employment discrimination standards — pointing toward enforcement risk for enterprise AI deployments.
  • Copyright via fine-tuning: Research showed fine-tuning on verbatim-generation tasks can bypass alignment-trained copyright guardrails, enabling up to 91.9% verbatim book reproduction. This has direct implications for fine-tuning API providers and downstream deployers.
  • Financial AI bias: A "know-your-agent" (KYA) audit framework was proposed for autonomous financial agents, identifying internal model features that shift portfolio allocations even when asset names don't appear in prompts.

Where it's heading

The regulatory trajectory points toward a pre-deployment approval regime for the highest-capability models — an FDA-style gate that the White House was actively designing as of mid-2026. The TRAINS task force is the operational prototype. The open questions are whether the standard will be codified in statute, how capability thresholds will be defined, and whether the jailbreak-resistance bar applied to Anthropic's Fable 5 and Mythos 5 will become the operative test — a standard that, as Anthropic argued, no current frontier model could meet. The tension between government access demands and lab safety restrictions is not resolved; it has merely moved from negotiation to litigation and executive action.

U.S. AI regulatory escalation ladder (2025–2026)

Regulatory actors and their instruments

Key regulatory instruments and their status

InstrumentJurisdictionScopeStatus
NIST TRAINS task forceU.S. FederalPre-deployment national-security eval for frontier modelsActive (voluntary; mandatory EO under consideration)
Trump EO on AI testingU.S. FederalMandatory testing prior to frontier model releasesSigned Jun 2026
California SB 53U.S. State (CA)Mandatory safety/transparency for frontier AI developersIn effect Jan 1, 2026
EU AI Act (high-risk provisions)European UnionCompliance requirements for high-risk AI systemsDeadline delayed to Dec 2027
DoW supply-chain risk designation (10 USC 3252)U.S. FederalBars designated companies from DoW contractsApplied to Anthropic Mar 2026; challenged in court
Anthropic RSP / FCFVoluntary (U.S.)Internal ASL framework + CA SB 53 compliance layerRSP v3.0 published Feb 2026; FCF Dec 2025
OpenAI Frontier Governance FrameworkVoluntary (U.S.)Safety/risk practices aligned to EU and CA requirementsPublished May 2026

All entries traceable to events in the bundle; unknown cells render —.

Timeline

  1. Anthropic publishes Responsible Scaling Policy with ASL-1–5 framework

  2. OpenAI transitions to Public Benefit Corporation structure

  3. Anthropic activates ASL-3 protections for Claude Opus 4 — first ASL-3 deployment

  4. Anthropic discloses first AI-orchestrated cyber espionage campaign using Claude Code

  5. Anthropic publishes Frontier Compliance Framework for California SB 53

  6. Dario Amodei discloses DoW demands to remove autonomous-weapons and surveillance safeguards

  7. DoW formally designates Anthropic a supply-chain risk; OpenAI signs DoW contract

  8. NIST TRAINS task force announced for pre-deployment national-security evaluation

  9. EU AI Act high-risk deadline delayed to December 2027

  10. Trump signs EO requiring AI testing prior to frontier model releases

  11. U.S. government orders Anthropic to suspend Fable 5 and Mythos 5 access via export control directive

Related topics

FAQ

What is the NIST TRAINS task force and why does it matter?

TRAINS (Testing Risks of AI for National Security) is a multi-agency U.S. task force announced in May 2026 to evaluate frontier models for cybersecurity, biosecurity, and chemical weapons risks before public deployment. It marks the first structured federal pre-deployment evaluation regime, with major labs voluntarily submitting models; a mandatory executive order was under active consideration.

Why was Anthropic designated a supply-chain risk by the U.S. Department of War?

The Department of War invoked 10 USC 3252 after Anthropic refused to remove two usage restrictions from Claude: fully autonomous weapons and mass domestic surveillance of Americans. The designation — previously applied only to foreign companies — bars Anthropic from direct DoW contract work; Anthropic is challenging it in court.

How does California SB 53 differ from the EU AI Act?

SB 53, in effect since January 1, 2026, is the first mandatory U.S. frontier AI safety and transparency law, targeting the largest frontier developers with risk assessment and incident response requirements. The EU AI Act is broader in scope (covering high-risk AI systems across sectors) but its high-risk compliance deadline was pushed to December 2027 after industry lobbying.

What is the difference between Anthropic's RSP and its Frontier Compliance Framework?

The Responsible Scaling Policy (RSP) is a voluntary internal framework using AI Safety Levels (ASL-1 through ASL-5+) to gate deployment as models grow more capable. The Frontier Compliance Framework (FCF) is a separate document mapping Anthropic's practices to California SB 53's mandatory requirements; the RSP continues as a voluntary layer beyond regulatory minimums.

What triggered the shift toward pre-deployment government testing in the U.S.?

Multiple converging events: Anthropic's disclosure that Claude Mythos Preview could autonomously exploit software vulnerabilities, the documented AI-orchestrated espionage campaign using Claude Code in late 2025, and Anthropic's identification of industrial-scale distillation attacks by Chinese labs. These prompted the White House to first halt Mythos access expansion, then support TRAINS, and ultimately sign an executive order requiring pre-release testing.

How is China shaping the regulatory landscape from the outside?

China's NDRC blocked Meta's $2.5B acquisition of Singapore-based Manus, asserting jurisdiction over AI technology developed by Chinese engineers regardless of corporate domicile — effectively ending the 'Singapore strategy' for Chinese AI startups seeking Western capital. Separately, Chinese labs were accused of industrial-scale distillation attacks against U.S. models, which the White House framed as a national security concern in an April 2026 memo.

Stay current

Call Me Almanac pairs the week's AI news with guides like this one — Midweek & Sunday.

Versions

  • v1live6d ago

Related guides (4)

More on Regulatory Developments (6)

7The Batch·1mo ago·source ↗

U.S. Government to Pre-Release Test AI Models for National Security Risks via NIST TRAINS Task Force

NIST announced a new multi-agency task force called TRAINS (Testing Risks of AI for National Security), overseen by its Center for AI Standards and Innovation, to evaluate frontier AI models for cybersecurity, biosecurity, and chemical weapons risks before public deployment. Google, Microsoft, xAI, Anthropic, and OpenAI have voluntarily agreed to submit models with limited guardrails for evaluation. The policy shift follows Anthropic's announcement that Claude Mythos Preview can autonomously exploit software vulnerabilities, and marks a sharp reversal from the Trump Administration's earlier deregulatory stance. The White House is also considering an executive order that would make pre-release government testing mandatory.

7The Batch·22d ago·source ↗

European Union Regulators Delay Some AI Act Provisions, Delete Others

The European Parliament and member states agreed to amend the EU AI Act, delaying high-risk AI system compliance deadlines from August 2026 to December 2027 and extending other deadlines for watermarking, sandbox environments, and AI-driven products. The amendments also simplify compliance burdens for smaller companies, adjust personal data usage rules, and carve out exemptions for industrial machinery already covered by product-safety law. One area was strengthened: a new ban on AI-generated sexually explicit images of children and non-consensual nude images. The changes await formal adoption and follow sustained lobbying from European industry and two influential competitiveness reports.

9Anthropic News·7d ago·source ↗

US government orders Anthropic to suspend access to Fable 5 and Mythos 5 citing national security jailbreak concerns

The US government issued an export control directive requiring Anthropic to immediately disable Fable 5 and Mythos 5 for all foreign nationals, effectively forcing a full customer suspension to ensure compliance. The government cited awareness of a jailbreak method, but Anthropic disputes the severity, stating the demonstrated technique is a narrow, non-universal jailbreak that produces results already achievable by other publicly available models including GPT-5.5. Anthropic is complying with the directive while publicly disagreeing with the standard applied, arguing that requiring perfect jailbreak resistance would halt all frontier model deployments industry-wide. This is a significant regulatory and safety governance flashpoint involving government authority over commercial AI model access.

9Anthropic News·19d ago·source ↗

Anthropic Responds to Department of War Supply Chain Risk Designation

Anthropic CEO Dario Amodei issued a public statement after the U.S. Department of War formally designated Anthropic as a supply chain risk to national security, confirming the company will challenge the designation in court. Amodei clarified that the designation under 10 USC 3252 has narrow scope, affecting only direct use of Claude within Department of War contracts rather than all customers with such contracts. Anthropic committed to continuing to provide models to the Department of War and national security community at nominal cost during any transition period, while reiterating its two narrow usage exceptions: fully autonomous weapons and mass domestic surveillance. Amodei also apologized for a leaked internal post written on a difficult day, characterizing it as out-of-date and not reflecting his considered views.

7Anthropic News·19d ago·source ↗

Anthropic Publishes Frontier Compliance Framework for California's SB 53 Transparency in Frontier AI Act

Anthropic has released its Frontier Compliance Framework (FCF) in advance of California's SB 53 taking effect on January 1, 2026, which establishes the first mandatory frontier AI safety and transparency requirements in the US. The FCF covers risk assessment and mitigation for cyber, CBRN, and AI autonomy/control risks, tiered capability evaluation, model weight protection, and incident response. Anthropic frames the FCF as an evolution of its existing Responsible Scaling Policy, which will continue as a voluntary safety policy beyond regulatory minimums. The company also calls for a federal AI transparency framework with analogous requirements applied only to the largest frontier developers.

7The Batch·1mo ago·source ↗

China's Regulators Block Meta's Acquisition of Manus, an Agentic Startup Headquartered in Singapore

China's National Development and Reform Commission (NDRC) blocked Meta's proposed $2.5 billion acquisition of Manus, a Singapore-based AI agent startup originally founded in China by Butterfly Effect. The NDRC cited concerns over data transfers and foreign ownership of technology developed by Chinese engineers, asserting jurisdiction despite Manus having relocated to Singapore. The ruling has effectively killed the 'Singapore strategy' used by Chinese AI startups to attract Western capital, causing founders and investors to cancel plans to move abroad or pursue foreign partnerships. The episode marks a significant escalation in China's assertion of control over strategically important AI technology regardless of corporate domicile.