7Latent Space (swyx)·
OpenAI, Anthropic, GDM, Meta, and others co-sign letter calling to pace AI development amid RSI fears; HuggingFace details machine-speed cyberattack
A coalition of major AI labs including OpenAI, Anthropic, Google DeepMind, and Meta have co-signed a letter calling for a measured pace in AI development, apparently motivated by concerns about recursive self-improvement (RSI). Separately, HuggingFace has published details on a machine-speed offensive cyberattack. The convergence of frontier labs on a shared safety/pacing position would represent a significant industry-wide signal if confirmed.
Related guides (4)
Related events (8)
Frontier Lab Employees Publish Open Letter Calling for Ability to Pace AI Development
An open letter from frontier AI lab employees, described by commentator Zvi Mowshowitz as the most important open letter in years, calls for the ability to slow or pace AI development at the frontier. The letter appears to represent internal dissent or advocacy from employees at major AI labs regarding development speed. Zvi's commentary frames this as a significant safety and governance signal worth tracking closely.
Dario Amodei calls for stronger AI safety focus at Paris AI Action Summit
Anthropic CEO Dario Amodei issued a statement following the Paris AI Action Summit, expressing concern that the event underweighted critical issues including democratic leadership in AI, CBRN and autonomous-risk governance, and labor market disruption. Amodei forecasts that by 2026-2027 AI capabilities may be equivalent to 'a country of geniuses in a datacenter,' framing this as both an opportunity and an urgent governance challenge. He called for governments to enforce transparency of frontier lab safety plans, fund third-party evaluations, and monitor economic impacts—pointing to Anthropic's newly released Economic Index as a model. The statement also reaffirmed Anthropic's Responsible Scaling Policy as the first of its kind among frontier labs.
Anthropic Responds to White House AI Action Plan, Calls for Transparency Standards and Export Controls
Anthropic published a policy response to the White House's 'Winning the Race: America's AI Action Plan,' endorsing its focus on AI infrastructure, federal adoption, and safety research while urging additional steps on export controls and mandatory AI development transparency standards. The company highlighted alignment between the plan and its prior OSTP submissions, and noted its proactive activation of ASL-3 protections with Claude Opus 4 as evidence that safety and innovation are compatible. Anthropic called for a single national standard for frontier model transparency rather than a state-by-state patchwork, and encouraged continued investment in NIST's CAISI for evaluating frontier models on national security risks including CBRN capabilities.
Moving AI Governance Forward: OpenAI and Leading Labs Make Voluntary Safety Commitments
OpenAI and other leading AI laboratories announced voluntary commitments aimed at reinforcing AI safety, security, and trustworthiness. The commitments represent a coordinated industry response to governance concerns ahead of anticipated regulatory action. This move signals alignment among frontier labs on baseline safety standards, though the voluntary nature leaves enforcement questions open.
Anthropic Endorses California SB 53 AI Safety Disclosure Bill
Anthropic has announced its endorsement of California Senate Bill 53, which would require large frontier AI developers to publish safety frameworks, release transparency reports before deploying powerful models, report critical safety incidents within 15 days, and provide whistleblower protections. The bill, authored by Senator Scott Wiener and informed by the Joint California Policy Working Group, takes a disclosure-based approach rather than prescriptive technical mandates, drawing lessons from the failed SB 1047. Anthropic frames the bill as formalizing practices already followed by major labs including Google DeepMind, OpenAI, and Microsoft, while creating a level playing field that prevents competitive pressure from eroding voluntary safety programs. Anthropic notes the bill's compute-based threshold (10^26 FLOPS) is an acceptable starting point but calls for future refinement as AI capabilities advance.
Anthropic publishes Responsible Scaling Policy with AI Safety Level framework
Anthropic released its Responsible Scaling Policy (RSP), a formal framework of technical and organizational protocols for managing catastrophic risks from increasingly capable AI systems. The policy introduces AI Safety Levels (ASL-1 through ASL-5+), modeled on US biosafety level standards, requiring progressively stricter safety, security, and operational standards as models become more capable. Current Claude models are classified as ASL-2; ASL-3 triggers stricter deployment constraints including adversarial red-teaming requirements. The policy has been approved by Anthropic's board and is intended as a template for industry-wide adoption.
OpenAI and Anthropic jointly oppose open-weight AI models, citing national security and competitive concerns
OpenAI and Anthropic have reportedly aligned in opposition to open-weight AI models, framing the issue around risks to national security and, critics argue, their own competitive position. The story, published by Axios and surfacing on Hacker News with high engagement (240 points, 276 comments), touches on the Trump administration's China policy context. The move signals a potential lobbying or regulatory push by the two leading closed-model labs against open-weights competitors like Meta and DeepSeek.
Dario Amodei's AI Safety Summit remarks detail Anthropic's Responsible Scaling Policy and ASL framework
Dario Amodei delivered prepared remarks at the UK AI Safety Summit (November 2023) explaining Anthropic's Responsible Scaling Policy (RSP), which was the first such policy published by a major AI lab. The RSP introduces AI Safety Levels (ASL-1 through ASL-4), modeled on biosafety level frameworks, with capability thresholds triggering mandatory safeguards before further training or deployment. Key implementation lessons include deep executive involvement, integrating RSP requirements into product roadmaps, and formal accountability through Anthropic's board and Long Term Benefit Trust. The remarks outline specific ASL-3 requirements around CBRN misuse prevention and security, and preview ASL-4 criteria involving near-human autonomy or becoming a primary source of global security threats.