Google DeepMind launches $10M funding call for multi-agent AI safety research
Google DeepMind and unnamed partners have announced a $10M funding call targeting safety research for multi-agent AI systems. The initiative signals institutional recognition that multi-agent architectures present distinct safety challenges requiring dedicated research investment. This is a notable funding commitment from a tier-1 lab directed specifically at an underexplored safety domain.
Related guides (3)
Related events (8)
Google DeepMind funds research into risks of large-scale multi-agent interaction
Google DeepMind is funding research into the safety risks that emerge when millions of AI agents interact with each other online without human oversight. Rohin Shah, who directs AGI safety and alignment research at DeepMind, is cited as the source. The concern centers on emergent behaviors and coordination dynamics that could arise at mass-market agent deployment scale.
Google DeepMind Deepens Partnership with UK AI Security Institute
Google DeepMind and the UK AI Security Institute (AISI) are strengthening their collaboration on AI safety and security research. The announcement signals an expanded formal relationship between a leading frontier lab and a government-backed AI safety body. Specific research areas and deliverables were not detailed in the available text, but the partnership focuses on critical safety and security topics.
OpenAI Superalignment Fast Grants: $10M for Superhuman AI Safety Research
OpenAI is launching $10M in fast grants to fund external technical research on aligning and ensuring the safety of superhuman AI systems. Priority research areas include weak-to-strong generalization, interpretability, and scalable oversight. The program is part of OpenAI's broader Superalignment initiative, which aims to solve the alignment problem for superintelligent systems within four years.
Protecting People from Harmful Manipulation
Google DeepMind has published research examining AI's potential for harmful manipulation across domains including finance and health. The work identifies manipulation risks and proposes new safety measures to address them. This represents a proactive safety research effort from a Tier 1 lab focused on misuse and adversarial deployment scenarios.
Announcing the OpenAI Safety Fellowship
OpenAI has announced a Safety Fellowship, described as a pilot program aimed at supporting independent safety and alignment research while developing the next generation of AI safety talent. The announcement is sparse on details but signals a structured investment in external safety research capacity. This follows broader industry trends of labs funding independent safety work to build the research ecosystem.
Strengthening our Frontier Safety Framework
Google DeepMind has announced updates to its Frontier Safety Framework (FSF), aimed at better identifying and mitigating severe risks from advanced AI models. The announcement comes from a Tier 1 lab and signals continued evolution of internal safety governance structures. The body is brief and lacks technical specifics, but the update to a named safety framework from a major lab is substantively trackable.
Frontier Model Forum Announces Executive Director and $10M AI Safety Fund
OpenAI, Anthropic, Google, and Microsoft jointly announced the appointment of a new Executive Director for the Frontier Model Forum and the establishment of a $10 million AI Safety Fund. The Frontier Model Forum is an industry body formed by leading AI labs to advance AI safety research and best practices. This represents a concrete financial commitment from major frontier AI developers toward safety research infrastructure.
Advancing independent research on AI alignment
OpenAI is committing $7.5 million to The Alignment Project to fund independent AI alignment research. The grant is framed as part of broader efforts to address AGI safety and security risks. This represents a notable external funding move by OpenAI to support alignment work outside its own walls.