DeepMind co-founder launches AGI institute with safety warning

Shane Legg, one of the three co-founders of Google Alphabet Inc. ↗ 0.30% DeepMind, warned on Wednesday that rapidly advancing artificial intelligence must not outpace the safety controls designed to govern it, as he announced the launch of the DeepMind Institute, a new body aimed at exploring the implications of artificial general intelligence.reuters+1

The institute is intended to "elevate" the public debate around AGI by making the company's technical research accessible to a broader audience, Legg said in an interview with the Financial Times. AI companies' concerns about recursive self-improvement have grown as increasingly capable AI agents demonstrate the ability to write software, perform autonomous tasks, and assist in developing other AI systems.ft+1

A Founder Returns to His Mission

Legg, who holds the title of chief AGI scientist at Google DeepMind, has long been among the most safety-focused voices inside the lab. He co-founded DeepMind in London alongside Demis Hassabis and Mustafa Suleyman with the explicit goal of achieving AGI. In January, Legg said he saw a 50 percent chance of reaching what he called "minimal AGI" — where AI handles standard human cognitive tasks — by 2028.observer

The launch of the DeepMind Institute comes at a turbulent moment for the organization. In August, Alphabet CEO Sundar Pichai announced a sweeping leadership restructuring: Hassabis stepped back from day-to-day operations to become chair of Google DeepMind and Alphabet's chief scientist, while longtime CTO Koray Kavukcuoglu was promoted to senior vice president running the unit. Jeff Dean, Google's chief scientist for 27 years, departed to co-found a new AI-focused public benefit corporation.studioglobal+1

Broader Expansion and Genomics Push

Google DeepMind has also been expanding its research footprint beyond core AI development. Earlier this year, the lab partnered with the Wellcome Sanger Institute and Google.org to launch an AI genomics consortium, with Google DeepMind and Google.org committing $5 million per year over five years to build high-quality, AI-ready genomic datasets.sanger+1

The three original DeepMind founders now occupy strikingly different positions in the AI landscape: Hassabis straddles frontier research and drug discovery through Isomorphic Labs; Suleyman leads Microsoft ↘ 0.66% AI and its consumer products; and Legg remains focused on the safety questions that animated the lab's founding more than a decade ago.observer