Google DeepMind boss Demis Hassabis issues call to action on AI safety standards

Google DeepMind CEO Demis Hassabis says only the United States is up to the task of keeping AI safe – but it’s unclear why technology rivals, notably China, would heed an American standards body.

Hassabis has called for a framework for testing frontier models, on the grounds that he believes progress has been faster than expected and artificial general intelligence (AGI) will arrive imminently.

He argues that such work should be led by the US because of its technical and economic standing.

“This US-initiated effort would provide a strong starting point for creating shared international standards on Frontier AI,” Hassabis noted in a social media post.

How would it work

Beyond being US-managed, Hassabis described a standards body that was federally overseen, such as a public-private partnership or self-regulatory organization, pointing to the Financial Industry Regulatory Authority (FINRA).

“The Standards Body would be responsible for developing assessment protocols and working with appropriate federal agencies and the US National Labs to conduct testing in areas relevant to national security,” he said.

Anyone making a “frontier model” – as defined by a set of benchmarks – would be considered a “frontier lab”, and be “encouraged” to adopt certain best practices.

This would include publishing technical details, ensuring internal security is up to standard, vetting key personnel, and adequate resourcing safety research.

Non-frontier models, such as those made by startups or academia, would not be expected to take part.

Hassabis also called for frontier labs to share new modes with the standards body 30 days before release, something the US government has pushed key developers to do with their AI models.

“Once the assessment protocol is shown to be effective and robust, formalisation could quickly follow, meaning that Frontier Models would be required to pass it to be deployed in the US market,” Hassabis said. “Labs would also work with the Standards Body to address any critical post-release vulnerabilities.”

Assessments conducted by the standards body would evaluate security, biological, and other threats, and check how well they withstood attempts to dodge guardrails. The tests would be regularly updated.

“The strength of this approach is it would be technically focused, while at the same time supporting innovation and incentivising responsible behaviour,” he said.