Seven major firms sign up to US government’s AI safety deal

The agreement, which also included Google, Amazon, Anthropic and Inflection, will commit the companies to internal and external security testing of their AI systems before release, with part of the testing to be conducted by independent experts.

The seven companies have also committed to sharing information across the industry and with governments, civil society and academia on managing AI risks, including best practices for safety, information on attempts to circumvent safeguards and technical collaboration.

The agreement means that companies will commit to investing in cybersecurity and safeguards, as well as facilitating third-party discovery and reporting of vulnerabilities in their AI systems.

Earning the public’s trust is also prominent in the agreement brokered between the government and the seven AI firms, with a promise to develop robust technical mechanisms to make sure users know when content is AI generated, such as a watermarking system.

Public reporting of AI system capabilities, limitations and areas of appropriate and inappropriate use will also be introduced, as well as prioritisation of research on the societal risks posed by AI.

The seven companies have also committed to developing and deploying advanced AI systems to help address society’s greatest challenges.

A statement from the White House added: “Companies that are developing these emerging technologies have a responsibility to ensure their products are safe.

“To make the most of AI’s potential, the Biden-Harris administration is encouraging this industry to uphold the highest standards to ensure that innovation doesn’t come at the expense of Americans’ rights and safety.

“These commitments, which the companies have chosen to undertake immediately, underscore three principles that must be fundamental to the future of AI – safety, security, and trust – and mark a critical step toward developing responsible AI.

“As the pace of innovation continues to accelerate, the Biden-Harris administration will continue to remind these companies of their responsibilities and take decisive action to keep Americans safe.”