Working with US CAISI and UK AISI to build more secure AI systems

We’re proud to continue to push the frontiers of AI capabilities and security. Developing and deploying AI that is secure and useful is core to our mission of ensuring that AGI benefits all of humanity. Key to this is our work with US and UK research and standards bodies who are also dedicated to ensuring the secure deployment of AI for their people.

We were among the first companies to enter into voluntary agreements with both the US Center for AI Standards and Innovation (CAISI) and the UK AI Security Institute (UK AISI). These partnerships reflect our belief that frontier AI development must happen in close collaboration with allied governments that bring deep expertise in machine learning, national security, and metrology.

Today, we’re sharing examples of how these voluntary collaborations have built on our existing security approaches to produce real-world security improvements in practice: joint red-teaming of safeguards against biological misuse, end-to-end testing of products for security issues, and rapid feedback loops to resolve related vulnerabilities. The result is stronger safeguards for widely used AI products, raising the bar for the wider industry, increasing adoption of AI, and showing how governments and industry can work together to evaluate and improve the security of AI systems.

Collaborating to Secure the Deployment of AI Agents

For more than a year, OpenAI has partnered with CAISI to evaluate⁠(opens in a new window) OpenAI models’ capabilities in cyber, chemical-biological, and other national security-relevant domains. We recently expanded our partnership to include emerging product security challenges and partnered with CAISI to red-team the security of OpenAI’s agentic AI systems. In a new kind of collaboration that took place in July, OpenAI worked with CAISI to explore how we can partner with external evaluators to find and fix security vulnerabilities in agentic systems, such as OpenAI’s ChatGPT Agent product.