Calls for AI slowdown raise new challenges for open-weight models

As AI leaders call for a slower, more deliberate approach to frontier AI development, a different governance question is emerging for open-weight models: Who is responsible for their safety once developers release the weights?

In the Sept. 12 essay that touched off the most recent AI slowdown debate, Anthropic CEO Dario Amodei argued that AI development must slow down so safety work has time to catch up with model capabilities. OpenAI CEO Sam Altman and other AI leaders and researchers have also called for a more measured pace.

So far, the slowdown debate has focused largely on frontier developers and their ability to control how their models are used. Some enterprises, however, are already experimenting and building around open-weight models -- downloading, customizing and running them on their own infrastructure.

Databricks, for example, offers models such as Kimi K3, Qwen and DeepSeek on its platform. The broader ecosystem also includes Meta's Llama and Mistral's models, among many others. The ecosystem extends well beyond those prominent models: Open source platform Hugging Face reported nearly 3 million public models in its repositories in August, spanning models of varying sizes and uses.

While these models give enterprises more control over deployment, the original developers generally lose direct technical control over how the released weights are modified, deployed and used, although licensing terms and legal restrictions can still place limits on their use and redistribution.

The slowdown debate exposes limits of centralized safety

With a closed, or proprietary, AI model, the developer typically manages access to the system. It can impose usage restrictions, monitor activity and change or withdraw access when necessary.

Stricter oversight rules could raise costs for open-weight AI

The largest labs have the resources to handle testing, evaluations and compliance, while smaller developers could struggle to meet stricter requirements.