llama.cpp v1.0.0 : A stronger foundation for the local AI ecosystem

llama.cpp makes it possible to run multi-modal LLMs across a wide range of hardware - from consumer-grade local machines to high-end enterprise servers. Through quantization, optimized backends, and a portable C/C++ implementation, we make AI inference accessible at every level of the software stack. We believe this is the most lightweight, versatile and sensible platform for building cross-platform and private AI products.

During the 3.5 years since its inception, the project has grown a lot and many downstream applications already depend on our work. We expect this trend to continue as local AI and privacy become increasingly important in our everyday lives. Every new integration means more developers depending on our library interfaces and therefore having a flexible but stable API is paramount.

Today we release libraries v1.0.0, highlighting our responsibility to those developers. Moving forward, both llama.cpp and ggml will reflect API and ABI incompatibilities with major-version bumps. As adoption grows, we will be stricter about making those boundaries visible to downstream consumers.

Releases

Release	Library	Public header(s)
llama.cpp v1.0.0 - LLM inference in C/C++	`libllama`	llama.cpp/include/
ggml v1.0.0 - Tensor library for machine learning	`libggml`	ggml/include/

Semantic version update rules

The following rules apply to all ggml-org projects using semantic versioning:

Change type	Bump
MAJOR	Breaking change to the public C API in `./include`
MINOR	Backward-compatible feature, backend updates, model support, or API addition
PATCH	Bug fix with no API change

Distribution

We are looking forward to expanding the ways in which ggml-org software is distributed and reaches developers and end-users. For more information about how to add ggml-org projects to your packaging and release pipelines, please check the following discussion.