Welcome Gemma 4: Frontier multimodal intelligence on device

The Gemma 4 family of multimodal models by Google DeepMind is out on Hugging Face, with support for your favorite agents, inference engines, and fine-tuning libraries 🤗

These models are the real deal: truly open with Apache 2 licenses, high quality with pareto frontier arena scores, multimodal including audio, and sizes you can use everywhere including on-device. Gemma 4 builds on advances from previous families and makes them click together. In our tests with pre-release checkpoints we have been impressed by their capabilities, to the extent that we struggled to find good fine-tuning examples because they are so good out of the box.

We collaborated with Google and the community to make them available everywhere: transformers, llama.cpp, MLX, WebGPU, Rust; you name it. This blog post will show you how to build with your favorite tools so let us know what you think!

Table of Contents

• What is New with Gemma 4?
• Overview of Capabilities and Architecture
  • Architecture at a Glance
  • Per-Layer Embeddings (PLE)
  • Shared KV Cache
• Multimodal Capabilities
• Deploy Anywhere
  • transformers
  • Llama.cpp
  • Plug in to your local agent
  • transformers.js
  • MLX
  • Mistral.rs
• Multi-Token Prediction Drafters
• DiffusionGemma: Text Generation via Diffusion
• Fine-tuning & Demos
  • Fine-tuning with TRL
    • Fine-tuning with TRL on Vertex AI
  • Fine-tuning with Unsloth Studio
• Try Gemma 4
• Benchmark Results
• Acknowledgements

What is new with Gemma 4?

Similar to Gemma-3n, Gemma 4 supports image, text, and audio inputs, and generates text responses. The text decoder is based on the Gemma model with support for long context windows. The image encoder is similar to the one from Gemma 3 but with two crucial improvements: variable aspect ratios, and configurable number of image token inputs to find your sweet spot between speed, memory, and quality. All models support images (or video) and text inputs, while the small variants (E2B, E4B) and the 12B Unified model support audio as well.

Inference code Inference code Inference code Inference code Inference code Inference code Inference code