Welcome Gemma 3: Google's all new multimodal, multilingual, long context open LLM

TL;DR

Today Google releases Gemma 3, a new iteration of their Gemma family of models. The models range from 1B to 27B parameters, have a context window up to 128k tokens, can accept images and text, and support 140+ languages.

Try out Gemma 3 now 👉🏻 Gemma 3 Space

	Gemma 2	Gemma 3
Size Variants	2B 9B 27B	1B 4B 12B 27B
Context Window Length	8k	32k (1B) 128k (4B, 12B, 27B)
Multimodality (Images and Text)	❌	❌ (1B) ✅ (4B, 12B, 27B)
Multilingual Support	–	English (1B) +140 languages (4B, 12B, 27B)

All the models are on the Hub and tightly integrated with the Hugging Face ecosystem.

Both pre-trained and instruction tuned models are released. Gemma-3-4B-IT beats Gemma-2-27B IT, while Gemma-3-27B-IT beats Gemini 1.5-Pro across benchmarks.

Gemma 3 27B is in the pareto sweet spot (Source: Gemma3 Tech Report)

What is Gemma 3?

Gemma 3 is Google's latest iteration of open weight LLMs. It comes in four sizes, 1 billion, 4 billion, 12 billion, and 27 billion parameters with base (pre-trained) and instruction-tuned versions. Gemma 3 goes multimodal! The 4, 12, and 27 billion parameter models can process both images and text, while the 1B variant is text only.

The input context window length has been increased from Gemma 2’s 8k to 32k for the 1B variants, and 128k for all others. As is the case with other VLMs (vision-language models), Gemma 3 generates text in response to the user inputs, which may consist of text and, optionally, images. Example uses include question answering, analyzing image content, summarizing documents, etc.

Pre Trained	Instruction Tuned	Multimodal	Multilingual	Input Context Window
gemma-3-1b-pt	gemma-3-1b-it	❌	English	32K
gemma-3-4b-pt	gemma-3-4b-it	✅	+140 languages	128K
gemma-3-12b-pt	gemma-3-12b-it	✅	+140 languages	128K
gemma-3-27b-pt	gemma-3-27b-it	✅	+140 languages	128K

Technical Enhancements in Gemma 3

The three core enhancements in Gemma 3 over Gemma 2 are:

• Longer context length
• Multimodality
• Multilinguality