Run Gemma 2 9B in your browser
Google’s 9B instruct model. Needs 6.5 GB of GPU memory and f16 shaders.
Use Gemma 2 9B in the browser All models Downloads once · then works offline
- Family
- Gemma
- Published by
- Parameters
- 9B
- Quantisation
- q4f16_1 · 4-bit
- Download
- 4.8 GB · 128 files
- GPU memory
- 6.3 GB
- Context window
- 4k tokens
- Reasoning
- —
- Licence
- Gemma Terms of Use
- Base model
- google/gemma-2-9b-it
- Weights
- mlc-ai/gemma-2-9b-it-q4f16_1-MLC
- Good at
- Chat · Multilingual
How big is the Gemma 2 9B download?
4.8 GB for the q4f16_1 build, in 128 files. It downloads once and stays in your browser cache, so every later visit starts straight away and works offline.
What does my device need to run Gemma 2 9B?
A browser with WebGPU (a recent Chrome, Edge, Firefox or Safari) and about 6.3 GB of GPU memory. Before anything downloads, the tool checks your GPU, memory and free space and tells you whether Gemma 2 9B fits.
Is anything I type sent to a server?
No. Gemma 2 9B runs on your own GPU inside the browser tab. The only network traffic is the one-time download of the model files from Hugging Face; your prompts and the answers never leave the device, and the chats are stored in this browser.
Which build of Gemma 2 9B should I choose?
Start with q4f16_1. It is the smallest download and the fastest to run. The f32 builds are larger and use more memory, but they run on GPUs without 16-bit shader support. Builds marked 1k hold a shorter conversation in exchange for less memory.
How long a conversation can Gemma 2 9B hold?
Its context window is 4k tokens. Longer conversations still work: once the conversation no longer fits, the oldest turns are dropped and you see a notice.
What licence is Gemma 2 9B released under?
The weights are Gemma Terms of Use, taken from the model card of google/gemma-2-9b-it. Check the licence yourself before using it commercially.
Figures read from the WebLLM 0.2.84 catalog and the model card on 2026-09-03.
