Run SmolLM2 135M Instruct in your browser
SmolLM2 135M Instruct is a 135M Hugging Face model. In the browser it downloads 257 MB and needs about 360 MB of GPU memory.
Use SmolLM2 135M Instruct in the browser All models Downloads once · then works offline
- Family
- SmolLM
- Published by
- Hugging Face
- Parameters
- 135M
- Quantisation
- q0f16 · 16-bit
- Download
- 257 MB · 8 files
- GPU memory
- 360 MB
- Context window
- 4k tokens
- Reasoning
- —
- Licence
- Apache 2.0
- Base model
- HuggingFaceTB/SmolLM2-135M-Instruct
- Good at
- Chat
How big is the SmolLM2 135M Instruct download?
257 MB for the q0f16 build, in 8 files. It downloads once and stays in your browser cache, so every later visit starts straight away and works offline.
What does my device need to run SmolLM2 135M Instruct?
A browser with WebGPU (a recent Chrome, Edge, Firefox or Safari) and about 360 MB of GPU memory. Before anything downloads, the tool checks your GPU, memory and free space and tells you whether SmolLM2 135M Instruct fits.
Is anything I type sent to a server?
No. SmolLM2 135M Instruct runs on your own GPU inside the browser tab. The only network traffic is the one-time download of the model files from Hugging Face; your prompts and the answers never leave the device, and the chats are stored in this browser.
Which build of SmolLM2 135M Instruct should I choose?
Start with q0f16. It is the smallest download and the fastest to run. The f32 builds are larger and use more memory, but they run on GPUs without 16-bit shader support. Builds marked 1k hold a shorter conversation in exchange for less memory.
How long a conversation can SmolLM2 135M Instruct hold?
Its context window is 4k tokens. Longer conversations still work: once the conversation no longer fits, the oldest turns are dropped and you see a notice.
What licence is SmolLM2 135M Instruct released under?
The weights are Apache 2.0, taken from the model card of HuggingFaceTB/SmolLM2-135M-Instruct. Check the licence yourself before using it commercially.
Figures read from the WebLLM 0.2.84 catalog and the model card on 2026-09-03.
