Skip to the tool workspace
Browser 106
no file limit
Hugging Face Runs on your GPU

Run SmolLM2 360M in your browser

The lightest chat model here. Answers instantly on almost any GPU; keep questions simple.

modelSmolLM2-360M-Instruct-q4f16_1-MLC engineWebLLM 0.2.84 networkthe model downloads once
Download194 MB
GPU memory376 MB
Context4k tokens
Parameters360M
Builds4

Use SmolLM2 360M in the browser All models Downloads once · then works offline

Open this page in a browser with JavaScript to check whether SmolLM2 360M fits this device. It needs about 376 MB of GPU memory and a 194 MB download.
Specifications Sourced from the model card
Family
SmolLM
Published by
Hugging Face
Parameters
360M
Quantisation
q4f16_1 · 4-bit
Download
194 MB · 7 files
GPU memory
376 MB
Context window
4k tokens
Reasoning
Licence
Apache 2.0
Good at
Chat
Builds Same weights, different precision
# Build Download GPU memory Context Note
01 q4f16_1 194 MB 376 MB 4k tokens 4-bit weights, f16 · needs f16 shaders Recommended
02 q4f32_1 216 MB 580 MB 4k tokens 4-bit weights, f32
03 q0f16 690 MB 872 MB 4k tokens 16-bit weights, f16 · needs f16 shaders
04 q0f32 1.3 GB 1.7 GB 4k tokens 32-bit weights, f32
How to run it
01 Open the chat The button above opens SmolLM2 360M in the browser AI chat, with the model already selected.
02 Download once 194 MB arrives from Hugging Face and stays in your browser cache. You can start typing while it downloads.
03 Chat privately The model runs on your GPU. Nothing you type is uploaded, and it keeps working offline.
Questions
How big is the SmolLM2 360M download?

194 MB for the q4f16_1 build, in 7 files. It downloads once and stays in your browser cache, so every later visit starts straight away and works offline.

What does my device need to run SmolLM2 360M?

A browser with WebGPU — recent Chrome, Edge, Firefox or Safari — and about 376 MB of GPU memory. The tool checks your GPU, memory and free space and tells you whether SmolLM2 360M fits before anything downloads.

Is anything I type sent to a server?

No. SmolLM2 360M runs on your own GPU inside the browser tab. The only network traffic is the one-time download of the model files from Hugging Face; your prompts and the answers never leave the device, and the chats are stored in this browser.

Which build of SmolLM2 360M should I choose?

Start with q4f16_1 — it is the smallest download and the fastest to run. The f32 builds are larger and use more memory, but they run on GPUs without 16-bit shader support. Builds marked 1k hold a shorter conversation in exchange for less memory.

How long a conversation can SmolLM2 360M hold?

Its context window is 4k tokens. Longer conversations keep working — the oldest turns are dropped with a notice when the conversation no longer fits.

What licence is SmolLM2 360M released under?

The weights are Apache 2.0, taken from the model card of HuggingFaceTB/SmolLM2-360M-Instruct. Check the licence yourself before using it commercially.

Other models Same family, then same size

All 65 models Open the chat

Figures read from the WebLLM 0.2.84 catalog and the model card on 2026-09-03.

/ai/browser-based-ai-chat
1 tool selected
Runs locally·The model downloads once·Your input never leaves
Out0 B
Ready