Run OLMo 2 1124 7B Instruct in your browser
OLMo 2 1124 7B Instruct is a 7B Ai2 model. In the browser it downloads 3.8 GB and needs about 6.3 GB of GPU memory.
Use OLMo 2 1124 7B Instruct in the browser All models Downloads once · then works offline
- Family
- OLMo
- Published by
- Ai2
- Parameters
- 7B
- Quantisation
- q4f16_1 · 4-bit
- Download
- 3.8 GB · 117 files
- GPU memory
- 6.3 GB
- Context window
- 4k tokens
- Reasoning
- —
- Licence
- Apache 2.0
- Base model
- allenai/OLMo-2-1124-7B-Instruct
- Good at
- Chat
How big is the OLMo 2 1124 7B Instruct download?
3.8 GB for the q4f16_1 build, in 117 files. It downloads once and stays in your browser cache, so every later visit starts straight away and works offline.
What does my device need to run OLMo 2 1124 7B Instruct?
A browser with WebGPU — recent Chrome, Edge, Firefox or Safari — and about 6.3 GB of GPU memory. The tool checks your GPU, memory and free space and tells you whether OLMo 2 1124 7B Instruct fits before anything downloads.
Is anything I type sent to a server?
No. OLMo 2 1124 7B Instruct runs on your own GPU inside the browser tab. The only network traffic is the one-time download of the model files from Hugging Face; your prompts and the answers never leave the device, and the chats are stored in this browser.
Which build of OLMo 2 1124 7B Instruct should I choose?
Start with q4f16_1 — it is the smallest download and the fastest to run. The f32 builds are larger and use more memory, but they run on GPUs without 16-bit shader support. Builds marked 1k hold a shorter conversation in exchange for less memory.
How long a conversation can OLMo 2 1124 7B Instruct hold?
Its context window is 4k tokens. Longer conversations keep working — the oldest turns are dropped with a notice when the conversation no longer fits.
What licence is OLMo 2 1124 7B Instruct released under?
The weights are Apache 2.0, taken from the model card of allenai/OLMo-2-1124-7B-Instruct. Check the licence yourself before using it commercially.
Figures read from the WebLLM 0.2.84 catalog and the model card on 2026-09-03.
