Skip to the tool workspace
Browser 106
no file limit
Meta Runs on your GPU

Run Llama 2 7B Chat in your browser

Llama 2 7B Chat is a 7B Meta model. In the browser it downloads 3.5 GB and needs about 6.6 GB of GPU memory.

modelLlama-2-7b-chat-hf-q4f16_1-MLC engineWebLLM 0.2.84 networkthe model downloads once
Download3.5 GB
GPU memory6.6 GB
Context4k tokens
Parameters7B
Builds4

Use Llama 2 7B Chat in the browser All models Downloads once · then works offline

Open this page in a browser with JavaScript to check whether Llama 2 7B Chat fits this device. It needs about 6.6 GB of GPU memory and a 3.5 GB download.
Specifications Sourced from the model card
Family
Llama
Published by
Meta
Parameters
7B
Quantisation
q4f16_1 · 4-bit
Download
3.5 GB · 115 files
GPU memory
6.6 GB
Context window
4k tokens
Reasoning
Good at
Chat
Builds Same weights, different precision
# Build Download GPU memory Context Note
01 q4f16_1 3.5 GB 6.6 GB 4k tokens 4-bit weights, f16 · needs f16 shaders Recommended
02 q4f16_1 3.5 GB 4.5 GB 1k tokens 4-bit weights, f16 · short context, less memory · needs f16 shaders
03 q4f32_1 3.9 GB 8.9 GB 4k tokens 4-bit weights, f32
04 q4f32_1 3.9 GB 5.2 GB 1k tokens 4-bit weights, f32 · short context, less memory
How to run it
01 Open the chat The button above opens Llama 2 7B Chat in the browser AI chat, with the model already selected.
02 Download once 3.5 GB arrives from Hugging Face and stays in your browser cache. You can start typing while it downloads.
03 Chat privately The model runs on your GPU. Nothing you type is uploaded, and it keeps working offline.
Questions
How big is the Llama 2 7B Chat download?

3.5 GB for the q4f16_1 build, in 115 files. It downloads once and stays in your browser cache, so every later visit starts straight away and works offline.

What does my device need to run Llama 2 7B Chat?

A browser with WebGPU — recent Chrome, Edge, Firefox or Safari — and about 6.6 GB of GPU memory. The tool checks your GPU, memory and free space and tells you whether Llama 2 7B Chat fits before anything downloads.

Is anything I type sent to a server?

No. Llama 2 7B Chat runs on your own GPU inside the browser tab. The only network traffic is the one-time download of the model files from Hugging Face; your prompts and the answers never leave the device, and the chats are stored in this browser.

Which build of Llama 2 7B Chat should I choose?

Start with q4f16_1 — it is the smallest download and the fastest to run. The f32 builds are larger and use more memory, but they run on GPUs without 16-bit shader support. Builds marked 1k hold a shorter conversation in exchange for less memory.

How long a conversation can Llama 2 7B Chat hold?

Its context window is 4k tokens. Longer conversations keep working — the oldest turns are dropped with a notice when the conversation no longer fits.

What licence is Llama 2 7B Chat released under?

The weights are Llama 2 Community License, taken from the model card of meta-llama/Llama-2-7b-chat-hf. Check the licence yourself before using it commercially.

Other models Same family, then same size

All 65 models Open the chat

Figures read from the WebLLM 0.2.84 catalog and the model card on 2026-09-03.

/ai/browser-based-ai-chat
1 tool selected
Runs locally·The model downloads once·Your input never leaves
Out0 B
Ready