Skip to the tool workspace
Browser 106
no file limit
TinyLlama Runs on your GPU

Run TinyLlama 1.1B Chat v1.0 in your browser

TinyLlama 1.1B Chat v1.0 is a 1.1B TinyLlama model. In the browser it downloads 590 MB and needs about 697 MB of GPU memory.

modelTinyLlama-1.1B-Chat-v1.0-q4f16_1-MLC engineWebLLM 0.2.84 networkthe model downloads once
Download590 MB
GPU memory697 MB
Context2k tokens
Parameters1.1B
Builds4

Use TinyLlama 1.1B Chat v1.0 in the browser All models Downloads once · then works offline

Open this page in a browser with JavaScript to check whether TinyLlama 1.1B Chat v1.0 fits this device. It needs about 697 MB of GPU memory and a 590 MB download.
Specifications Sourced from the model card
Family
TinyLlama
Published by
TinyLlama
Parameters
1.1B
Quantisation
q4f16_1 · 4-bit
Download
590 MB · 24 files
GPU memory
697 MB
Context window
2k tokens
Reasoning
Licence
Apache 2.0
Good at
Chat
Builds Same weights, different precision
# Build Download GPU memory Context Note
01 q4f16_1 590 MB 697 MB 2k tokens 4-bit weights, f16 · needs f16 shaders Recommended
02 q4f16_1 590 MB 675 MB 1k tokens 4-bit weights, f16 · short context, less memory · needs f16 shaders
03 q4f32_1 656 MB 840 MB 2k tokens 4-bit weights, f32
04 q4f32_1 656 MB 796 MB 1k tokens 4-bit weights, f32 · short context, less memory
How to run it
01 Open the chat The button above opens TinyLlama 1.1B Chat v1.0 in the browser AI chat, with the model already selected.
02 Download once 590 MB arrives from Hugging Face and stays in your browser cache. You can start typing while it downloads.
03 Chat privately The model runs on your GPU. Nothing you type is uploaded, and it keeps working offline.
Questions
How big is the TinyLlama 1.1B Chat v1.0 download?

590 MB for the q4f16_1 build, in 24 files. It downloads once and stays in your browser cache, so every later visit starts straight away and works offline.

What does my device need to run TinyLlama 1.1B Chat v1.0?

A browser with WebGPU — recent Chrome, Edge, Firefox or Safari — and about 697 MB of GPU memory. The tool checks your GPU, memory and free space and tells you whether TinyLlama 1.1B Chat v1.0 fits before anything downloads.

Is anything I type sent to a server?

No. TinyLlama 1.1B Chat v1.0 runs on your own GPU inside the browser tab. The only network traffic is the one-time download of the model files from Hugging Face; your prompts and the answers never leave the device, and the chats are stored in this browser.

Which build of TinyLlama 1.1B Chat v1.0 should I choose?

Start with q4f16_1 — it is the smallest download and the fastest to run. The f32 builds are larger and use more memory, but they run on GPUs without 16-bit shader support. Builds marked 1k hold a shorter conversation in exchange for less memory.

How long a conversation can TinyLlama 1.1B Chat v1.0 hold?

Its context window is 2k tokens. Longer conversations keep working — the oldest turns are dropped with a notice when the conversation no longer fits.

What licence is TinyLlama 1.1B Chat v1.0 released under?

The weights are Apache 2.0, taken from the model card of TinyLlama/TinyLlama-1.1B-Chat-v1.0. Check the licence yourself before using it commercially.

Other models Same family, then same size

All 65 models Open the chat

Figures read from the WebLLM 0.2.84 catalog and the model card on 2026-09-03.

/ai/browser-based-ai-chat
1 tool selected
Runs locally·The model downloads once·Your input never leaves
Out0 B
Ready