FR
Catalogue · 26 models

How much VRAM for each LLM?

Memory needed in Q4, Q8 and FP16 with an 8k-token context, and the cheapest machine that runs it. Click a model for details by context and by card.

All26Llama3Qwen8OpenAI2Google2Mistral4Microsoft1DeepSeek3GLM2Kimi1
2 results
Dense · Google2025-03
Gemma 3 12B12 B · dense
10 GBQ415 GBQ827 GBFP16

From: RTX 3060 12 GB · €1,180

Dense · Google2025-03
Gemma 3 27B27 B · dense
19 GBQ432 GBQ859 GBFP16

From: 2 × RTX 3060 12 GB · €1,460