FR
Catalogue · 26 models

How much VRAM for each LLM?

Memory needed in Q4, Q8 and FP16 with an 8k-token context, and the cheapest machine that runs it. Click a model for details by context and by card.

All26Llama3Qwen8OpenAI2Google2Mistral4Microsoft1DeepSeek3GLM2Kimi1
1 result
Dense · Microsoft2024-12
Phi-4 14B15 B · dense
11 GBQ418 GBQ833 GBFP16

From: RTX 3060 12 GB · €1,180