FR
Catalogue · 26 models

How much VRAM for each LLM?

Memory needed in Q4, Q8 and FP16 with an 8k-token context, and the cheapest machine that runs it. Click a model for details by context and by card.

All26Llama3Qwen8OpenAI2Google2Mistral4Microsoft1DeepSeek3GLM2Kimi1
2 results
MoE · GLM2025-07
GLM-4.5-Air 106B106 B · 12 B active
69 GBQ4120 GBQ8224 GBFP16

From: Mini-PC Ryzen AI Max+ 395 128 GB · €2,300

MoE · GLM2025-07
GLM-4.5 355B355 B · 32 B active
226 GBQ4398 GBQ8748 GBFP16

From: Mac Studio M3 Ultra 512 GB · €11,500