FR
Catalogue · 26 models

How much VRAM for each LLM?

Memory needed in Q4, Q8 and FP16 with an 8k-token context, and the cheapest machine that runs it. Click a model for details by context and by card.

All26Llama3Qwen8OpenAI2Google2Mistral4Microsoft1DeepSeek3GLM2Kimi1
1 result
MoE · Kimi2025-07
Kimi K2 1T1,000 B · 32 B active
631 GBQ41,114 GBQ82,101 GBFP16

From: 5 × H200 141 GB · €171,000