Catalogue · 26 models
How much VRAM for each LLM?
Memory needed in Q4, Q8 and FP16 with an 8k-token context, and the cheapest machine that runs it. Click a model for details by context and by card.
Dense · Mistral2024-07
Mistral Nemo 12B12 B · dense9 GBQ415 GBQ827 GBFP16
From: RTX 3060 12 GB · €1,180
Dense · Mistral2025-01
Mistral Small 24B24 B · dense17 GBQ428 GBQ852 GBFP16
From: 2 × RTX 3060 12 GB · €1,460
MoE · Mistral2023-12
Mixtral 8x7B47 B · 13 B active31 GBQ453 GBQ899 GBFP16
From: 2 × RTX 4060 Ti 16 GB · €1,800
Dense · Mistral2024-11
Mistral Large 123B123 B · dense81 GBQ4140 GBQ8261 GBFP16
From: Mini-PC Ryzen AI Max+ 395 128 GB · €2,300
No model found.