Catalogue · 26 models
How much VRAM for each LLM?
Memory needed in Q4, Q8 and FP16 with an 8k-token context, and the cheapest machine that runs it. Click a model for details by context and by card.
Dense · Llama2024-07
Llama 3.1 8B8.0 B · dense6 GBQ410 GBQ818 GBFP16
From: RTX 3060 12 GB · €1,180
Dense · Llama2024-12
Llama 3.3 70B71 B · dense47 GBQ481 GBQ8151 GBFP16
From: Mini-PC Ryzen AI Max+ 395 128 GB · €2,300
Dense · Llama2024-07
Llama 3.1 405B405 B · dense259 GBQ4455 GBQ8855 GBFP16
From: Mac Studio M3 Ultra 512 GB · €11,500
No model found.