Catalogue · 26 models
How much VRAM for each LLM?
Memory needed in Q4, Q8 and FP16 with an 8k-token context, and the cheapest machine that runs it. Click a model for details by context and by card.
No model found.
Memory needed in Q4, Q8 and FP16 with an 8k-token context, and the cheapest machine that runs it. Click a model for details by context and by card.