How much VRAM does each open model need?

Already know the model and the card? The can-I-run-it checker answers that pairing directly. Below, all 40 open models tracked on this site are measured the same way, at Q4_K_M with 8k of context, from LFM3 1.7B at 1.6 GB to Mistral Small 4 119B (MoE) at 72.5 GB. 33 of them fit a 24 GB card at that setting. Nothing here is benchmarked: memory comes from a stated formula over each model's published architecture, and every model's page links the file the numbers were read from.

Every model, compared

"Smallest card" is the smallest memory size that holds the model at Q4_K_M with 8k of context. For named cards rather than sizes, see every GPU compared; for 32k context and the full fit table, see which models fit on 8 to 96 GB.

How to read the table

The Q4 column decides whether it loads. Weights are the big number: parameters multiplied by the bytes each takes at the chosen quantisation. A mixture-of-experts model keeps every expert in memory, so its full size counts here even though only the active share is read per token.

The context column decides how long a conversation it holds. It is the memory each extra 1,000 tokens costs, and it is where models of the same size differ most: Nemotron 3.5 Lightning 30B-A3B (MoE) pays 0.006 GB per 1,000 tokens, Llama 3.3 70B pays 0.328 GB. Models released in 2026 mostly keep a growing cache on only some of their layers, which is why they sit at the cheap end. Why newer models pay less for context has the working.

The window is a limit of the model, not of your GPU. Spare memory does not extend it. No page on this site credits a model with more context than its card states.

Qwen

• Qwen3.8 27B
  18 GB at Q4 · fits 24 GB · 256k window · Apache 2.0 · 2026-08

  Alibaba's dense 27B from August 2026, and one of the most downloaded open models of the year.

• Qwen3.6 27B
  18 GB at Q4 · fits 24 GB · 256k window · Apache 2.0 · 2026-04

  Alibaba's dense 27B from April 2026, released days after the Qwen3.6 35B-A3B: a vision-language model on the Qwen3.5 hybrid architecture, tuned for agentic coding.

  Newer in this family: Qwen3.8 27B
• Qwen3.6 35B-A3B (MoE)
  22.4 GB at Q4 · fits 24 GB · 256k window · Apache 2.0 · 2026-04

  The first open-weight Qwen3.6 model, April 2026: 256 experts with 8 routed and one shared, 3B parameters read per token.

• Qwen3.5 4B
  3.7 GB at Q4 · fits 8 GB · 256k window · Apache 2.0 · 2026-02

  The small end of Alibaba's Qwen3.5 family from February 2026.

• Qwen3.5 9B
  6.7 GB at Q4 · fits 8 GB · 256k window · Apache 2.0 · 2026-02

  The 9B model of Alibaba's Qwen3.5 family, February 2026, and one of the most downloaded open models of the year.

• Qwen3-Coder-Next 80B-A3B (MoE)
  48.9 GB at Q4 · fits 80 GB · 256k window · Apache 2.0 · 2026-01 · code model

  Alibaba's coding-agent model, early 2026: 80B of weights across 512 experts, with 3B read per token.

• Qwen3 8B
  6.7 GB at Q4 · fits 8 GB · 40k window · Apache 2.0 · 2025-04

  The 8B dense model of Alibaba's Qwen3 generation, April 2025.

  Newer in this family: Qwen3.5 9B
• Qwen3 14B
  10.8 GB at Q4 · fits 12 GB · 40k window · Apache 2.0 · 2025-04

  The 14B dense model of the Qwen3 generation, April 2025.

• Qwen3 30B-A3B (MoE)
  19.7 GB at Q4 · fits 24 GB · 40k window · Apache 2.0 · 2025-04

  The small mixture-of-experts model of the Qwen3 generation, April 2025: 30B of weights, 3.3B read per token.

  Newer in this family: Qwen3.6 35B-A3B (MoE)
• Qwen3 32B
  22.4 GB at Q4 · fits 24 GB · 40k window · Apache 2.0 · 2025-04

  The dense flagship of the Qwen3 generation, April 2025, and for a year the model a 24 GB card was bought to run.

  Newer in this family: Qwen3.8 27B
• Qwen2.5 Coder 32B
  22.4 GB at Q4 · fits 24 GB · 32k window · Apache 2.0 · 2024-11 · code model

  Alibaba's coding model from November 2024, and the open coding model of choice through most of 2025.

  Newer in this family: Qwen3-Coder-Next 80B-A3B (MoE)

Gemma

• Gemma 4 12B
  8.2 GB at Q4 · fits 12 GB · 256k window · Apache 2.0 · 2026-05

  Google DeepMind's Gemma 4 12B "Unified", May 2026.

• Gemma 4 26B-A4B (MoE)
  16.4 GB at Q4 · fits 24 GB · 256k window · Apache 2.0 · 2026-03

  The mixture-of-experts member of Gemma 4, spring 2026: 128 experts with 8 active plus one shared, 3.8B parameters read per token.

• Gemma 4 31B
  20.9 GB at Q4 · fits 24 GB · 256k window · Apache 2.0 · 2026-03

  The dense flagship of Google DeepMind's Gemma 4 family, spring 2026.

• Gemma 3 12B
  8.7 GB at Q4 · fits 12 GB · 128k window · Gemma Terms of Use · 2025-03

  Google's 12B vision-language model from March 2025.

  Newer in this family: Gemma 4 12B
• Gemma 3 27B
  18.1 GB at Q4 · fits 24 GB · 128k window · Gemma Terms of Use · 2025-03

  Google's largest Gemma 3 model, March 2025: vision-language, 128k window, and for a year the most common answer to "what do I run on a 24 GB card".

  Newer in this family: Gemma 4 31B

Mistral

• Mistral Small 4 119B (MoE)
  72.5 GB at Q4 · fits 80 GB · 256k window · Apache 2.0 · 2026-03

  Mistral's March 2026 general model, and small in name only: 119B of weights, 128 experts, 6.5B read per token.

• Ministral 3 14B
  10.3 GB at Q4 · fits 12 GB · 256k window · Apache 2.0 · 2025-12

  The largest of Mistral's Ministral 3 family, December 2025, designed for edge and local deployment.

• Devstral Small 2 24B
  16.3 GB at Q4 · fits 24 GB · 256k window · Apache 2.0 · 2025-12 · code model

  Mistral's agentic coding model, December 2025.

• Mistral Small 3.1 24B
  16.3 GB at Q4 · fits 24 GB · 128k window · Apache 2.0 · 2025-03

  Mistral's 24B general model from March 2025: text and images, a 128k window, Apache 2.0.

  Newer in this family: Mistral Small 4 119B (MoE)

Llama

• Llama 3.3 70B
  45.8 GB at Q4 · fits 80 GB · 128k window · Llama Community License · 2024-12

  Meta's 70B text model from December 2024, and still the reference dense 70B. When people ask whether a card "can run a 70B", this is the model they mean.

• Llama 3.2 3B
  3.4 GB at Q4 · fits 8 GB · 128k window · Llama Community License · 2024-09

  Meta's small text model from September 2024, built to run on phones and laptops.

• Llama 3.1 8B
  6.4 GB at Q4 · fits 8 GB · 128k window · Llama Community License · 2024-07

  Meta's 8B text model from July 2024, and probably the most fine-tuned open model there has been.

DeepSeek

• DeepSeek-R1 Distill Qwen 32B
  22.4 GB at Q4 · fits 24 GB · 128k window · MIT · 2025-01 · reasoning model

  DeepSeek-R1's reasoning distilled into Qwen2.5 32B, January 2025.

• DeepSeek-R1 Distill Llama 70B
  45.8 GB at Q4 · fits 80 GB · 128k window · MIT · 2025-01 · reasoning model

  DeepSeek-R1's reasoning distilled into Llama 3.3 70B, January 2025.

gpt-oss

• gpt-oss 20B
  13.4 GB at Q4 · fits 16 GB · 128k window · Apache 2.0 · 2025-08

  The smaller of OpenAI's two open-weight models, August 2025.

• gpt-oss 120B
  71.4 GB at Q4 · fits 80 GB · 128k window · Apache 2.0 · 2025-08

  The larger of OpenAI's open-weight models, August 2025: 117B of weights, 5.1B read per token, shipped in MXFP4 so that it fits a single 80 GB card.

Granite

• Granite 4.2 8B
  7.2 GB at Q4 · fits 8 GB · 128k window · Apache 2.0 · 2026-08

  The middle size of IBM's Granite 4.2 family, August 2026: a dense text model that thinks before it answers, with tool calling in its chat template.

• Granite 4.2 30B
  20.3 GB at Q4 · fits 24 GB · 128k window · Apache 2.0 · 2026-08

  The largest of IBM's Granite 4.2 models, August 2026: a dense 30B that thinks before it answers, with a second fine-tuning phase weighted towards agentic data, per the card.

Nemotron

• Nemotron 3.5 Bolt 74B-A9B (MoE)
  45.9 GB at Q4 · fits 80 GB · 256k window · OpenMDW 1.1 · 2026-10

  NVIDIA's 74B-A9B vision-language model, October 2026, compressed from its Nemotron 3.5 Super VL 120B-A12B to run agent work on one machine.

• Nemotron 3.5 Lightning 30B-A3B (MoE)
  19.7 GB at Q4 · fits 24 GB · 256k window · OpenMDW 1.1 · 2026-08

  NVIDIA's open 30B-A3B model, August 2026, released with its training data and recipes.

Flint

• Flint 40B-A2.5B (MoE)
  24.8 GB at Q4 · fits 32 GB · 256k window · Apache 2.0 · 2026-10 · code model

  Recursive's coding-agent model from October 2026, trained from scratch: 39.8B of weights across 256 experts, with about 2.5B read per token.

GLM

• GLM-4.7 Flash 30B-A3B (MoE)
  19.8 GB at Q4 · fits 24 GB · 198k window · MIT · 2026-01

  Z.ai's 30B-A3B mixture-of-experts model, January 2026, the lightweight member of the GLM-4.7 line.

LFM

• LFM3 1.7B
  1.6 GB at Q4 · fits 8 GB · 256k window · LFM Open License v1.0 · 2026-10

  Liquid AI's small text model from October 2026, built for local agents, tool calling and structured output on phones and laptops.

MiniCPM

• MiniCPM-V 4.7 35B-A3B (MoE)
  22 GB at Q4 · fits 24 GB · 256k window · Apache 2.0 · 2026-10

  OpenBMB's MiniCPM-V 4.7 from October 2026, the first mixture-of-experts model in its MiniCPM-V vision series: 35B of weights with 3B read per token, on a Qwen3.5 and Qwen3.6 language backbone with a SigLIP2 vision encoder.

Muse

• Muse Glimmer 30B
  18.7 GB at Q4 · fits 24 GB · 128k window · Apache 2.0 · 2026-08

  Meta's 30B model from August 2026, distilled from Muse Spark and built for agents that run on consumer hardware.

Nanbeige

• Nanbeige4.3 33B
  22.2 GB at Q4 · fits 24 GB · 512k window · Apache 2.0 · 2026-10 · code model

  The Nanbeige team's dense 33B from October 2026, the flagship of its Nanbeige4.3 series and the "teacher" its smaller models will be distilled from.

Phi

• Phi-4 14B
  11 GB at Q4 · fits 12 GB · 16k window · MIT · 2024-12

  Microsoft's 14B model from December 2024, trained largely on synthetic data with an emphasis on reasoning and mathematics.

Sage

• Sage-A1.5 35B (MoE)
  22.4 GB at Q4 · fits 24 GB · 256k window · Apache 2.0 · 2026-10 · reasoning model

  InternScience's agent model from October 2026, built on Qwen3.6 35B-A3B and its own Agents-A1 for long-horizon scientific problem solving.

Spark

• Spark-X2.6 4B
  3.3 GB at Q4 · fits 8 GB · 1024k window · Apache 2.0 · 2026-10

  The SparkLLM team's on-device model from October 2026, published under XHToken on Hugging Face: a 4B text model whose release notes put agent work first, meaning tool use, multi-step planning and software engineering.

How to choose, in one paragraph

Start from the memory you have, not the model you have heard of. Find the largest row whose Q4 figure fits your card with room to spare, then check its context column against how long your documents and conversations really are. If two models fit, the newer one usually holds more conversation in the same memory. If the model you want does not fit anything you own, the checker lists exactly what would change that, and the build vs rent calculator tells you honestly whether buying a bigger card beats renting one for the hours you would use it.

• Architecture values are read from each model's config.json and model card on Hugging Face; every model page links its own source.
• Memory: weights + KV cache + runtime overhead, per the formula in the VRAM calculator. Sliding-window, hybrid and latent-attention models are counted as they actually cache.
• Context cost is at an FP16 KV cache, once any sliding windows are full.
• Every figure in this table, and each model at every quantisation and context length, is also open data: CSV and JSON under CC BY 4.0, archived on Zenodo with a DOI.