Ryzen AI Max+ 395
A Ryzen AI Max+ 395 runs 40 of the 40 open models tracked here at Q4_K_M with 8k context, computed on 3 November 2026. The largest is Mistral Small 4 119B (MoE), needing 72.5 GB and generating about 48 tokens per second.
- Memory
- 128 GB unified
- For the GPU
- 96 GB
- Bandwidth
- 256 GB/s
- Released
- 2025
- Availability
- Sold new
Open the Ryzen AI Max+ 395 in the LLM checker
What a Ryzen AI Max+ 395 runs, model by model
Ryzen AI Max+ 395 (128 GB) addresses 96 GB of its 128 GB of unified memory, worked out from what AMD documents (see the sources below), at 256 GB/s. Every model below is at Q4_K_M with 8k of context, the setting most people actually use. Once the 5% safety margin comes off, the card has 91.2 GB to spend: memory decides what loads, bandwidth how fast it answers. Both are estimates from stated formulas, and the VRAM calculator shows the working.
On this card a model fits at or under 91.2 GB, and above 81.6 GB it is tight: it loads, but there is little left for the conversation, and a desktop on the same 128 GB can push it over. Tokens per second are single-stream estimates from memory bandwidth; ≤ marks a ceiling real runtimes fall well below.
Computed 3 November 2026The model to actually run on it
Nemotron 3.5 Bolt 74B-A9B (MoE) is the best use of this card: 45.9 GB of the 96 GB available, an estimated 34 tokens per second, comfortable for chat, and 131,072 tokens of context still available. It is a mixture-of-experts model, so all 74.9B parameters sit in memory but only 9B are read per token, which is why it is quick for its size.
How this is chosen, since no benchmark is quoted: models are compared by size, a mixture-of-experts model counting at the geometric mean of its total and active parameters (a rule of thumb, not a measurement). The pick is the biggest class that fits with memory to spare and answers at 25 tokens per second or better, and within that class the most recent general-purpose release; coding and reasoning specialists are listed above but not recommended by default.
Mistral Small 4 119B (MoE) is the largest model the card will hold, at 72.5 GB, with room for 131,072 tokens of context. It is a mixture-of-experts model reading only 6.5B parameters per token, so it is the faster of the two at an estimated 48 tokens per second; what it gives up is the depth of a dense model that reads all of its weights for every token.
If quality matters more than parameter count, Llama 3.3 70B fits at Q8_0 in about 81 GB. Q8 is near-lossless; a smaller model at Q8 often beats a larger one squeezed into Q3.
How much context actually fits
Model size is the question people ask; context is the one that bites. The KV cache grows linearly with the conversation, so a model that loads comfortably can still run out of memory halfway through a long document. On 96 GB, the context you get is whatever the weights leave behind, which is why two cards that run the same model can feel completely different in use. These are the largest contexts this card holds, at Q4_K_M weights.
| Model | Max context, FP16 KV | With Q8 KV cache |
|---|---|---|
| Nemotron 3.5 Bolt 74B-A9B (MoE) | 131,072 tokens | 131,072 tokens |
| Llama 3.3 70B | 131,072 tokens | 131,072 tokens |
| Nanbeige4.3 33B | 131,072 tokens | 131,072 tokens |
| Qwen3 32B | 40,960 tokens · model limit | 40,960 tokens · model limit |
Every model in this table already reaches its limit at FP16, so quantising the KV cache buys nothing here. Capped at 128k tokens, or at the model's own native window where that is smaller, marked "model limit": free memory beyond that point buys nothing. Rows that hold far more context than their size suggests are hybrid, sliding-window or latent-attention models, which cache only a fraction of what a standard transformer does; each model page shows the working.
Where this card stops
Nothing in this list is out of reach. Every model tracked here fits at Q4_K_M with 8k of context, so the ceiling you will meet is context length and batch size, not parameter count.
Buy or rent
It makes sense if you want one x86 machine, laptop or desktop, that also holds large mixture-of-experts models. For dense models above 30B it is slow: a used 24 GB card generates several times faster on anything that fits in 24 GB. Check the power limit of the specific machine before you buy.
Where to buy: GMKtec · GMKtec EU · Framework · Minisforum · Beelink · Corsair.
To weigh it against every other machine for your own job (chat, agents, images or video), use the AI computer picker.
Retail prices drift, and a figure written today would be wrong within a month, so this page does not carry one. Put the figure you are actually looking at, with your electricity rate and your real monthly hours, into the build vs rent calculator. It returns the month owning becomes cheaper, or tells you it never does. Hours per month decides it far more often than the price does.
The honest take
AMD's 128 GB laptop and mini-PC chip: up to 96 GB for the GPU on Windows, and an x86 route to large mixture-of-experts models.
The same bargain as the DGX Spark, made by AMD for ordinary PCs: lots of memory, modest speed. Up to 96 GB can go to the GPU on Windows, and more on Linux, which holds models far beyond any 24 GB card. At 256 GB/s it reads them slowly, so mixture-of-experts models suit it and dense 70B models do not. It runs Windows and Linux on x86, through llama.cpp, LM Studio and ROCm rather than CUDA.
What it is good at
- Up to 96 GB of graphics memory on Windows, set with AMD Variable Graphics Memory.
- An x86 machine that runs Windows or Linux, in laptops and mini-PCs from several makers.
- LM Studio and llama.cpp support it directly, and AMD documents ROCm on Linux for this chip.
What it is not
- 256 GB/s: every token of a dense model reads all its weights at that speed.
- No CUDA. Fine-tuning and much image and video tooling assume it.
- On Linux the GPU sees about half the RAM until the shared memory limit is raised, and ROCm needs a recent kernel.
The thing people get wrong: The 128 GB is not all GPU memory. On Windows up to 96 GB can be made graphics memory, and whatever you assign is taken away from the CPU. The power limit is chosen by the laptop or mini-PC maker, anywhere from 45 to 120 W, so two machines with this chip can perform quite differently.
Compared with the alternatives
- DGX Spark: 126 GB · 273 GB/s · best fit Nemotron 3.5 Bolt 74B-A9B (MoE) at ~37 tok/s. NVIDIA's small Linux box with 128 GB the GPU can share: large models fit, but they are read at about a quarter of an RTX 4090's speed.
- MacBook Pro M5 Max: 96 GB · 614 GB/s · best fit Nemotron 3.5 Bolt 74B-A9B (MoE) at ~82 tok/s. Apple's 128 GB laptop: large models fit and are read at 614 GB/s, if you buy the 40-core GPU.
- RTX 3090: 24 GB · 936 GB/s · best fit Muse Glimmer 30B at ~38 tok/s. The value benchmark for local models, and it has been for years.
The unified-memory machines are compared head to head, on the same models, in DGX Spark vs Strix Halo vs Mac Studio.
How it stacks up against the other personal AI computers, from the Ghost Core to an RTX PRO 6000 workstation: personal AI computers compared.
All 40 cards are compared side by side on the GPU index, and the same numbers from the model's point of view are on each model fit table. To check one specific pairing rather than read a table, use the can-I-run-it checker.
Questions
- Can a Ryzen AI Max+ 395 run a 70B model?
- Yes. Llama 3.3 70B at Q4_K_M with 8k of context needs about 45.8 GB, inside the 96 GB this card can address, and it generates an estimated 4 tokens per second, which is too slow for interactive use.
- What is the best model to run on a Ryzen AI Max+ 395?
- Nemotron 3.5 Bolt 74B-A9B (MoE). At Q4_K_M and 8k context it needs about 45.9 GB of the 96 GB available and generates an estimated 34 tokens per second, which is comfortable for chat. If quality matters more than size, Llama 3.3 70B fits at Q8 in about 81 GB.
- How many tokens per second does a Ryzen AI Max+ 395 generate?
- It depends entirely on the size of the model, because generating a token means reading every active weight out of memory. At 256 GB/s and 70% efficiency, this card produces an estimated 39 tokens per second on an 8B model at Q4, and about 48 on the largest model it holds, Mistral Small 4 119B (MoE). Reading speed is roughly 5 to 8 words per second, so anything above 25 feels immediate. Treat 39 as a ceiling on 256 GB/s rather than a measurement; the higher a figure, the further real runtimes fall below it.
- Is 96 GB enough for running LLMs locally?
- It runs 40 of the 40 models tracked here at Q4_K_M with 8k of context, up to 119B parameters. The honest test is not the model list but the context: Nemotron 3.5 Bolt 74B-A9B (MoE) on this card holds about 131,072 tokens before memory runs out.
- Ryzen AI Max+ 395 or DGX Spark for local models?
- The DGX Spark holds more: 126 GB against 96 GB, but both run all 40 of these models at Q4_K_M with 8k of context, so the extra memory goes to longer context and higher precision. On speed, the DGX Spark is faster: 273 GB/s against 256 GB/s, and bandwidth is what sets chat speed.
- How much memory can the Ryzen AI Max+ 395's GPU use?
- On Windows, up to 96 GB of a 128 GB machine can be set as graphics memory with AMD Variable Graphics Memory, and AMD says workloads perform best inside that. On Linux, AMD recommends a small BIOS reservation and raising the shared memory limit instead: the default is about half of RAM, and AMD's own guide raises it to 120 GB. Every figure on this page uses 96 GB.
- Is Strix Halo good for local LLMs?
- For mixture-of-experts models, yes: they hold tens of billions of parameters but read only a few billion per token, so capacity matters more than its 256 GB/s. For dense 70B models it is slow, because every token reads all of the weights at that speed.
- Memory: weights (parameters × bytes per parameter) + KV cache (2 × layers × KV heads × head dim × context × bytes for a standard transformer; sliding-window, hybrid and latent-attention models counted as they actually cache) + 0.5 GB runtime + 4% of weights. Full derivation in the VRAM calculator.
- Speed: 70% × bandwidth ÷ active weight bytes, single stream, no batching, prompt processing excluded. A ceiling, not a measurement: the 8 of 40 figures marked ≤ are where real runtimes fall furthest below the number, because so few weights are read per token. See the tokens-per-second estimator.
- Card specification (manufacturer figures): 128 GB, 256 GB/s; see AMD's own page for this machine. The bandwidth figure: AMD's Ryzen AI Halo page for the same chip. Unified memory: AMD lets up to 96 GB of the 128 GB be set aside as graphics memory (Variable Graphics Memory), and says workloads run best inside it. Figures here use 96 GB. On Linux AMD documents raising the shared limit further, to 120 GB in its own guide. Source: AMD's Variable Graphics Memory FAQ.
- Model architecture values come from each model's published config; the self-hosted LLM guide explains what each one changes.