Build with AI

What hardware should you buy to run AI at home in late 2026?

Published · By Robert Scales, with AI tools · 6 min read

Short answer

Buy for memory first: 16 GB runs small models, 32 GB runs today's best 27-billion-parameter coding models, and 128 GB reaches models above 100 billion parameters. A memory shortage has pushed prices far above launch levels, so a 32 GB machine now starts near CA$1,800 and a 128 GB one near CA$4,800.

Advice on buying local AI hardware goes stale quickly this year, because the price of memory keeps moving. NVIDIA's 128 GB DGX Spark launched at US$3,999 and now lists at US$6,950. Framework's 128 GB desktop, US$1,999 at its February 2025 launch, was US$3,449 by July. So every price below carries the date it was read, and you should check it again before paying.

The guide's 2024 hardware overview explains why memory matters, and the October 2026 setup guide covers installing the software. This article answers the next question: what to buy, at what budget.

Three numbers decide the purchase

Memory the processor can reach quickly. On a PC with a graphics card, that is the card's VRAM. On an Apple Mac or an AMD Ryzen AI Max machine, it is a shared pool called unified memory. This sets the largest model you can load.

Memory bandwidth. Measured in gigabytes per second, it sets how fast words appear once a model is loaded. A Mac mini M6 starts at 153 GB/s, a DGX Spark has 273 GB/s, and an M5 Ultra has 1.2 TB/s.

Software support. Tools usually arrive first for NVIDIA's CUDA platform. That matters little for chatting and a lot for training, as the Mac versus PC comparison explains.

Budget tiers, with prices read November 2, 2026

Prices exclude tax. Apple and Framework figures come from their store pages as shown to a Canadian visitor. Graphics card figures are the cheapest new US listings on the Tom's Hardware index for October 26, as read by PC Server and Parts, a used-card seller that discloses its interest. They cover the card alone, not the computer around it.

TierExamplePriceFast memoryWhat fits
StartThe computer you own$08 to 16 GB3B to 8B models
SmallMac mini M6CA$1,249 (US$899)16 GB8B comfortably, 14B with short context
Small upgradeRadeon RX 9060 XT 16 GB or RTX 5060 Ti 16 GBUS$599 or US$76516 GB14B
CodingFramework Desktop, Max 385CA$1,78932 GB sharedQwen3.8-27B, measured at 17.6 GB
Coding, usedRTX 3090about US$1,559 average asking24 GB27B at 4 bits, short context
LargeFramework Desktop, Max+ 395CA$2,74964 GB sharedQwen3.5-122B-A10B at 3 bits, measured at 52.5 GB
Large, fasterMac Studio M5 MaxCA$4,399 (US$3,099)64 GB at 614 GB/sSame models, more than twice the bandwidth
Very largeFramework Desktop, Max+ 395CA$4,839128 GB sharedgpt-oss-120b (65 GB); DeepSeek V4 Flash at 2 bits, measured at 90.9 GB
Very large, NVIDIADGX SparkUS$6,950128 GBUp to 200B by NVIDIA's count
Top desktopMac Studio M5 UltraCA$7,799 (US$5,499)96 GB at 1.2 TB/sFastest shared-memory option here
Top graphics cardRTX 4090 or RTX 5090US$4,450 or US$8,477 (one listing)24 or 32 GBSmall models at very high speed

"B" means billion parameters, the numbers a model learned in training. The measured sizes are Framework's own, from its September 2026 reference tests.

Two things stand out. The 16 GB graphics cards cost almost as much as a small computer: the RTX 5060 Ti 16 GB launched at US$429. And prices disagree between sources: the same index lists the RTX 5080 at US$1,699 while a Hardware Unboxed survey found US$2,200 that month. Treat any single number as a snapshot.

A worked example: a private coding assistant

Suppose you want a local model to work on code you cannot send anywhere. The open coding models guide points to Qwen3.8-27B, an 18 GB download. Ollama recommends at least 64,000 tokens of context for coding tools, and that context needs memory beside the model.

  • 16 GB: the model does not load. Skip this tier for that goal.
  • 24 GB: it loads with little left over, so contexts stay modest.
  • 32 GB shared: it fits with room for context, since the system and the model share the pool. Expect modest speed.
  • 64 GB: it fits with plenty of context, and you can try larger models.

So the sensible spend for this person starts at the CA$1,789 tier, not at a CA$7,799 machine. The extra money buys speed and bigger models, which only help if you will really use them.

Try it: Write down the one model you most want to run and its download size. Add 30% as a planning margin for context and the system. Find the cheapest row in the table that clears the total, then look up today's price on the maker's own page.

Common mistakes

  • Buying the chip instead of the memory. A faster processor with too little memory cannot load the model at all.
  • Trusting a parameter ceiling in marketing. Those figures assume heavy compression and little context. The memory calculator shows how to check.
  • Forgetting that shared memory is soldered. Macs and Ryzen AI Max machines cannot be upgraded later, so choose the memory you will need.
  • Ignoring running costs and noise. A big graphics card draws far more power than a small box. The power and noise guide has the figures.

Should you buy now, or rent until prices settle?

Nobody can tell you when prices will fall. Micron, one of the largest memory makers, says it cannot see when supply and demand will balance and expects the crunch to worsen in 2027 and 2028. That is a company's forecast rather than a certainty, so waiting may or may not pay off.

The more useful test is why you want local AI. If the reason is saving money, the numbers rarely work: hosted gpt-oss-20b was listed on OpenRouter from about US$0.066 per million output tokens, which is close to what electricity alone costs to run it at home. If the reason is privacy, offline use or learning how these systems behave, then the machine buys something a hosted service cannot sell you.

A cautious path is to start with the computer you already own and a small model. Next, test the model you want through a hosted API or a rented graphics card for a few weeks. Buy only once you know which model you will really run and how much context you need. That way the purchase is sized by your own measurements, not by a spec sheet.

Sources

  1. Buy Mac Studio and Mac mini (Canadian and US Apple Store pages) — Apple, November 2, 2026
  2. Framework Desktop — Framework
  3. GPU Price Increase 2026: Why, and When Will Prices Drop? — PC Server and Parts, October 28, 2026

Sources for the articles linked in the text

Each linked article has its own page, with its sources and its date.

From the Guide to Artificial Intelligence, by Robert Scales, published by Holistic Hybrid Inc. Share and adapt it under CC BY-NC-SA 4.0: credit the guide, link to https://guidetoartificialintelligence.com/en/learn/local-ai-hardware-buying-guide-2026/, no commercial use without permission, and keep the same licence.

Get the free Guide to Artificial Intelligence

Sign up for the newsletter and receive the free guide: what changed in AI, one lesson, one prompt to try. Unsubscribe in one click.

How we handle your address

Back to top

Display

Your choices are saved in this browser only. No data is sent.

Text size
100%
Colours
Reading
More settings
Accessibility statement

Get the app

Add the guide to your home screen. It opens like an app, and the pages you have read stay available offline.

Read without a connection: download the articles

iPhone and iPad (Safari, Chrome, Edge)

  1. Tap the Share button (the square with an arrow). In Chrome and Edge, it is in the address bar or the menu.
  2. Choose “Add to Home Screen”.
  3. Tap “Add”.

Android (Chrome, Edge, Samsung Internet, Firefox)

  1. Open the browser menu (⋮ or ☰).
  2. Choose “Install app” or “Add to Home screen”.
  3. Confirm with “Install”.

Computer (Chrome, Edge)

  1. Click the install icon at the right end of the address bar, or open the browser menu (⋮ or …).
  2. In Chrome, choose “Cast, save and share”, then “Install page as app”. In Edge, choose “Apps”, then “Install this site as an app”.
  3. Click “Install”.

Mac (Safari)

  1. Open the File menu.
  2. Choose “Add to Dock”.
  3. Click “Add”.

Firefox on a computer can’t install a site as an app. Use Chrome, Edge or Safari instead.