Knowledge Base · Local AI

Can my laptop run a local AI model?

Updated October 2026. No affiliate links on this page. For most people the answer is yes. Here's what your laptop can handle and the one number that decides it.

If your laptop has at least 8 GB of RAM, it can run a local AI model today. How far you can go depends on memory:

Memory is the spec that matters. Processor speed matters far less.

Words you'll see in this guide
  • LLM: large language model, the kind of AI behind ChatGPT and Claude. A local LLM runs on your own computer.
  • RAM: your computer's main working memory. More RAM lets it run more apps at once. AI models can run from it too, just slower than from VRAM.
  • VRAM: the memory on your graphics card. AI models load into it, so more VRAM means you can run bigger models.
  • Quantization: shrinking a model by storing its numbers less precisely, so it fits in less memory with a small drop in quality. Think of saving a photo as a smaller JPEG. "4-bit" (Q4) is the common setting.
  • Parameters (3B, 8B, 70B): a rough measure of a model's size. "8B" means 8 billion. Bigger models are usually smarter and need more memory.

See the full glossary

Why memory decides everything

When an AI model runs, it has to fit into memory: either your system RAM, where the processor runs it, or a graphics card's VRAM, where the card runs it. If it fits, it runs. If it doesn't, it won't load at all. That's why memory, not processor speed, is what limits you.

Models are almost always run in a compressed form called quantized, which uses about a quarter of the memory of the full version.

What runs at each amount of RAM

Your RAMWhat you can runWhat it's like
8 GBSmall models (1B to 3B), like Llama 3.2 3B or PhiFine for simple chat, summaries, and experimenting
16 GB7B and 8B models, like Llama 3.1 8B or MistralThe sweet spot. Useful for real work, on par with older cloud models
32 GB13B and 14B modelsNoticeably smarter answers, still comfortable
64 GB or moreLarge models, up to 70B on a MacGetting close to cloud quality, especially on Apple Silicon

The math behind the table: a compressed model needs about 0.5 to 1 GB of memory per billion parameters, plus a couple of GB extra.

Macs get more out of their memory. Apple Silicon laptops share one pool of memory between the processor and graphics, so their RAM works like VRAM. A 32 GB MacBook runs models that a 32 GB Windows laptop without a big graphics card can't. If you have an M-series Mac, go one row further down the table. More in Mac vs PC for local AI.

Fitting vs running fast

Fitting the model and running it fast are two different things. A model running on a graphics card, or in a Mac's shared memory, writes quickly. One that only fits in regular system RAM runs on the processor. You get the same answers, several times slower.

That's why a gaming laptop with an Nvidia graphics card feels much faster than a thin laptop with the same RAM: the model lives in the card's fast VRAM. Either way, if it fits, it works.

How to try it

Start with an app that hides the technical parts.

Not sure which suits you? See Ollama vs LM Studio.

Check your exact laptop

Type your chip and RAM, or your graphics card, into the Server Calculator. It tells you what fits and roughly how fast each model size will run.

Quick answers

Can my laptop run a local AI model?

Almost certainly, if it has at least 8 GB of RAM. 8 GB runs small models up to about 3B, 16 GB handles useful 7B to 8B models, 32 GB runs 13B to 14B well, and 64 GB or more opens up large models. Memory decides it more than the processor.

How much RAM do I need to run a local LLM?

Roughly 0.5 to 1 GB per billion parameters at the usual compressed setting, plus a couple of GB extra. So a 7B model needs about 5 to 8 GB free, a 13B model about 8 to 10 GB, and a 70B model 40 GB or more.

Is a Mac good for running local AI?

Yes. Apple Silicon Macs share one pool of memory between the processor and graphics, so a 32 GB MacBook can run models that would need an expensive graphics card on a Windows laptop.