Which AI models run on a PC with 8 GB of RAM and no graphics card?
18 of Toskar's 21 models run on a PC with 8 GB of RAM and no graphics card, and 15 of them run comfortably. Everyday laptops and older desktops.
Start here
The best model for each job
The largest model of each kind that runs comfortably on this computer.
Everyday chat and writing
Gemma 2 9BHigher-quality general assistant when you have more memory.
Coding
Qwen 2.5 Coder 7BStrong all-round coding model with tool use.
Pictures and screenshots
Qwen 2.5 VL 7BSees pictures in more detail: documents, charts, and small text.
Step-by-step reasoning
DeepSeek R1 Distill 7BStronger reasoning for analysis and multi-step problems.
Every model on this computer
Graded with Toskar 1.12.1's own estimate: the model file plus working memory at an 8K context.
Excellent fitPlenty of memory to spare.
- Qwen 2.5 Coder 7B≈ 5.3 GB
- Qwen 2.5 7B≈ 5.3 GB
- DeepSeek R1 Distill 7B≈ 5.3 GB
- Mistral 7B Instruct≈ 5.0 GB
- Qwen 3.5 4B≈ 3.9 GB
- Gemma 3 4B≈ 3.9 GB
- Phi 3.5 Mini≈ 3.0 GB
- Llama 3.2 3B≈ 2.6 GB
- Qwen 2.5 3B≈ 2.5 GB
- Gemma 2 2B≈ 2.2 GB
- Qwen 2.5 Coder 1.5B≈ 1.6 GB
- DeepSeek R1 Distill 1.5B≈ 1.6 GB
- Llama 3.2 1B≈ 1.3 GB
Good fitShould run comfortably.
- Gemma 2 9B≈ 6.5 GB
- Qwen 2.5 VL 7B≈ 6.1 GB
Tight fitRuns, with little memory to spare. Close other big apps.
- Qwen 3.5 9B≈ 7.2 GB
May run slowlyMay need swap or a shorter context.
- Qwen 2.5 14B≈ 10.2 GB
- Qwen 2.5 Coder 14B≈ 9.7 GB
Too big for this computer: Qwen 2.5 32B, Qwen 3.8 27B, Muse Glimmer 30B. A paired computer with more memory can run them for you.
Questions
- What's the best local AI model for a PC with 8 GB of RAM and no graphics card?
- For everyday use, start with Gemma 2 9B: it's the largest of its kind that runs comfortably here. For coding, try Qwen 2.5 Coder 7B. For pictures and screenshots, try Qwen 2.5 VL 7B. For step-by-step reasoning, try DeepSeek R1 Distill 7B.
- How big a model can a PC with 8 GB of RAM and no graphics card run?
- The largest that runs is Qwen 2.5 14B, at about 10.2 GB; the largest that runs comfortably is Gemma 2 9B, at about 6.5 GB. Memory decides it: the model and the conversation have to fit, with room left for everything else you have open.
- Do I need a graphics card?
- No, but it helps. Without one, models run on the processor: smaller models answer at a comfortable pace, and larger ones are slower.
- Does it cost anything to run these models?
- No. Toskar Core is free and open source, and the models download at no cost. Everything runs on your own computer, so there's no subscription and no per-question bill.
Other computers
Mac with Apple silicon
PC with a graphics card
PC without one
- PC, 8 GB, no graphics card
- PC, 16 GB, no graphics card
- PC, 32 GB, no graphics card
Run them with Toskar
Toskar Core is free and open source for Mac, Windows, and Linux. It suggests the models that fit your computer, downloads them for you, and keeps every question on your computer.