Skip to content

Local AI models

Which AI models run on a Mac with 32 GB?

21 of Toskar's 21 models run on a Mac with 32 GB, and 21 of them run comfortably. An upgraded Mac mini or MacBook Air, and many MacBook Pro and Mac Studio models.

Start here

The best model for each job

The largest model of each kind that runs comfortably on this computer.

  • Everyday chat and writing

    Qwen 2.5 32B

    Large high-quality model for capable machines.

  • Coding

    Muse Glimmer 30B

    Meta's large model that sees pictures, codes, and reasons well; for 32 GB Macs or 24 GB graphics cards.

  • Pictures and screenshots

    Qwen 3.8 27B

    The most capable everyday assistant, for computers with plenty of memory. Sees pictures too.

  • Step-by-step reasoning

    Qwen 2.5 14B

    Largest curated quality pick when your machine has headroom.

Every model on this computer

Graded with Toskar 1.12.1's own estimate: the model file plus working memory at an 8K context.

Excellent fitPlenty of memory to spare.

Good fitShould run comfortably.

Questions

What's the best local AI model for a Mac with 32 GB?
For everyday use, start with Qwen 2.5 32B: it's the largest of its kind that runs comfortably here. For coding, try Muse Glimmer 30B. For pictures and screenshots, try Qwen 3.8 27B. For step-by-step reasoning, try Qwen 2.5 14B.
How big a model can a Mac with 32 GB run?
The largest that runs is Qwen 2.5 32B, at about 21.5 GB; the largest that runs comfortably is Qwen 2.5 32B, at about 21.5 GB. Memory decides it: the model and the conversation have to fit, with room left for everything else you have open.
Do I need a graphics card?
No. On a Mac with Apple silicon the graphics share the Mac's memory, so every model below uses it to answer quickly.
Does it cost anything to run these models?
No. Toskar Core is free and open source, and the models download at no cost. Everything runs on your own computer, so there's no subscription and no per-question bill.

Other computers

Run them with Toskar

Toskar Core is free and open source for Mac, Windows, and Linux. It suggests the models that fit your computer, downloads them for you, and keeps every question on your computer.