Quantization
Shrinks a model’s numbers so it takes less memory and runs faster. You gain room on your Mac. You lose a little accuracy, and the more you shrink it, the more you lose.
About LMM
LMM shows which local AI models will run well on your Mac, with what settings and what to expect. When something slows down, it finds out why.
Why it exists
Watch a few local AI videos and the setup is usually the same: racks of GPUs, a maxed-out Mac Studio, a budget most of us don’t have. The model flies, and the video ends with “just run this.”
We wanted to know something smaller. What can I get running right now, on the laptop I already own? Or on a phone, or whatever else is on the desk? Which model is actually good, and which one only looks good in a chart?
Every answer lived somewhere different. One site for the model, another for the numbers, a forum thread for the settings, and a comment saying it crashed on theirs. Then the words started: quantization, context window, tokens per second. What does any of it mean? What do you gain by shrinking a model, and what do you lose?
Half the time it didn’t work. A model would download and not load. Or it loaded and crawled, with the Mac swapping to disk, and nothing said whether the model, the settings or the Mac was to blame.
LMM is the tool we wished we’d had at the start. It looks at your Mac, tells you what will actually run well, explains the settings in plain words and finds the problem when something is slow. It’s built for Macs, because that’s where we started.
What we had to learn
Local AI runs on a few ideas that rarely get explained first. Once you know them, the choices get a lot easier.
Shrinks a model’s numbers so it takes less memory and runs faster. You gain room on your Mac. You lose a little accuracy, and the more you shrink it, the more you lose.
How much text a model can keep in mind at once. A bigger context needs more memory, which is why a model that fits at 32k may not fit at 128k.
How fast the answer is written. It’s only half of speed: the model also has to read your prompt first, and for a coding agent that can take a long time.
How we work
Three rules we hold LMM to.
If a setup will be Frustrating or Won’t fit, LMM says so before you press Load, and tells you what would help.
When a technical word matters, LMM uses it and explains it, so the choices make sense.
LMM runs on your Mac. Your prompts, conversations and files never come to us.
What LMM checks
The Planner and Checkup look at the same things, on your actual Mac.
Where it’s going
New models land every week, and the tools around them keep getting better at doing more with less. LMM’s job is to keep that progress clear: which new model is worth trying on your Mac, what settings suit it and how it performs once it’s running.
Email us and tell us what you’re trying to do.