
Thereās a ton of chatter lately around the expense of AI, with headings like āAIās real cost problem: Using the tech is more expensive than paying human employeesā. Wow, maybe our jobs arenāt in danger! Anyway, Iām not here to express an opinion about clankers replacing humans, thatās for another day. Here Iām just wanting to ask and answer the question: Can you simply run AI locally? If so, whatās it like? And just how capable is the 2026 MacBook Neo, really?
So, to start with, hereās a video of one of the newer highly optimised AI models running on my Neo:
As you can see, itās certainly quick enough to be useful! And arguably more reliable than using AI online where, if their servers are overloaded, you often donāt get an answer at all (Iām looking at you, Geminiā¦).
How did I do this? Simply by following this recipe:
I tried various other approaches using command-line python, Appleās MLX library, etc, but none of that worked. LM Studio is good.
So I asked it to generate a SkiFree game. Hereās what it came up with:
As you can see, nowhere near SkiFree. However, in its defence:
I then asked it to generate a āplasmaā graphics effect. Hereās what it made:
Again, not quite a traditional plasma effect, but still something fascinating!
So, in conclusion, even if you have a cheap-as-chips Neo, you can run AI locally just fine, and itās obvious not as good as the frontier commercial models, but itās better than youād think, and plenty fine for the way I use AI: like a supercharged search.
Give it a try! May i recommend LM Studio and the <= 4-bit MLX models.
Thanks for reading, I pinky promise this was written by a human, not AI, hope you found this helpful, at least a tiny bit, God bless!
Photo from unsplash.com/@allthestories
You can read more of my blog here in my blog archive.

(Comp Sci, Hons - UTS)
Software Developer (Freelancer / Contractor) in Australia.
I have worked at places such as Google, Cochlear, CommBank, Assembly Payments, News Corp, Fox Sports, NineMSN, FetchTV, Coles, Woolworths, Trust Bank, and Westpac, among others. If you're looking for help developing an iOS app, drop me a line!
Get in touch:
[email protected]
github.com/chrishulbert
linkedin