David Heinemeier Hansson

Local LLMs, while technically impressive, still lag significantly behind cloud-based frontier models for practical development work. Despite the hype around running AI models locally, most developers don't actually need expensive high-RAM machines. Budget mini PCs costing around $500 can handle typical development tasks just as well as premium $2,000+ workstations, especially when running Linux. This is fortunate timing given the current spike in RAM prices driven by AI's resource demands.

Local LLMs are how nerds now justify a big computer they don't need

no local LLMs are how we prevent companies from stealing even more of our data

I don’t need 128GB of RAM, but I do need quite a lot. Any given day, I might be running 3 or 4 applications out of IntelliJ, plus those 3 or 4 projects, plus Slack, my notes, Arc… maybe 1 or more projects in IntelliJ and a terminal session or two.
Needless to say, I don’t think a $500 mini PC will handle that. 😜

First i was curious about the title. I wanted to know what is the arguments for this kind of header but then i was shocked about the degree of misunderstanding. What makes it even worse is that this does not come from somebody who has no clue, but from someone who should know it better.
So the first premise of his statement is: we should always give all our data to the big cloud providers and abandon all data souvereignity. Even worse if you think that he is from Denkmark an EU Country.
The second premise is: doesn’t matter if its a cake recipe or an attempt to fold proteins. You always need a frontier model for every Task. Which is completely missing the point of differentiation of complexity. No Mr. i do not need a 1.2T Parameter Model to book a table in a restaurant.
The 3rd Premise is: Developers dont need to prototype Software on their own private Hardware. They should prototype their products instantly on the cloud. Which again leads to premise 1.
I can tell you that in fact you need good hardware if you want to build an llm/agentic prototype applicaton locally.
So im wondering why such an article made it even through the gate to be considered as serious and interesting part of the newsfeed.

Meanwhile i just asked people on whatsapp if somebody has an old bad laptop they dont want anymore and now i am running Linux Mint XFCE and the code editor Zed on a machine with less cpu power than a raspberry pi and it just works 😂😂

Sounds like bro doesn’t self host 😫