Zed·40wWhy LLMs Can't Really Build Software — Zed's Blog
Large Language Models excel at writing code but struggle with the iterative mental modeling that defines effective software engineering. While LLMs can generate code and update it when given specific problems, they cannot maintain clear mental models of requirements versus implementation, leading to confusion when tests fail or debugging is needed. Current models suffer from context omission, recency bias, and hallucination issues that prevent them from understanding complex software systems. For non-trivial projects, human engineers must remain in control, using LLMs as tools while maintaining responsibility for requirements clarity and code verification.
