Data engineering has evolved through multiple epochs from the 1970s to today, but the core loop remains unchanged: ingest, model, transform, serve, break, rebuild. Despite shifting from SSIS and star schemas to dbt and Iceberg, data engineers still solve the same fundamental problems with different tools. The role requires

15m read timeFrom ssp.sh
Post cover image
Table of contents
The Invisible PlumbersThe Epochs: A 50-Year JourneyThe Eternal Loop: Same Problems, New ToolsWhat Actually Matters (And What Doesn’t)The Lost Art of Data ModelingThe Lost Code We InheritThe Books That Actually MatterWhat I Know Now That I Wish I Knew ThenThe Loop ContinuesThe Final Truth
1 Comment

Sort: