Data Engineering Blog

Explores data architecture patterns and their influence on data modeling, covering general patterns like medallion architecture (bronze/silver/gold layers) and specialized patterns including batch vs streaming, data lake vs warehouse, and semantic layers. Reviews data modeling tools from commercial options like SAP PowerDesigner to open-source alternatives like MySQL Workbench, discusses AI's role in data modeling, and introduces frameworks like ADAPT and BEAM for structured data model creation. Emphasizes that while AI can assist with schema generation, human expertise remains essential for understanding business semantics and domain knowledge in data modeling decisions.

Data Modeling - The Unsung Hero of Data Engineering: Architecture Pattern, Tools and the Future (Part 3)

Data Architecture Pattern with Data Modeling

General Purpose Data Architecture Pattern (Medallion, Core, etc.)