DuckLake is a new table format that stores metadata in relational databases (PostgreSQL, MySQL, SQLite) instead of files on blob storage like Iceberg and Delta Lake. This approach reduces metadata overhead and round trips, enabling faster query performance while maintaining ACID transactions, schema evolution, and time travel capabilities. The format stores data as Parquet files on object storage while leveraging database strengths for small, frequent metadata operations.

10m read timeFrom motherduck.com
Post cover image
Table of contents
Table Format RecapDuckLake: A New Table FormatSetting up DuckLakeCreating your first DuckLake tableWhat do you want to see in DuckLake?

Sort: