DuckDB combines the simplicity and ease of use of SQLite with the analytical performance of specialized columnar databases. Learn more with Python examples.

KDnuggets is a leading resource for data scientists, machine learning engineers, and AI practitioners, offering news, tutorials, and insights on data science, machine learning, and artificial intelligence. With a focus on practical applications and real-world use cases, KDnuggets provides resources for learning data science techniques, exploring machine learning algorithms, and staying updated on the latest trends and advancements in the field.

KDnuggets

DuckDB combines the simplicity and ease of use of SQLite with the analytical performance of specialized columnar databases. DuckDB is free and open-source software, so anyone can use and modify the code. It's embedded, meaning the DBMS ( database management system) runs in the same process as the application that uses it.

Why is DuckDB Getting Popular?

If you wanna roll your own stuff locally, it’s definitely the way to go, saves you a lot of time. Doesn’t necessarily scale, but doesn’t need to in most cases.

I like the features it can Processing and storing tabular datasets, e.g. from CSV or Parquet files

I use Supabase. I find Supabase has all the features I need

Does anyone know if DuckDB supports reading from a saved local db, but then functioning solely in memory (e.g. for use in a serverless type environment where local saving makes no sense) ?