Community Picks

This post presents a benchmark comparing the performance of DuckDB and Polars, two data tools. Polars outperforms DuckDB in reading CSV files and executing window functions, while DuckDB is faster in join operations. The performance of both tools is similar overall.

DuckDB vs Polars — Which One Is Faster?

Medium

The post describes the author's experience with DuckDB, a database for processing large volumes of data locally. It covers the problem of processing logs of Brazilian electronic ballot boxes and the challenges involved. The post explains the features and advantages of DuckDB and provides a step-by-step implementation of data processing. It concludes with the author's evaluation of DuckDB's performance and usability.

My First Billion (of Rows) in DuckDB

This post discusses the combination of DuckDB and Apache Arrow technologies in building an analytics platform. It highlights the features and benefits of DuckDB and Apache Arrow, as well as how they are used together. The post also mentions future steps such as pre-aggregations and data federation.

DuckDB Meets Apache Arrow

DuckDB is an open-source, embeddable SQL database engine designed for analytical and data science workloads in Python, R, and other programming languages. It provides features such as columnar storage, vectorized query execution, and multi-threaded processing for efficient query performance and scalability. Readers can explore DuckDB's features, integrations, and use cases for interactive data analysis, data visualization, and machine learning applications, leveraging its lightweight and fast SQL engine for handling large datasets in memory-constrained environments.

Best of DuckDB — May 2024