Marco shows how you can combine pg_partman and pg_cron on Bridge for Analytics to set up automated time-partitioning with long-term retention and fast analytics in your data lake.

CrunchyData's platform is a central hub for PostgreSQL professionals and database administrators, offering insights into PostgreSQL deployment, administration, and optimization. Through articles, tutorials, and case studies, CrunchyData offers insights into PostgreSQL features, replication strategies, and high availability architectures. Readers can learn about database performance tuning, backup and recovery procedures, and security best practices to ensure the reliability and security of their PostgreSQL deployments.

Crunchy Data

Bridge for Analytics is a hybrid database system that provides solutions for dealing with large data volumes in PostgreSQL. It allows for easy data copying and transformation into a data lake for cheaper storage and efficient analytical queries. Time-partitioned tables and compressed Parquet files in S3 are used to optimize performance. The process includes setting up partitioned tables, copying data into an analytics table, and running fast analytical queries on historical data.

Syncing Postgres Partitions to Your Data Lake...

Setting up a time-partitioned table for fast writes and lookup queries

Copying data into a lake analytics table for cheap storage and fast analytics

Running fast analytical queries on our historical data

Get started with Crunchy Bridge for Analytics