This section demonstrates ETL operations using a JDBC connection and sample CSV data from the Commodity Flow Survey (CFS) open dataset published on the United States Census Bureau site. The example…

AWSTip offers tips, best practices, and insights for leveraging Amazon Web Services (AWS) effectively, covering topics such as cloud architecture, cost optimization, and security on AWS. Users can learn about AWS services, features, and deployment strategies to optimize their cloud infrastructure and maximize the benefits of AWS services.

AWS Tip

This post demonstrates how to perform ETL operations using a JDBC connection in AWS Glue. It includes steps to load CSV data from an S3 bucket to an on-premises PostgreSQL database and to transform the data from the PostgreSQL database to Parquet format.

Perform ETL in AWS Glue using the JDBC connection

Part 1: An AWS Glue ETL job loads CSV data from an S3 bucket to an on-premises PostgreSQL database

Part 2: An AWS Glue ETL job transforms the data from an on-premises PostgreSQL database to Parquet format