This project automates the process of collecting, storing, and analyzing football data using technologies like Apache Airflow, DBT Cloud, and AWS. The workflow includes web scraping data using Python, storing it in Amazon S3, processing it in Amazon Redshift, transforming data with DBT Cloud, and visualizing it through Amazon QuickSight. This integrated approach offers a scalable solution to manage and analyze detailed football statistics efficiently.
Table of contents
IntroductionCreate AWS Integration with Apache AirflowCreate DAGs for Extract and Load ProcessTransforming Raw Data into Insights with Dbt CloudCreating a Dashboard with Amazon QuickSightSort: