Learn how to build real-time, event-driven data pipelines directly from your object storage with Amazon SQS and S3.

Redpanda

Learn how to build automated, event-driven data pipelines by configuring S3 to send notifications to SQS when new objects are created, then using Redpanda Connect to listen to the queue and automatically process uploaded files. This tutorial walks through setting up S3 event notifications, configuring Redpanda Connect to poll SQS, and parsing event messages to fetch and process S3 objects in real-time without manual intervention.

Building event-driven pipelines with SQS and S3

Building event-driven pipelines with SQS and S3 #