Allen Wang: Real time events are an important data source to gain insight into our business. He says real time events need to be reliably transported to our data warehouse, Snowflake, or other online datastores with low latency for business analysis. Wang: We will talk about what stream processing framework can do for you and how you can pick one.

24m read timeFrom infoq.com
Post cover image
Table of contents
TranscriptSuccessful Patterns in Building Realtime Event ProcessingReal Time Events Use Case at DoorDashIntroducing IguazuSimplify and Optimize Event ProducingLeveraging Kafka REST ProxyProxy EnhancementsEvent Processing with FlinkRivieraEvent Format and Schema: Protocol between Producers and ConsumersData Warehouse and Data Lake IntegrationWorking Towards a Self-Serve PlatformSummaryBeyond the ArchitectureQuestions and Answers

Sort: