Expedia Group built a real-time A/B test monitoring system called EGTnL Circuit Breaker using Apache Flink to prevent revenue loss from poorly performing experiments. The system addresses the critical gap in monitoring during the first 24 hours of an experiment by aggregating user exposures and metrics in real-time, handling
Table of contents
Preventing Revenue Loss With Real-Time A/B Test MonitoringWhy real-time A/B testing mattersBreaking down A/B test monitoringExperimentation science: key conceptsDesign goals and technical requirementsNonstandard streaming aggregation problemSolution architectureAreas for improvementBusiness outcomesLearn MoreSort: