Atlassian built Flakinator, a platform-agnostic tool that detects and manages flaky tests across their monorepo. The system ingests CI data from 350+ million daily test executions, uses retry-based and Bayesian inference algorithms to identify flaky tests, automatically quarantines them, and notifies teams via Jira tickets and Slack. Since deployment across 12 products, it has recovered over 22,000 builds, identified 7,000 unique flaky tests, reduced costs, and improved build reliability by preventing failures caused by non-deterministic test behavior.

10m read timeFrom atlassian.com
Post cover image
Table of contents
Hidden Cost of Flaky Tests?Why is it a Big Deal?Flakinator introducing FlakinatorResults and ImpactLessons LearnedFuture Plans

Sort: