Pinterest's Test Tools team reduced Android end-to-end testing build times by 36% (9 minutes) by replacing Firebase Test Lab with an in-house testing platform called PinTestLab. They implemented runtime-aware test sharding using historical duration data and a greedy allocation algorithm (Longest Processing Time rule) to
•15m read time• From medium.com
Table of contents
TL;DRIntroductionWhy Build an In-House Testing Platform?The Challenges Encountered with FTLEvaluating the Market for an AlternativeThe Decision to Build A Path to Deeper InnovationInfrastructure and Resource AllocationHow We Ran Tests Before, and Why We ChangedThe Goal: Equal Wall‑Time, Not Equal Number of TestsWhy “Sort + Round‑Robin” Still FailsThe Insight We Shipped: Runtime‑Aware ShardingGet Pinterest Engineering’s stories in your inboxExpanding Beyond Post CommitOther Options Considered: On‑Demand ShardingHow It Would Work at a High LevelTrade‑Offs and DecisionReflectionsWinsLearnsFuture Enhancements and ExpansionAcknowledgementJoin the ConversationSort: