Codeship10 min readintermediate
CloudBees Smart Tests Helps Leading Software Company Double Release Velocity by Saving 40K Testing Hours in One Year
Summary
The article compares several test‑intelligence products, highlighting CloudBees Smart Tests as a CI‑agnostic solution that allegedly saved a company 40 K testing hours and doubled release velocity. It also outlines the trade‑offs of coverage‑based, ML‑driven, and flaky‑test‑focused tools.
- Smart Tests integrates test selection, flaky detection, and diagnostics without requiring CI migration, positioning it as a low‑friction option.
- ML‑driven selection (e.g., Gradle Develocity) works well for JVM projects but is limited to that ecosystem.
- Coverage‑based tools (Tricentis, Datadog) can miss tests whose relevance isn’t directly tied to code changes.
- Flaky‑test quarantine (Trunk) improves reliability but does not reduce the total number of tests executed.
Engineering leaders and CI/CD teams should read this to understand the practical trade‑offs between test‑intelligence solutions and avoid costly pipeline inefficiencies.
5/10