About BuildPulse
Almost every engineering team eventually experiences flaky tests. Martin Fowler sums up the problem nicely:
"[Flaky tests] are a virulent infection that can completely ruin your entire test suite. As a result they need to be dealt with as soon as you can, before your entire deployment pipeline is compromised." - Martin Fowler
As your product grows in complexity, so too does testing complexity. Ignoring this complexity can cause test assumptions to break and appear unstable. For a company, this can dramatically affect product stability and release velocity. BuildPulse helps you find and fix flaky tests.
Your product is only as stable and predictable as your tests.
Product
We provide an end-to-end solution to detect flaky tests, give you metrics on productivity and stability, and track progress over time.
We provide:
- Time consumed by flaky tests across various time windows
- Flaky test history
- Advanced reporting
- PR bots
- API access
Getting Started
There are 2 steps to enabling BuildPulse for your product.
Exporting a JUnit XML report from your testing framework
Enable BuildPulse CI integrations or the test-reporter to upload results to BuildPulse
See the Getting Started guide for more info.
Our Approach
BuildPulse determines that a tests is unstable when we observe a test failure and success for the same code. We determine if code has changed by comparing the git tree SHA against previous builds.
Security
We only require your test results and various metadata such as git commit and tree SHAs.
We currently don't require access to source code or any PII.