Skip to content

Flaky Tests

A flaky test is one that produces different results (pass/fail) across runs without any code changes. Drape automatically detects flaky tests by analyzing test result history.

Detection

Drape identifies flaky tests by looking at test results across multiple commits and runs:

  • A test that passes on one run and fails on another for the same commit is flaky
  • A test that alternates between passing and failing across recent commits (with no related code changes) is flaky

Impact

Flaky tests erode trust in your test suite. When developers can't trust test results, they start ignoring failures — which means real bugs slip through.

What Drape Shows You

  • Flaky test list — all tests identified as flaky, with their flakiness rate
  • History — when the test started being flaky and how often it flips
  • Suppression integration — flaky tests can be suppressed to unblock CI while you investigate