Establish a known-good baseline
Keep a successful run with a controlled scenario, traffic model, environment, and thresholds as the comparison point for future releases.
Turn repeatable load tests into a performance regression signal. Compare releases against a stable baseline, enforce latency and error budgets, and notify the team when performance drifts even if the application still “works.”
Pin the environment and workload before comparing builds.
Track the size and direction of latency/throughput changes.
Ignore fluctuations smaller than your repeatability envelope.
Many regressions are too small to cause an outage on the day they ship. A query adds 40 ms, a cache hit rate slips, an extra downstream call appears, and months later the system has lost most of its headroom. Regression testing catches that drift by repeating the same workload and comparing today’s result with a trusted reference.
Keep a successful run with a controlled scenario, traffic model, environment, and thresholds as the comparison point for future releases.
A run can violate an absolute p95 budget, regress meaningfully versus baseline, or both. Track both signals so slow drift does not hide below a generous ceiling.
Regression detection depends on repeatability. Keep request mix, test data, pacing, duration, and load profile as consistent as practical.
Run checks after deployments, before release promotion, or on a schedule so the team can associate a change in performance with a change in the system.
Use regression notifications, Slack or email alerts, and shared result links so a performance change becomes visible to the people who can act on it.
Catching small regressions early protects future headroom and reduces the chance that several individually acceptable changes combine into a larger performance problem.
A regression comparison is only credible when the setup stays controlled. Preserve the scenario, environment class, dataset, warm-up, and measurement window so the measured delta belongs to the build.
Use a run from a stable environment and a known-good release. Record the scenario, load profile, and relevant system conditions.
Set absolute thresholds and decide what relative change is meaningful enough to investigate.
Use the same workload and target environment class. Large environment differences can overwhelm the code-level signal you are trying to measure.
Review current latency, failures, throughput, and run-to-run deltas before a risky release reaches more users.
Update the baseline when the system has materially improved or the workload has legitimately changed. Do not silently normalize a regression by replacing the baseline after every run.
LoadTester combines repeatable test definitions, run comparison, thresholds, scheduled tests, CI/CD integration, and regression notifications so teams can move from occasional benchmarking to continuous performance awareness.
Read the release regression guide for baselines, comparison rules, thresholds, and rollout patterns.
Open the supporting guide →It is the practice of repeating a representative performance test and comparing the result against a previous known-good state. The goal is to detect slower latency, higher errors, lower throughput, or lost capacity introduced by change.
Use a stable run from a known-good release under comparable environment and workload conditions. The baseline should be intentional and documented, not simply the most recent run.
There is no universal percentage. Choose a limit based on measurement noise, user impact, and available performance headroom. Pair relative regression limits with absolute latency and error budgets.
Yes. Scheduled tests are useful for detecting drift even when no single deployment is suspected. CI/CD checks are useful for associating a regression closely with a release.
Establish the first repeatable baseline on the free plan, then automate the same comparison once the team knows which deltas are actionable.