Bellweather Plugin Testing Suite (BPTS)
Each release has a named qualification profile. Required checks must pass for the exact version being released, and the product's Validation Notes record what was actually run.
What is BPTS?
BPTS (Bellweather Plugin Testing Suite) is our custom testing framework built on industry-standard tools: Catch2 for unit tests via CTest, Pluginval for VST validation, and our own BOL (Bellweather Observation Lab) for characterization testing.
The available lanes cover rapid parameter changes, extreme values, thread race conditions, and deliberately injected faults. A product's release profile selects the checks that apply to that version.
Release Lanes
Every commit runs through automated release lanes in CI/CD. Each lane gates progressively more of the test suite:
Core Test Types
Category 5 Stress Tests →
A reusable stress lane for RT-safety, parameter mutations, memory behavior, and audio-artifact detection.
The Gauntlet™ →
A high-density automation stress lane with 1 million randomized parameter changes. Published results apply only to the tested product version and configuration.
Mutation Testing →
Intentionally inject bugs to verify our tests actually work. How we continuously strengthen detection coverage.
BOL Characterization →
Bellweather Observation Lab. Transfer curves, THD analysis, and envelope timing verification.
Why This Matters
We publish our testing methodology because engineering rigor is built on evidence, not claims.
Every test in BPTS exists because something broke in the past. We learned the hard way that you can't ship quality without rigorous testing.
If you find a bug our tests missed, we want to know. That's how we improve the framework for future plugins.