A treatment is the version of the UI (user interface) that the user sees. You can set a treatment in the UI to be on or off.
A t-test is a type of hypothesis test which assumes the test statistic follows the t-distribution. It is determines if there is a statistically significant difference between two groups.
Type I Error
A type I error is a type of statistical error where the test gives a false positive result, when a perfect test would report a negative.
Type II Error
A type II error is one of two statistical errors that can result from a hypothesis test. A type II error occurs when a false null hypothesis is accepted.
Trunk-based development (TBD) is a branching model for software development where developers merge every new feature, bug fix, or other code change to one central …
Testing in Production
To test in production means continuing to test features after they have been deployed to production by using staging to test your features.