Glossary

What is Continuous Integration, and Why You Need It Now

As a software development team increases in size and the functionality becomes increasingly complex, it becomes more important to frequently verify the integrity of the product build. Many development and QA professionals have come to realize that some degree of automation is the only feasible approach to effectively manage frequent…

Reduce Risk in Your Database Migration

What comes to your mind when you think of feature flags? If you’ve heard of them, you probably think of them in the context of turning on and off new features. But feature flags have back-end use cases too – including but not limited to reducing risk in database migrations.…

Migrate from Monolith to Microservices with Feature Flags

Monoliths – the type of application where all its code is in one single codebase – are extremely common. Just about every application begins as a monolith, in some way or another. However, there is a major problem with monoliths: they make users depend on code that they aren’t using.…

What is False Positive Rate?

False positive rate (FPR) is a measure of accuracy for a test: be it a medical diagnostic test, a machine learning model, or something else. In technical terms, the false positive rate is defined as the probability of falsely rejecting the null hypothesis. False Positive Definition Imagine you have an…

Testing in Production

Testing in production is the process of testing your features in the environment that your features will live in. It does not mean releasing untested code to users and hoping it works, but rather using feature flags to test the different treatments. This is best implemented in addition to pre-production…

Why Get Feature Flags as a Service?

“We do software development, we should build our own solution” and “if someone has already built it, why reinvent the wheel” are two common, conflicting solutions to many software problems. We call this the “build vs buy” question. The idea of feature flags as a service is moving feature flags…

Client Side Testing

Client-side testing refers to any type of testing – commonly A/B testing, but also multivariate testing or multi-armed-bandit testing – that occurs in the user’s browser. This is contrasted with server-side testing, where the test cases are decided on the back-end (in the web server) before they’re served to the…

Server Side Testing

Server-side testing refers to any type of testing – commonly A/B testing, but also multivariate testing or multi-armed bandit testing – that occurs on the web server instead of in the user’s browser. This is contrasted with client-side testing, where the test cases are rendered (typically using some type of…

What is Statistical Significance?

When people discuss A/B testing, they commonly throw around the term “statistical significance” a lot. But what does this mean? In short, getting a statistically significant result means that the result is highly unlikely to be the product of random noise in the data, and more likely to be the…

Dark Launch

Dark launching is the term for releasing features to a subset of your users, seeing how they respond, and making updates to your features accordingly. It’s somewhat like what every project manager does to monitor application health, but focused entirely on a single new feature. In this modern age of…