Detect user experience degradations with our newly released RUM agent
Split manages more than 50 billion feature flags changes around the world every day. A recent study shows that about 5 to 6% of feature flags are rolled-back (or killed, using Split terminology in reference to a kill switch) within 30 days of being created. This speaks to the importance of making data available for short-term feature decisions, especially those that impact core KPIs.
The majority of our customers rely on external systems like APM services and integrations to other analytics systems to understand how a feature change impacts an area of their application they care about.
At Split we believe that feature flags are incomplete without data and so we worked hard over the last few months to create a real user monitoring (RUM) agent to provide insights into how a website’s key indicators are impacted immediately after a feature release. We paired this with our statistics engine to create alerts, even if only a subset of users experience a degradation from the baseline.
Website metrics captured
When Split RUM agent is installed on a website, our customers will be able to automatically receive five different metrics: page.load.time, time.to.first.byte, time.to.interactive, time.to.dom.interactive and errors.
All these metrics are available in our metrics section to allow customers to define custom metrics that better suit their application and on which to be alerted on when a feature is released.
Split will then compare the features each user is exposed to with each user’s metrics (like page.load.time) in order to determine which feature in your release is good, and which is rotten.
Similar to our recently released Sentry integration, by measuring these metrics in Split, our customers will now be able to get automatic feedback whenever a newly released feature causes a degradation for a subset of users for any of these metrics, and be alerted to take remedial action.
Roadmap
Our team is working hard to prioritize the next set of features for our RUM agent. Among them we have mobile support, new metrics like bounce rate, single page app (SPA) support and the ability to attach properties to the metrics from the RUM agent for allowing a more in depth analysis. As always, we’d love to hear your thoughts!
Getting started
Ready to test this out? Visit our documentation and give our RUM agent a try. Don’t yet have a Split account? No worries, sign up here to get started!
Stay up to date
Don’t miss out! Subscribe to our digest to get the latest about feature flags, continuous delivery, experimentation, and more.
Related posts
Respond quickly to degradations in metrics with alert policies
At Split we believe in the power of metrics, and are always striving to improve the ways we help our users make more data-driven product decisions. In this previous post we talked about the importance of understanding the impact of a new feature release via key and guardrail metrics. With…
Find which feature caused an error with our new Sentry Integration
When we speak to our customers, one of the most common reasons they say they made the move towards feature flags was the need to make sure their releases didn’t cause more errors for their users. By leveraging feature flags to ramp the release of their features to just small…
Release Safer with Feature Monitoring
Find faulty features before your customers do One of the most common reasons, our customers tell us, for moving towards feature flags is risk mitigation: the need to make sure releases don’t cause errors for users. Given how frequently organizations are now deploying features, the ability to limit the blast…
Ready to get started?
Start using Split for free today. No credit card required.