October 30th, 2020

Statistics

  • Multiple Comparison Correction
    You can now apply a statistical correction to control the False Discovery Rate when making multiple comparisons in the same experiment. The significance threshold setting can be adjusted to higher or lower confidence. Using the default significance threshold of 5%, you can be confident that at least 95% of all the statistically significant metrics you see reflect meaningful detected impacts. This guarantee applies regardless of how many metrics you have.

September 8th, 2020

Management Console

  • Data export
    A new “Data Exports” tab is located within the Data Hub, where you will be able to create and download (CSV) exports for impressions and events for up to 90 days worth of data. Your organization can run 5 reports per day, and will also be able to access previously generated data exports for up to 7 days after their creation date.

August 18th, 2020

Statistics

  • Welch’s T-Test
    Statistical results in Split are now calculated using Welch’s T-Test. Unlike the more commonly used Student’s T-Test, Welch’s T-Test does not assume that the samples have equal variances. This makes the Welch approach more accurate in cases where there is both a difference between the variances of the samples and an unequal rollout plan, e.g. 5% on, 95% off.

August 17th, 2020

SDK Enhancements

  • Filter splits
    You can now filter split definitions by name to specify which ones are downloaded to the SDK from a given environment. This is particularly helpful for client side SDKs because it allows you to only select the subset of splits that are used for a specific application.

June 23rd, 2020

Management Console

  • Live tail
    The live tail functionality within the Data hub gives you a single place to view and query all of your impressions and your event data. You will be able to filter this data by a variety of dimensions so you can easily find data that is important to you.