Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions docs/platform-release-notes/2025/02.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,8 @@ enhancements based on customer feedback and QA reports. Additionally,
we're excited to introduce the **beta version of our new Velocity Report**,
designed to help you track your experimentation program more effectively.

---

## Beta Feature: Velocity Report

We're introducing the
Expand All @@ -21,6 +23,8 @@ experimentation process.
would you like to see on the report? Let us know so we can improve it
together.

---

## Bug Fixes & Improvements

This release includes **50+ bug fixes and small improvements** reported by
Expand Down Expand Up @@ -51,6 +55,8 @@ our customers and QA team. Here are some key updates:
These updates enhance platform stability, performance, and usability to
make experimentation even smoother.

---

## Feedback & Next Steps

Your input is invaluable! If you have thoughts on the
Expand Down
11 changes: 10 additions & 1 deletion docs/platform-release-notes/2025/03.mdx
Original file line number Diff line number Diff line change
@@ -1,10 +1,13 @@
# March 2025

This March release focuses mainly on our reports by improving the
## Overview
This release focuses mainly on our reports by improving the
**Velocity Report** and launching the new **Decisions Report**. Both of
those reports will help you get a better overview and track your
experimentation program more effectively.

---

## Velocity Report updates

In this release we focused on improving the Velocity Report which we launched
Expand All @@ -23,6 +26,8 @@ key updates:
On as well as early stops, we renamed the **Aborted** widget to
**Not completed**.

---

## Beta Feature: Decisions Report

After the Velocity Report, we are also excited to launch the second part
Expand All @@ -43,6 +48,8 @@ past decisions.
your feedback on this first release of the Decisions Report so we can
make it right for you.

---

## Experiment Dashboard redesign

We are working on a new improved version of one of the most important
Expand All @@ -60,6 +67,8 @@ decisions.
- **What's next?** Give us your feedback below or send it to
[[email protected]](mailto:[email protected]).

---

## Feedback & Next Steps

We want to build the best possible experimentation platform for you so if
Expand Down
8 changes: 7 additions & 1 deletion docs/platform-release-notes/2025/04.mdx
Original file line number Diff line number Diff line change
@@ -1,9 +1,11 @@
# April 2025

Overview
## Overview

In this new release we mainly focused on improvement to the **Velocity **and **Decisions Reports**. All those improvements are driven by feedback we received from you so keep them coming. Here are some of the most important updates.

---

## Velocity Report

- **Aggregate data per quarter:** To help you run your quarterly experimentation reports we made it possible to aggregate the data per quarter (previously you could only aggregate per year, month or week).
Expand All @@ -12,13 +14,17 @@ In this new release we mainly focused on improvement to the **Velocity **and 

**Stay tuned**: One of the main feature requests we received for the Velocity Report is to be able to open the list of experiments in each report. We are hoping to introduce this feature in one of our upcoming releases.

---

## Decisions Report

Earlier this month we launched the new [Decisions Reports (Beta)](/docs/web-console-docs/experiment-reports/#decisions-overview). In this release we are introducing a few improvements to provide better insights into each decision.

- **Secondary & Guardrail metrics:** Like with the primary metric, you can now see the experiment results on the secondary and guardrail metrics. This helps understand the rationale behind each decision.**
- **Health checks:** We are now surfacing any [health check violations](/docs/web-console-docs/Experiment-health-checks) in the reports so you can get better insights into the quality of each decision.

---

## Feedback & Next Steps

As always we value your feedback so please share with us what you would like to see improve in the future. We have some really exciting new features coming your way in the next few releases so stay tuned.
7 changes: 7 additions & 0 deletions docs/platform-release-notes/2025/05.mdx
Original file line number Diff line number Diff line change
@@ -1,19 +1,26 @@
# May 2025

## Overview
This release focuses on backend improvements and foundational work to support future features. While there are few visible changes for you today, these updates improve platform stability and pave the way for upcoming capabilities. We still managed to squeeze a few improvements to the Velocity report and to the Experiment Dashboard redesign.

---

## Velocity Report

- **View the list of experiments:** The most requested feature request for the velocity report. You can now click on any graph on the Velocity Report to get the list of experiments included.
- **Early stop vs Early full-on:** The Experiments not completed graph now shows the breakdown between the early full-on and early stops.

---

## Experiment Dashboard Redesign

Our new Experiment Dashboard redesign is still in progress and you can see. The main reason behind this redesign is to consolidate how *Fixed Horizon* and *Group Sequential* experiments are shown and to make it easier for everyone to make quality decisions. In this release we added GST data to the metric's table. Please have a look and let us know what you think.

- **How to see it?** Within the dashboard of any existing experiment you will have a *'Load new UI'* button which will enable you to toggle between the old and the new view.
- **What’s next?** Give us your feedback below or send it to [[email protected]](mailto:[email protected]).

---

## Feedback and Next Steps

As always we value your feedback so please share with us what you would like to see improve in the future. We have some really exciting new features coming your way in the next few releases so stay tuned.
11 changes: 11 additions & 0 deletions docs/platform-release-notes/2025/06.mdx
Original file line number Diff line number Diff line change
@@ -1,7 +1,10 @@
# June 2025

## Overview
Our latest release introduces new features to support better collaboration, data access, and metric/goal discoverability. With foundational Team Management features and a faster way to download experiment data, this update sets the stage for a more streamlined and scalable experimentation experience.

---

## New Feature: Team Management (Foundations)

Teams become much more than just metadata, you can now properly define and manage teams within the platform. This update allows you to map your internal organizational structure directly into the product by:
Expand All @@ -12,6 +15,8 @@ Teams become much more than just metadata, you can now properly define and manag

This is the first step toward upcoming improvements around ownership, permissions, and team-level collaboration. Go to `Settings > Teams` to get started with managing your team and inviting your team members. If you already have teams defined in ABsmartly, you can simply move them to the right place in your org structure. Check our [wiki page](/docs/web-console-docs/creating-and-managing-teams) for more information on creating and managing teams in ABsmartly.

---

## New Feature: One-Click Experiment Data Export

We added an **Export data** button to the experiment overview page, allowing you to export participant exposures and goal event data for that experiment with a single click.
Expand All @@ -29,17 +34,23 @@ We added an **Export data** button to the experiment overview page, allowing you

Only users with the Events:List permissions will be able to trigger the export and download the file.

---

## Improved Metrics & Goals List Pages

Finding the right metrics and goals just got easier. We've enhanced the list pages to:

- Improve searchability and filtering (archived vs unarchived)
- Help you quickly identify and select the metrics and goals that matter

---

## Other Fixes & Improvements

This release also includes several smaller enhancements and bug fixes to improve overall platform stability and performance.

---

## Feedback and Next Steps

As always we value your feedback so please share with us what you would like to see improve in the future. We want to build the right product for you so [reach out to us](mailto:[email protected]) if you want to discuss our roadmap or your specific needs.
37 changes: 37 additions & 0 deletions docs/platform-release-notes/2025/07.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@
# July 2025

## Overview
This release introduces a brand-new notification system to help teams stay on top of what matters, along with the official launch of the improved Metrics Overview tab.
These updates are designed to make your workflow more informed, timely, and collaborative.

---

## New Feature: Built-In Notifications
Never miss a key event again. Our new built-in notification system ensures you're always up to date with what's happening on the platform.

- **Team assignments**: Get notified when you're added/removed to a team
- **Experiment/feature lifecycle updates**: Get alerts when an experiment starts, stops, is put full-on or when a feature is turned on/off.

More alert types will be added in upcoming releases — stay tuned!

---

## New Feature: Impact per Day Estimates
We've added a new **Impact per Day estimates** on all relevant metric type inside the experiment overview to help you better understand the real-world significance of your experiment results.
This gives you a clearer picture of the **daily impact** your changes could have when rolled out, making it easier to evaluate their practical value.

---

## Metrics Overview Tab Out of Beta
Thanks to all your feedback, the new Metrics Overview tab is now officially out of beta.

- Cleaner layout and better tooltips and timestamps
- Consolidation of GST and Fixed Horizon experiment results in a single table
- Display impact per day for all relevant metrics
- More actionable information at a glance

These changes are designed to help you make faster, more informed decisions when reviewing experiment results.

---

Let us know if you have any questions or if you would like to discuss future features with us.
Original file line number Diff line number Diff line change
Expand Up @@ -97,7 +97,7 @@ Group Sequential Testing, makes it easy to visually interpret results. The graph

---
### Interpreting the Boundaries
1. **Efficiency Boundary (Green)**:
1. **Efficacy Boundary (Green)**:
- Crossing this boundary means there is enough evidence to conclude the variant performs significantly better than the baseline.
- The experiment can be stopped early, and the variant can be considered successful.

Expand Down
2 changes: 1 addition & 1 deletion docs/web-console-docs/events.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ code and the Web Console. To access it, select `Events` from the sidebar and
choose `All`.

:::info
If you want to **export ALL the exposure and goal events for a single experiment**, you can do it directly from the experiment overview page by clicking on the ... menu and seleting **Export data**.
If you want to **export ALL the exposure and goal events for a single experiment**, you can do it directly from the experiment overview page by clicking on the ... menu and selecting **Export data**.
:::

## The Events List
Expand Down