Skip to content

Commit 4ac402c

Browse files
authored
Clarify metric descriptions in metric-drill-down.mdx (#3745)
Updated descriptions for Cumulative and Days Since Exposure metrics to clarify their meanings and implications.
1 parent 0f825bf commit 4ac402c

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

snippets/pulse/metric-drill-down.mdx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -44,13 +44,13 @@ In this view, select and drag as needed to zoom-in on different time ranges. Th
4444
<img src="https://github.com/user-attachments/assets/f42453a6-e413-47d5-b176-bb3e9b49a915" alt="Daily metric impact visualization interface" />
4545
</Frame>
4646

47-
**Cumulative**: Shows how the aggregated metric lift and confidence intervals evolve over time.
47+
**Cumulative**: Shows the cumulative metric impact from the start of experiment over time. This is a good way to observe trends and see how your confidence interval changes over time.
4848

4949
<Frame>
5050
<img src="https://github.com/user-attachments/assets/b2e9aea9-98fb-4e29-bccf-abae356d0173" alt="Cumulative metric lift visualization interface" />
5151
</Frame>
5252

53-
**Days Since Exposure**: Shows the metric impact broken down by the number of days users have been in the experiment, which helps distinguish between novelty effects and sustained impact. For key metrics, this view also shows pre-experiment metrics to identify an differences that existed between groups even before the experiment started.
53+
**Days Since Exposure**: Shows the metric impact based on how long a user has been in the experiment. Daily data for each user is aligned by the day they entered the experiment (Day 0, Day 1, ...etc), not by calendar date. This allows you to distinguish early (novelty) from long-term effects. This view also shows pre-experiment data which identifies biases between groups before the experiment started. This can happen due to random chance or by some issue in the random assignment process.
5454

5555
<Frame>
5656
<img src="https://github.com/user-attachments/assets/17eeb054-43d8-424c-b43a-85c682bfcfb8" alt="Days since exposure metric visualization interface" />

0 commit comments

Comments
 (0)