Interview Query

New UI Effect

Start Timer

0:00:00

Upvote
10
Downvote
Save question
Mark as completed
View comments (19)
Next question

Let’s say we’re testing a new UI with the goal to increase conversion rates. We test it by giving the new UI to a random subset of users.

The test variant wins by 5% on the target metric. What would you expect to happen after the new UI is applied to all users? Will the metric actually go up by ~5%, more, or less?

Note: Assume there is no novelty effect.

.
.
.
.
.
A/B Testing & Experiment Design

This question is a part of the course:

A/B Testing & Experiment Design
Learn more about course


Comments

Loading comments.