Interview Query
Back to Statistics & AB Testing Interview
Statistics & AB Testing Interview

Statistics & AB Testing Interview

42 of 77 Completed

Overview

2m read

Multiple Comparisons

4m read

Debugging A/B Tests

4m read

Holdback Effects

3m read

Cannibalization

3m read

Non-Normal A/B Testing

Question

Random Bucketing

Question

Sample Size Bias

Question

Twenty Variants

Question

Twenty Variants
Go to question details page

Let’s say your manager is running A/B tests on a website. You find out that your manager has run an A/B test with 20 different variants and come back to you that one of the variants is significant.

Would you think there was anything fishy about the results?

Sample Size Bias
When you shouldn't A/B test
Good job, keep it up!

54%

Completed

You have 35 sections remaining on this learning path.

Advance your learning journey! Go Premium and unlock 40+ hours of specialized content.

Log in
Sign up