Interview Query

Twenty Variants

Start Timer

0:00:00

Upvote
13
Downvote
Save question
Mark as completed
View comments (31)

Let’s say your manager is running A/B tests on a website. You find out that your manager has run an A/B test with 20 different variants and come back to you that one of the variants is significant.

Would you think there was anything fishy about the results?

.
.
.
.
.
Topic
A/B Testing & Experimentation
Tags
A/B Testing
Probability
Bonferroni Correction
Statistical Significance
Null Hypothesis Significance Testing
Multiple Comparisons Problem
Category
Case Study
Position
Data Scientist
Marketing Analyst
AI Research Scientist
Business Intelligence
Product Analyst
Product Manager
Difficulty
Easy
Success
N/A
Last asked
This question was asked on August 2, 2023
Companies
What did you think?
A/B Testing Common Scenarios

This question is a part of the course:

A/B Testing Common Scenarios
Learn more about course


Comments