Interview Query

Sample Size Bias

Start Timer

0:00:00

Upvote
11
Downvote
Save question
Mark as completed
View comments (54)

Let’s say you have to analyze the results of an AB test.

One variant of the AB test has a sample size of 50K users and the other has a sample size of 200K users.

Given the unbalanced size between the two groups, can you determine if the test will result in bias towards the smaller group?

.
.
.
.
.
Topic
A/B Testing & Experimentation
Tags
A/B Testing
Data Analysis
Design of Experiments
Null Hypothesis Significance Testing
Power of a Test
Category
Case Study
Position
Data Scientist
Business Analyst
AI Research Scientist
Business Intelligence
Marketing Analyst
Product Analyst
Product Manager
Difficulty
Medium
Success
N/A
Last asked
This question was asked on March 2, 2025
Companies
What did you think?
A/B Testing Common Scenarios

This question is a part of the course:

A/B Testing Common Scenarios
Learn more about course


Comments