Prepare for and practice interview questions from Evidera.

Evidera Interview Questions

Evidera Interview Guides

Let’s say that your company is running a standard control and variant AB test on a feature to increase conversion rates on the landing page. The PM checks the results and finds a .04 p-value.

How would you assess the validity of the result?

Experiment Validity

In an A/B test, how can you check if assignment to the various buckets was truly random?

In an A/B test, which of the following is a common method to determine if the assignment to the test groups was truly random?

In an A/B test, which of the following is a common method to determine if the assignment to the test groups was truly random?

Random Bucketing

Suppose there exists a new airline named Jetco that flies domestically across North America. Jetco recently had a study commissioned that tested the boarding time of every airline, and it came out that Jetco had the fastest average boarding times of any airline.

What factors could have biased this result, and what would you look into?

What could potentially bias the average boarding time in favor of an airline that only flies domestically?

What could potentially bias the average boarding time in favor of an airline that only flies domestically?

Boarding Times Bias

A new airline came out as the fastest average boarding times compared to other airlines.  What factors could have biased this result and what would you look into?

Evidera Interview Questions

Evidera Interview Guides

Evidera Interview Questions

Evidera Salaries by Position

Evidera Opening Jobs