Prepare for and practice interview questions from Calance.

Calance Interview Questions

Calance Interview Guides

You are testing hundreds of hypotheses with many t-tests. What considerations should be made?

What is a key disadvantage of the F-test when compared to multiple t-tests?

What is a key disadvantage of the F-test when compared to multiple t-tests?

Hundreds of Hypotheses

You are testing hundreds of hypotheses with many t-tests. What considerations should be made?

Let’s say that your company is running a standard control and variant AB test on a feature to increase conversion rates on the landing page. The PM checks the results and finds a .04 p-value.

How would you assess the validity of the result?

Experiment Validity

Let’s say you work for a social media company that has just done a launch in a new city. Looking at weekly metrics, you see a slow decrease in the average number of comments per user from January to March in this city.

The company has been consistently growing new users in the city from January to March.

What are some reasons why the average number of comments per user would be decreasing and what metrics would you look into?

What metric could be used to measure if active users are still engaging on the platform despite an overall decrease in the average number of comments per user?

What metric could be used to measure if active users are still engaging on the platform despite an overall decrease in the average number of comments per user?

Decreasing Comments

How would you investigate a decline in the average number of comments per user?

Calance Interview Questions

Calance Interview Guides

Calance Interview Questions

Calance Salaries by Position

Calance Opening Jobs