Prepare for and practice interview questions from Step.

Step Interview Questions

Step Interview Guides

<p>Let’s say that your company is running a standard control and variant AB test on a feature to increase conversion rates on the landing page. The PM checks the results and finds a .04 p-value.</p>

<p>How would you assess the validity of the result?</p>


Experiment Validity

<p>Suppose there exists a new airline named Jetco that flies domestically across North America. Jetco recently had a study commissioned that tested the boarding time of every airline, and it came out that Jetco had the fastest average boarding times of any airline.</p>

<p>What factors could have biased this result, and what would you look into?</p>


<p>What could potentially bias the average boarding time in favor of an airline that only flies domestically?</p>

What could potentially bias the average boarding time in favor of an airline that only flies domestically?

Boarding Times Bias

A new airline came out as the fastest average boarding times compared to other airlines.  What factors could have biased this result and what would you look into?

<p>You’re given a table that represents search results from searches on Facebook. The <code>query</code> column is the search term, <code>position</code> column represents each position the search result came in, and the <code>rating</code> column represents the human rating from 1 to 5 where 5 is high relevance and 1 is low relevance.</p>

<p>Each row in the <code>search_events</code> table represents a single search with the <code>has_clicked</code> column representing if a user clicked on a result or not. We have a hypothesis that the CTR is dependent on the search result rating.</p>

<p>Write a query to return data to support or disprove this hypothesis.</p>

<p><strong>Example:</strong></p>

<p><strong>Input:</strong></p>

<p><code>search_results</code> table</p>

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>query</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>result_id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>position</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>rating</code></td>
<td>INTEGER</td>
</tr>
</tbody>
</table>
<p><code>search_events</code> table</p>

<table>
<thead>
<tr>
<th>Column</th>
<th>Type</th>
</tr>
</thead>

<tbody>
<tr>
<td><code>search_id</code></td>
<td>INTEGER</td>
</tr>

<tr>
<td><code>query</code></td>
<td>VARCHAR</td>
</tr>

<tr>
<td><code>has_clicked</code></td>
<td>BOOLEAN</td>
</tr>
</tbody>
</table>


We have a hypothesis that the CTR is dependent on the search result rating. Write a query to return data to support or disprove this hypothesis.

Step Interview Questions

Step Interview Guides

Step Interview Questions

Step Salaries by Position

Step Opening Jobs