← All questions
Metricsstandard
Daily active users on a messaging app dropped 10% week over week. How would you investigate?
How to approach it
Before guessing causes, check whether the drop is real: data pipeline, definition changes, and seasonality.
How a strong answer opens
“Before I look for causes, I want to know the drop is real. Has anything changed in logging or in how we define a daily user, and how big is a normal weekly swing?”
Outline of a strong answer
Try answering out loud for a few minutes before you open this.
- Confirm the data: logging changes, dashboard bugs, definition changes
- Check timing: sudden or gradual, holiday or event
- Segment: platform, country, app version, new versus existing users
- Look at internal causes: releases, outages, notification changes
- Look at external causes: competitor launch, app store issues, news
- Form a hypothesis, test it, and propose a fix with an owner
Where this question usually goes wrong
Brainstorming twenty causes before checking the data, the timing and where the drop is concentrated.
Learn the method
Diagnosing a metric drop in Module 2, Metrics and execution.
The full kit has worked answers in full, start to finish, for every round type. $129 once.
More metrics questions
- Uber trips in one city fell 15% yesterday. What do you do?
- Checkout conversion on an e-commerce site dropped after a release. Walk me through your diagnosis.
- Sign-ups for a SaaS free trial doubled overnight. Is that good news?
- Average session length on YouTube went up, but daily active users went down. What's happening?
- Food delivery orders are flat, but average delivery time rose by 8 minutes. How do you dig in?