How Daily Activity Tracking Helps You Prove Real Engagement in a Closed Test

Play Console can tell you that 12 testers opted in. It does not tell you whether they opened your app on day 6, or whether anyone got past the login screen on day 9. Daily activity tracking fills that gap. It gives you a record of what happened during the 14 days, so you can fix problems while the test is still running and describe the test accurately afterward.
Opt-in is not the same as engagement
The closed testing requirement for new personal developer accounts is about testers staying opted in for 14 days in a row. That is the number Play Console counts. But a tester can stay opted in without ever launching your app again. Opt-in is a membership status. It says nothing about use.
This matters for two reasons:
- You can't improve what you can't see. If half your testers went quiet after day 2, you want to know on day 3, not after the test ends.
- You may need to explain the test. When you apply for production access, Play Console asks questions about your testing. Vague answers like "testers used the app" are weaker than answers backed by your own records. Exact questions and requirements change, so check Play Console Help for the current wording.
What "real engagement" looks like in data
You don't need a complicated analytics setup. A few simple signals tell most of the story.
Daily active testers
How many distinct testers opened the app each day. This is the most useful number. A flat line across 14 days looks very different from a spike on day 1 followed by silence.
Session length
A tester who opens the app for five seconds and closes it hasn't tested anything. If you expect people to spend around 20 minutes a day exploring (which is what TesterMob testers are asked to do), session length shows whether that is happening.
Screens and features reached
Do testers get past onboarding? Do they reach settings, checkout, or the core feature? Counting screen views or key actions shows whether the whole app is being exercised or only the first screen.
Crashes and errors per day
Real use on real devices produces real problems. Crashes and ANRs that appear in Android vitals or your crash reporter are evidence that people are using the app on varied hardware. They are also your to-do list.
Ways to collect daily activity
There are a few options. Use whichever fits your project.
- An analytics library you already use. Firebase Analytics or a similar tool will show daily active users and screen views. You probably have this in your app already.
- Your own lightweight logging. A simple event sent to your backend on app open and on key actions. Fine if you already have a server.
- Tester-side activity from TesterMob. If you use TesterMob, there is an optional Android SDK (an
.aarfile) that shows daily tester activity in your developer dashboard. It is optional, so the test works without it. See the documents page for setup details. - Crash reporting. Crashlytics or Play Console's own crash data complements usage data.
Whatever you pick, add it to the build you upload to the closed track, and check it works on a real device before testers arrive. Discovering on day 8 that your analytics never initialised is a common and avoidable mistake.
A simple daily routine
Tracking only helps if you look at it. Five minutes a day is enough:
- Check how many testers were active yesterday compared with the day before.
- Look for anyone who has gone quiet for two days or more.
- Scan new crashes and errors.
- Read any written feedback that arrived.
- Write one line in a notes file: what you saw and what you'll do about it.
That last step is easy to skip and worth keeping. By day 14 you have a short, dated log that reflects what actually happened.
What to do when activity drops
If activity falls off, don't assume the testers are the problem. Check these first:
- Is there a crash on launch for a specific Android version or device?
- Does the app need a login that some testers can't complete?
- Is something blocking progress, such as a feature that needs a server that is down?
- Did the testers understand what you wanted them to try?
Often the data points directly at a bug or a confusing step. Fixing it and shipping an update is more useful than sending a general reminder.
Using your activity record when you apply for production
When you answer questions about your testing, your records give you something specific to say. For example, you can describe how many testers were active across the period, what kinds of problems they hit, and what you changed because of it. Keep the answer factual and in your own words.
A few cautions:
- Don't inflate numbers. Report what your data shows, including quiet days. An honest answer with some gaps is better than a polished one that isn't true.
- Don't treat data as a guarantee. Google makes the production access decision, and no tracking tool or testing service, TesterMob included, can guarantee approval.
- Stay current. Google Play's requirements and review questions change. Check Play Console Help for the latest.
Privacy: track activity, not people
You only need to know that a tester used the app, not who they are in the real world. A few good habits:
- Don't collect names, emails, or device identifiers beyond what you need.
- Use anonymous or app-scoped IDs where you can.
- Update your privacy policy and your Data safety form so they match what the build collects. Any analytics or crash SDK you add counts.
- Remember that the test build is the same app you plan to release. Whatever tracking you add may need to stay, or be removed deliberately before production.
What activity tracking can't do
Numbers show that people used the app. They don't show whether the experience was good. Pair the activity data with written feedback: what confused people, what felt slow, what they expected but didn't find. Activity tells you where to look, and feedback tells you why.
It also doesn't replace a sound app. If the store listing, data safety declarations, or content rating have problems, a clean activity log won't fix them.
A short checklist
- Add analytics or the optional SDK to the closed-track build before testers join.
- Verify events arrive from a real device on day 0.
- Check daily active testers, session length, key screens, and crashes each day.
- Log one line of notes per day.
- Fix and update when the data shows a blocker.
- Keep privacy policy and Data safety answers in sync with what you collect.
- Describe the test accurately when answering production access questions.
If you'd like testers on real Android phones using your app daily, with activity visible in a dashboard, you can read how it works on the developer page or check the FAQ. The pricing is one payment of $9.99 per app in USDT, with no subscription.