Most mobile games that fail do so because not enough people want them, and many studios only discover this after months of development. Concept testing turns that order around: show the idea to real people through ads, measure how they respond, and decide whether to build before most of the money is spent.
The practice goes by several names, such as marketability testing, CPI testing or prototype testing, and is common among casual and hybrid-casual studios and their publishers. This guide explains how it works, what to show, what to measure and how to avoid results that mislead.
What a concept test answers
A concept test answers one question: do people who see this idea want to play it? It does not tell you whether the game will retain players or make money; that needs a playable build and later tests. It is a cheap filter that kills weak ideas early and lets strong ones through to the next stage.
Typical stages, each more expensive than the last:
- Concept: do people click on the idea? Measured with ads and a store page.
- Prototype: do people who install a rough build play it, and come back the next day?
- Soft launch: does a fuller game retain and monetise in a few markets?
- Global launch: does it scale profitably?
This guide covers the first two. Soft launch covers the third, and how to find a publisher explains how publishers use these tests to decide what to fund.
What to put in the ad
The ad must show the core of the game honestly, because the test is meaningless if it measures interest in something you will not build. Three formats are common:
- Short videos of the core loop, captured from a rough prototype or made as animatics. Cheap to make and easy to vary.
- Playable ads of the core mechanic. More work, but they test whether the mechanic itself is fun to touch, which a video cannot.
- Static images or store-style screenshots, for very early ideas. Weak signal, but almost free.
Make several creatives per concept, typically with different hooks or themes, because one bad ad can sink a good idea. If every creative for a concept underperforms, the concept is likely the problem; if one works and the others do not, the idea may be fine and the execution needs work.
Where the click goes
Most app install campaigns need a live store listing to point at, which shapes how tests are run:
- A prototype build published in a limited set of countries, with a real store page. The ad measures click and install rates, and the build measures early play.
- A pre-registration page on Google Play, which allows a store listing before the game is released and measures sign-ups. Pre-registration campaigns covers how it works.
- A landing page outside the store, for the earliest ideas. It needs a web campaign rather than an app install campaign and gives a weaker signal.
Whatever the route, the store page is part of the test. A good ad and a poor store page will produce a poor install rate. Some studios run store listing experiments on Google Play or product page optimisation on the App Store to test icons and screenshots for the same concept. App store optimisation covers both.
Where to run the test
Studios usually run concept tests in markets where installs are relatively cheap but audiences resemble their target markets, often with one or two higher-value markets for a sense of real costs. Choose countries and keep them the same across tests, so concepts can be compared with each other. Tier 1, 2 and 3 countries explains how markets differ.
Use one network, or a small, consistent set, for all tests. Costs differ between networks, so a concept tested on one and another on a different one cannot be compared fairly.
What to measure
- Click-through rate: do people stop and tap on the ad?
- Install rate from the store page: once they see the full listing, do they still want it?
- Cost per install: the combined effect of the two, at the budget and market you tested.
- For playable concepts, interaction and completion rates: is the mechanic fun to touch?
- For prototype builds, day-one retention and session length: do people who install it play?
Compare results against your own previous tests and, if you work with one, against the publisher's current targets. Targets differ by genre, market and year, so use a benchmark built from your own data rather than a figure from an old article.
Pitfalls that mislead
- Too little data. A test needs enough spend for the numbers to settle; a few dozen installs is noise.
- Misleading ads. An ad showing a mechanic you will not build tests the ad, not the game, and inflates results you will never reproduce.
- Changing the method between tests. Different countries, networks or budgets make concepts impossible to compare.
- Judging only cost per install. A cheap install from an audience that will never pay or stay is not a win.
- Falling in love with the idea. A concept test is only useful if the team agrees beforehand what result will kill a concept, and then honours it.
Honesty and policy
Ads for a game in development must still follow network policies on misleading content. Showing the real prototype, or clearly representative art, keeps the test honest and avoids rejections. If the ad points at a store page, the store page must describe what is actually available. Playable ad policy covers what networks reject.
Making tests cheap and fast
Concept testing pays off when it is cheap enough to run often. The cost lies mostly in the creatives, so teams look for ways to make several per concept quickly. A playable built from a re-skinnable template, or generated from a short description and then refined, can be ready in a day rather than a week. Playable Ads Maker's template library and AI Lab are designed for exactly that kind of fast, repeated creative production.
A simple test plan
- Write down the concept in one sentence and the result that would kill it.
- Make three or more creatives with different hooks, all showing the real core.
- Publish a store page or prototype build in a fixed set of countries.
- Run all creatives on the same network with the same budget per concept.
- Compare against your previous concepts, decide, and record the result and the reasons.
Create playable end cards in minutes—no code required.
Open Playable Ads Maker