More Creativity Does Not Mean More Hypotheses
Twenty banners with different background colors can be the same idea. A useful creative test does not begin with design, but with the formulation of a hypothesis: What motive or user question are we testing?
Divide the test into levels
The first level is the communication angle. The second is format. The third is concrete performance.
| Level. | Example of a variable | What do we know? |
|---|---|---|
| Corner | rational/emotional | Which message best attracts the right audience |
| Format | static/video | How the audience consumes the message |
| Enforcement | headline, frame, composition | How to improve a winning idea |
If you test small details at once, you can optimize a weak concept for a long time.
First Step Metrics and Business Metrics
CTR helps you understand if creativity attracts attention. But a high CTR can come from a promise that’s too loud and lead to a weak click → registration. Creativity cannot be judged by click alone.
Minimum look:
- CTR;
- cost of clicking;
- click → registration;
- registration → FTD;
- The cost of the confirmed action.
An example of a false winner
Creative A gives CTR 3.2%, creative B 2.4%. I think A's better. But after a click, A will convert 8% to registration and B will convert 15% to registration. If the cost of a confirmed FTD is lower for B, it is B that is the stronger business option.
How to recognize burnout
Burnout is not the magical state of a banner. Usually you see a combination of signs: the frequency of impressions increases, the CTR drops, the result becomes more expensive, the audience stops responding. At this point, it is more useful to change the communication angle or segment, rather than just repaint the old layout.
Maintenance of the test library
Keep your creatives not by name. final_2_newAnd according to the system: GEO → source → angle → format → version. Record the result next to you. After a few cycles, it turns into its own knowledge base, not a picture folder.
What to send in a request for promotional materials
If you need materials from the partner team, specify the size, site, GEO and hypothesis. On the page. promotional materials There is a short brief that helps to formulate the request specifically.
Separate "corner" and "promise"
The angle of communication is a way to convey value, not a right to exaggerate terms. For example, the rational angle can explain mechanics, and the emotional angle can emphasize the convenience of the process. Both should remain within the corroborated language.
Four-week test plan
Week 1: Compare two different angles. Week 2: Inside the winning corner compare the format. Week 3: Improve the first seconds or header. Week 4: Check to see if the result is transferred to another segment. This order creates a knowledge tree, not a bundle of unrelated results.
Why You Need Post-Click Control
Creativity with a very high CTR is sometimes just better at provoking curiosity. If after a click, users quickly leave or do not move on to the next action, the message may create a wrong expectation. Therefore, in the report on creatives, add at least one metric after a click.
What to Do With Losing Ideas
Don't remove them from the library. Mark the date, the audience, and the reason why the option lost. In a few months, a similar idea may work on another GEO, but you’ll realize it’s a new test, not a forgotten old hypothesis.
How many options to run at the same time
If the budget is small, too many options will blur the data. Better three strong hypotheses than twenty weak ones. In the first phase, each option should get a chance to gain comparable volume, otherwise the early random leader will take all the traffic.
Use the naming convention
The creative name may contain GEO, angle, format and version: kz-rational-video-v2. It seems like a trifle, but it makes the analysis much easier. The report immediately shows what is being compared, without a separate folder search.
Post-test analysis
For each winner, write down not only a number, but also a hypothesis: “a short, rational headline is better than a long, emotional one on mobile KZ.” This conclusion can be verified in another segment. The phrase "video-03 is the best" carries almost nothing into the next test.
