Category & Listing
Campaign Badge on Product Cards A/B Test Example
A campaign badge may help shoppers notice an eligible offer while browsing the listing and encourage product-page visits or purchases. Too many badges can weaken the visual hierarchy.
A/B test scenario. This page is a test plan, not the result of a real experiment.
- Category listing
- Purchase conversion rate
Control vs Variant
Absent on one side, present on the other.
- Changed
- Presence
- Page
- Category listing
- Difference
- added
Hypothesis
If campaign-eligible products carry a single badge on the card, shoppers may spot the offer while scanning the listing and move toward those products more often. The badge could lift purchase conversion rate, though a crowd of badges could weaken the same effect.
Test plan
When to run this test
Low click-through on campaign items, shoppers saying they only learned about the campaign on the product page, or support tickets asking whether a campaign is running all suggest that campaign products do not stand out on the listing page. The pattern to expect is that badged products get opened, added to cart and bought more often. Use the badge only for a campaign whose terms really apply, and if the campaign itself is weak, work on the offer first, because a badge does not make up for it.
How to measure success
Purchase conversion rate
Compare purchases among eligible visitors assigned to the campaign-badge experience.
Also track
- Click-through rate (CTR)Check whether products with the badge receive more clicks.
- Add-to-cart rateCheck whether visitors add the badged product more often.
- Exit rateTrack exits to see whether badge clutter may be putting visitors off.
- Revenue per visitor (RPV)Check how any conversion change affects revenue per visitor.
How to set it up
- BadgeAdd one predefined badge to products eligible for the current campaign.
- Keep constantKeep campaign terms, prices, sorting and other card elements unchanged.
- BehaviorMeasure clicks and purchases; a claim about being noticed needs separate evidence.
- DeviceCheck readability and results on mobile and desktop.
- Separate testsKeep badge placement, color and eligible products fixed; test alternatives separately.
What to watch when reading the result
- 1More clicks on badged products do not show on their own that shoppers noticed the badge or that it lifted sales. Purchase conversion rate is the measure that counts; do not treat a lift as a reason to ship if revenue per visitor (RPV) falls or exit rate rises.
- 2This test speaks only to this campaign and its eligible products; a campaign with different terms may behave differently. Do not draw conclusions about badge placement or color from it either; test alternatives separately.
- 3An unclear result may simply mean the campaign ended before the test reached the sample it needed. Compare the sample per variant from the sample size calculator with the visitors each arm actually got during the campaign; if it fell short, do not read it as no effect, and test the same badge setup again in the next campaign.
- 4Badges can crowd the cards as more products join the campaign, so look at exit rate separately on pages where many badges sit side by side. Check on mobile and desktop that the campaign badge is clearly distinct in color from price badges and does not cover the product photo.
Frequently Asked Questions
Which products should receive a campaign badge?
Only products genuinely eligible for the existing campaign. Use one predefined badge and preserve prices, eligibility rules and other card elements.
Do more clicks prove visitors noticed the badge?
Clicks measure behavior, not awareness directly. Use purchase conversion as the primary outcome. Review RPV to understand whether the purchase mix changed.
Can campaign badges clutter the listing?
Yes. Avoid overwhelming the card hierarchy or covering product photos. Monitor exits as a guardrail and keep the selected design stable.
More tests in Category & Listing
All testsTesting a First-Order Discount Message on Cards
Category listingPost-discount revenue per eligible new visitor
A first-purchase discount line on the listing card, aimed at new users and read through net revenue per new user. See the variable and both arms.
Graying Out vs Hiding Out-of-Stock Products A/B Test
Category listingCategory-page purchase rate
Two ways to handle unavailable items in a category list: leave them grayed out or drop them entirely. Covers assortment perception and purchase rate.
Should a Campaign Banner Show a Countdown Timer?
Category listingCampaign purchase conversion rate
An experiment idea adding a countdown to a listing page campaign banner. Read both arms, the urgency reasoning and the resetting-timer credibility risk.