Ali Demirbaş - Lab

Category & Listing

Campaign Badge on Product Cards A/B Test Example

A campaign badge may help shoppers notice an eligible offer while browsing the listing and encourage product-page visits or purchases.

  • Category listing
  • Purchase conversion rate

Control vs Variant

Absent on one side, present on the other.

Changed
Presence
Page
Category listing
Difference
added

Hypothesis

Too many badges can weaken the visual hierarchy.

How to run this test

Primary metric

Purchase conversion rate

Compare purchases among eligible visitors assigned to the campaign-badge experience.

Other metrics

  • Click-through rate (CTR)Check whether products with the badge receive more clicks.
  • Add-to-cart rateCheck whether visitors add the badged product more often.
  • Exit rateTrack exits to see whether badge clutter may be putting visitors off.
  • Revenue per visitor (RPV)Check how any conversion change affects revenue per visitor.

What to check before and during the test

  • BadgeAdd one predefined badge to products eligible for the current campaign.
  • Keep constantKeep campaign terms, prices, sorting and other card elements unchanged.
  • BehaviorMeasure clicks and purchases; a claim about being noticed needs separate evidence.
  • DeviceCheck readability and results on mobile and desktop.
  • Separate testsKeep badge placement, color and eligible products fixed; test alternatives separately.

Setup mistakes to avoid

  1. 1Avoid using so many badges that the card becomes visually cluttered.
  2. 2Do not use the same color for price and campaign badges if that makes them hard to distinguish.
  3. 3Use a badge only when the campaign terms apply.
  4. 4Do not make it large enough to cover the product photo.
  5. 5Keep badge color and position unchanged during the test.