Ali Demirbaş - Lab

Home & Landing

Abstract Hero Imagery vs Real Product Screens A/B Test

Real product screens can make the offer easier to understand, while a complex interface may make the product look harder to use.

  • Home & landing
  • Primary action completion rate

Option A vs Option B

The asset itself is the variable.

Changed
Media
Page
Home & landing
Difference
changed

Hypothesis

Abstract visuals communicate a theme without showing the interface. Compare the visual approaches using accurate, current product screens.

How to run this test

Primary metric

Primary action completion rate

Compare whether the visual type changes completion of the target action.

Other metrics

  • Primary action completion rateCompare target-action completion among visitors assigned to each visual type.
  • Page load timeTrack the impact of image files on load time.
  • Browsing after heroReview progression past the hero; scrolling alone does not show interest.

What to check before and during the test

  • Visual typeCompare abstract imagery with real product screens.
  • CompositionKeep image count, placement, space and surrounding copy unchanged.
  • DetailChoose one readable screen presentation; full-size versus cropped screens is a separate test.
  • AccuracyUse current product screens and clearly labeled sample data with no real customer information; provide text alternatives.
  • FamiliarityReview new visitors and visitors familiar with the product separately.

Setup mistakes to avoid

  1. 1Do not present a screen the product does not have as a real product interface.
  2. 2Do not make sample data look like real customer data.
  3. 3Do not change visual type and image count together.
  4. 4Do not count a screen too small to read as a meaningful product demo.
  5. 5Measure page weight when replacing images.