Ali Demirbaş - Lab

Product Detail Page

Photo Reviews vs Text-Only Reviews A/B Test Example

Customer photos may show details or wearing conditions absent from studio images.

  • Product page
  • Return rate

Control vs Variant

The asset itself is the variable.

Changed
Media
Page
Product page
Difference
changed

Hypothesis

They can clarify expectations, but may also change who decides to buy. Keep review text and order the same in both arms, then compare returns after an adequate follow-up period.

How to run this test

Primary metric

Return rate

Compare returns for orders that have completed the same follow-up period in each arm, alongside conversion and the mix of products purchased.

Other metrics

  • Purchase conversion rate (CR)Assess purchases among all assigned visitors, not only those who open a photo.
  • Review section interaction rateUse photo opens and review interactions as diagnostics; those controls appear only in the variant.
  • Page weight and load timeMake sure images do not slow the mobile experience.
  • Moderation workloadCheck that the volume of inappropriate content remains manageable.

What to check before and during the test

  • PhotosShow permitted customer photos within the same eligible reviews.
  • FormatUse one fixed photo presentation and keep review order unchanged.
  • CollectionKeep the review request process unchanged; prompting for new photo submissions is a separate test.
  • Image setSet eligibility rules and a maximum number of displayed photos.
  • CategoryReview relevant categories separately.

Setup mistakes to avoid

  1. 1Do not present customer photos in a way that could be mistaken for product photography.
  2. 2Do not cherry-pick only positive photos.
  3. 3Do not enlarge low-resolution images.
  4. 4Keep review ranking unchanged during the test.
  5. 5Do not let the photo strip push the CTA down the page.