Ali Demirbaş - Lab

Home & Landing

Outcome Testimonial vs General Praise A/B Test Idea

A specific customer outcome gives visitors something concrete to relate to their own needs, while general praise says less about what the product does.

  • Home & landing
  • Primary action completion rate

Option A vs Option B

Two alternatives; neither is the incumbent.

Changed
Options
Page
Home & landing
Difference
changed

Hypothesis

A narrowly framed success story may not fit other use cases, so compare the selected testimonials without assuming that specific stories always persuade more.

How to run this test

Primary metric

Primary action completion rate

Compare whether the type of testimonial changes completion of the target action.

Other metrics

  • Post-action drop-off rateMake sure visitors drawn in by a specific testimonial do not drop off at the next step.
  • Testimonial interaction rateTrack measurable interactions; visibility does not prove the testimonial was read.
  • Testimonial visibilityMeasure whether the section enters the viewport.
  • Return or cancellation rateTrack later losses that may follow a mismatch between claim and experience.

What to check before and during the test

  • SelectionCompare genuine general praise with genuine testimonials that describe a specific outcome.
  • PresentationKeep testimonial count, placement, design and identity format unchanged.
  • IdentityWhere possible, choose comparable customer contexts; the speaker's identity can also affect credibility.
  • Separate comparisonsTest testimonial count or identity detail later.
  • RelevanceReview results by the use case and industry represented.

Setup mistakes to avoid

  1. 1Do not attribute an outcome to a customer that they did not report.
  2. 2Do not publish names, titles or organization details without permission.
  3. 3Do not present an unmeasured figure as exact.
  4. 4Do not change testimonial content and count together.
  5. 5Do not generalize a testimonial from one industry to others.