Ali Demirbaş - Lab
TRGet in touch

Home & Landing

Channel-Matched Testimonial A/B Test

A testimonial that matches the visitor’s acquisition channel may address the need that brought them to the site.

  • Home & landing
  • Primary action completion rate

Control vs Variant

The same value, presented two ways.

Changed
Format
Page
Home & landing
Difference
changed

Hypothesis

A poor match can be less useful than a well-chosen general testimonial. Randomize within each channel so differences in traffic mix are not mistaken for a variant effect.

How to run this test

Primary metric

Primary action completion rate

Compare the same primary action between arms within each eligible acquisition channel.

Other metrics

  • Conversion by sourceReview which channels show a gain and which do not.
  • Bounce rateMake sure an irrelevant testimonial does not increase exits.
  • Testimonial interaction rateCheck whether visitors interact more with the testimonial.
  • Page load timeMake sure personalization does not add delay.

What to check before and during the test

  • Matching ruleSet one fixed channel-to-testimonial match before launch.
  • PresentationKeep headline, testimonial count, placement and visual presentation unchanged.
  • FallbackShow the control testimonial when the source is not recognized.
  • Alternative rulesIndustry similarity and company size are separate matching strategies.
  • EvaluationRandomize within channel and review visitor groups with enough data.

Setup mistakes to avoid

  1. 1Do not suggest a testimonial was personally selected for a visitor; that can feel like tracking.
  2. 2Define a fallback before matching; never leave an unknown source with no testimonial.
  3. 3Do not change the testimonial and headline together by source.
  4. 4Do not expand a win from one channel to all channels.
  5. 5Use testimonials only within the permission granted by the customer.