Home & Landing
Video Testimonial or Written Quote: A/B Test Example
Hearing a real customer's experience may feel more personal than reading a quote. Some visitors will not play a video, and video adds production and loading costs. Compare the same account in both formats and keep an equivalent text version available.
A/B test scenario. This page is a test plan, not the result of a real experiment.
- Home & landing
- Primary action completion rate
Option A vs Option B
The asset itself is the variable.
- Changed
- Media
- Page
- Home & landing
- Difference
- changed
Hypothesis
If visitors hear a real customer describe the experience in their own voice, the testimonial may feel more personal and credible than reading the same account. Visitors who never play the video and the extra loading time could limit that effect, so which format wins on the primary action completion rate depends on that balance.
Test plan
When to run this test
When the testimonial section gets seen but progress does not improve, survey answers find the quotes unconvincing, or messages ask whether the testimonials are real, it is worth questioning the format the testimonials come in. If the video format is more convincing, visitors who watch it find the account more credible and move on to the primary action more readily. Before launch, confirm that the person on screen is a real customer rather than an actor and that you have permission to use the footage; if the page is already slow, fix load time first.
How to measure success
Primary action completion rate
Compare whether the reference format changes completion of the target action.
Also track
- Reference engagementReport video starts and watch time separately from interaction with the text reference.
- Page load timeTrack the video's impact on page load time.
- Reference section visibilityMeasure whether the section enters the viewport; visibility does not prove it was read.
How to set it up
- FormatPresent the same approved customer story as text or video.
- Keep constantKeep the customer, claims, placement and surrounding content unchanged.
- Text accessProvide equivalent text for visitors who do not play the video; check captions and screen-reader access.
- PlaybackPredefine clip length and playback behavior.
- DeviceReview mobile and desktop results separately.
What to watch when reading the result
- 1Do not call the video version the winner because video starts or watch time are high. Report those separately from interaction with the text testimonial, let the primary action completion rate decide, and weigh any added page load time that eats into the gain.
- 2This finding is limited to this customer story and this spot on the page. Review mobile and desktop separately, because playback behavior and loading cost can differ by device, and validate the result again before carrying it over to another testimonial or page.
- 3While the result is unclear, do not draw conclusions from only the visitors who played the video, since that group already skews toward interested visitors. Compare all assigned visitors and assess the gap between the two formats with the A/B test significance calculator.
Frequently Asked Questions
Should the video and written testimonial contain the same account?
Yes. Preserve the authorized customer, claims and surrounding context. Otherwise the experiment changes both the format and the substance.
What should visitors who do not play the video see?
Provide an equivalent accessible text alternative and appropriate captions. Fix playback behavior and clip length beforehand rather than leaving non-viewers without the testimonial information.
Does higher video viewing make the variant a winner?
No. Use completed main actions as the primary outcome. Report video starts and viewing time as diagnostics, not equivalents of written-testimonial interaction.
What permission and accuracy checks are needed?
Verify rights to use the customer’s image and account. Do not portray an actor as a genuine customer. Monitor loading cost and supported device experiences.
More tests in Home & Landing
All testsOutcome Testimonial vs General Praise A/B Test Idea
Home & landingPrimary action completion rate
General praise against a testimonial reporting a concrete outcome. Examine both arms, the risk of narrowing the audience and the metric tracked.
Channel-Matched Testimonial A/B Test
Home & landingPrimary action completion rate
Compare one fixed testimonial with a testimonial matched to the visitor's acquisition channel, tracking the primary action and mismatch risk.
Zigzag Section Layout vs Consistent Alignment A/B Test
Home & landingPrimary action completion rate
Alternating zigzag sections against one consistent alignment. See both arms, the scanning speed trade-off and the metric this experiment tracks.