# Outcome Testimonial vs General Praise A/B Test Idea

Page: https://alidemirbas.com.tr/en/lab/ab-test-library/tests/outcome-testimonial-vs-general-praise-ab-test-idea

## Hypothesis

If a testimonial describes a specific outcome, visitors can compare it with their own needs, while general praise signals satisfaction but says little about what the product delivers. When the specific story fits the visitor's situation it could pull the primary action completion rate ahead of the general praise; when it does not, it could trail it.

## When to run this test

Survey answers that call the testimonials too generic, or support contacts asking what problem the product solves, suggest testimonials do not give visitors enough to decide. Visitors who read an outcome close to their own situation should then head for the primary action with more conviction and not drop off at the next step. Confirm that every specific outcome is in the customer's own words and that you have permission to show names, titles or organization details; if visitors leave before they reach the testimonials, look at that point first.

## Primary metric

**Primary action completion rate**: Compare whether the type of testimonial changes completion of the target action.

## Other metrics

- **Post-action drop-off rate**: Make sure visitors drawn in by a specific testimonial do not drop off at the next step.
- **Testimonial interaction rate**: Track measurable interactions; visibility does not prove the testimonial was read.
- **Testimonial visibility**: Measure whether the section enters the viewport.
- **Return or cancellation rate**: Track later losses that may follow a mismatch between claim and experience.

## What to check before and during the test

- **Selection**: Compare genuine general praise with genuine testimonials that describe a specific outcome.
- **Presentation**: Keep testimonial count, placement, design and identity format unchanged.
- **Identity**: Where possible, choose comparable customer contexts; the speaker's identity can also affect credibility.
- **Separate comparisons**: Test testimonial count or identity detail later.
- **Relevance**: Review results by the use case and industry represented.

## What to watch when reading the result

- If post-action drop-off or the return or cancellation rate rises, a gain in the primary action completion rate gives you no case for shipping. If a specific testimonial sets expectations the experience does not meet, the losses show up later, and a testimonial that presents an unmeasured figure as exact makes that risk larger.
- This pair of testimonials and the use case they represent set the limits of the finding. If the testimonials come from a single industry, do not generalize the result to other industries, and since a different speaker can also change credibility, do not credit the gap to the outcome framing alone.
- Before searching industry or use-case groups for a hidden effect, check whether each has enough data. Work out how many visitors each group needs with the [sample size calculator](https://alidemirbas.com.tr/en/calculators/sample-size-calculator); differences in small groups are easy to misread.

## Frequently Asked Questions

### What can a results-focused testimonial claim?

Only the customer’s genuine, authorized account. Verify numerical claims and permission for names, roles and organizations rather than inventing stronger results.

### Are specific outcomes always more persuasive?

No. A narrow story may not fit other needs. Choose comparable customer contexts where possible and inspect predefined sectors and use cases. Changing the speaker can also affect credibility.

### Does testimonial visibility establish that it was read?

No. Use completed main actions as the primary outcome. Interaction is diagnostic, and cancellations or returns can help identify expectation mismatches.
