Ali Demirbaş - Lab
TRGet in touch

Category & Listing

Short vs Long Product Titles A/B Test Example

A short heading may be quicker to scan, while a more descriptive one gives visitors extra context about the category.

  • Category listing
  • Category-page purchase conversion rate

Option A vs Option B

Two alternatives; neither is the incumbent.

Changed
Options
Page
Category listing
Difference
changed

Hypothesis

Compare how the two specific headings affect category selection and purchases; do not attribute the result to character count alone.

How to run this test

Primary metric

Category-page purchase conversion rate

Compare purchases among eligible visitors assigned to the short or descriptive heading.

Other metrics

  • Click-through rate (CTR)Check whether the first click rate changes.
  • Scroll depthTrack how far visitors explore the page.
  • Time on pageRead time alongside purchases; a longer visit is not automatically better.
  • Bounce rateTrack exits that may follow an expectation mismatch.

What to check before and during the test

  • Copy approachCompare a short heading with a descriptive one that explains the same product and offer.
  • Keep constantKeep supporting copy, CTA, category content and placement unchanged.
  • ScopeRun the test in the predefined category area; do not also change product, campaign or blog headings.
  • MobileCheck line breaks and truncation for both headings.
  • InterpretationTie the result to the specific copy compared, not length alone.

Setup mistakes to avoid

  1. 1Do not change supporting copy or CTA text along with the heading.
  2. 2Avoid headings that truncate on mobile and lose their meaning.
  3. 3Keep the product and offer equally clear in both headings.
  4. 4Do not test different heading formats across all pages at once.
  5. 5Avoid clickbait.