A/B Test Playbook
A/B Test Library
211 searchable test ideas and ready-to-run scenarios. See the variable, primary KPI and guardrails for each.
211 tests
Cart & Checkout
22 scenariosCart · Checkout
CTA Button Color A/B Test Example on the Cart Page
CartClick-through rate (CTR)
An experiment idea that varies only the cart CTA button color against the surrounding palette. See the setup, the tested element and the click-rate metric.
Removing Extra CTAs From the Cart A/B Test
CartOrder completion rate
A cart experiment stripping repeated and non-functional calls to action down to a single one. Review both arms, the reasoning and the tracked metric.
Testing a Free Shipping Progress Bar in the Cart
CartAverage order value (AOV)
An experiment idea adding a bar showing how much is left until free shipping. Examine the control arm, the added module and the basket value metric.
Visible vs Hidden Coupon Code Field A/B Test
CartRevenue per visitor (RPV)
Compares an open coupon box in the cart with one behind a link. Read the two arms, the discount-hunting risk described and the revenue metric chosen.
Guest Checkout vs Required Account A/B Test
CheckoutPurchase conversion rate (CR)
An experiment idea placing forced account creation against an added guest checkout option. Look through the arm definitions, the friction case and KPI.
One-Page vs Multi-Step Checkout A/B Test
CheckoutOrder completion rate
A structural experiment weighing a single checkout page against a stepped flow. See how each arm is framed and what completion metric is used here.
Category & Listing
23 scenariosCategory listing
Should a Campaign Banner Show a Countdown Timer?
Category listingCampaign purchase conversion rate
An experiment idea adding a countdown to a listing page campaign banner. Read both arms, the urgency reasoning and the resetting-timer credibility risk.
Category Ordering A/B Test on Listing Pages
Category listingPurchase conversion rate (CR)
An open-ended experiment idea on how category order shapes browsing direction and discovery. See the tested variable and the conversion metric chosen.
Infinite Scroll vs Load More Button A/B Test
Category listingCategory-page purchase conversion rate
A pagination experiment comparing continuous scrolling with button-triggered loading. Look at each arm, the orientation trade-offs and the metric used.
2 vs 3 Column Product Grid on Mobile A/B Test
Category listingMobile category-page purchase conversion rate
An experiment idea comparing two and three column mobile grids. See both arms and the trade-off between showing more products and keeping image detail.
Second Product Image on Listing Cards A/B Test
Category listingCategory-page purchase conversion rate
Shoppers can swipe or hover to a second image on the card in this experiment. Read both arms, the note on detail page traffic and the conversion metric.
Should Listing Pages Offer Quick Add to Cart?
Category listingOrder completion rate
An experiment idea adding a quick add button to product cards on the listing page. Review both arms, the shortened purchase path and the tracked metric.
Dashboard
3 scenariosEmpty-State Action Card on a Dashboard A/B Test
DashboardFirst-action completion rate
A new user opens a dashboard with no data yet. Compare a bare empty table with a card pointing to a first action, tracked as first-action completion.
Reordering Dashboard Widgets by Recent Use A/B Test
DashboardWidget interaction rate
A fixed widget order against an order driven by recent usage. The page sets out the predictability trade-off, the arms and the widget engagement metric.
Testing a One-Time Feature Tip Card on a Dashboard
DashboardFeature trial rate
A little-known feature introduced with one dismissible tip card, versus no introduction. Includes the interruption risk and the feature trial metric.
Forms & Signup
23 scenariosAbove vs Left-Aligned Form Label A/B Test Example
Forms & signupForm completion rate
Labels above the input against labels aligned to its left. Read why scan path, vertical space and long or translated labels pull the decision both ways.
Floating vs Always-Visible Form Labels A/B Test
Forms & signupForm completion rate
The floating label that starts inside the field and rises on typing, compared with a label that never disappears. Setup, arms and completion metric.
One-Column vs Two-Column Form Layout A/B Test
Forms & signupForm completion rate
Fields laid out in two columns against the same fields stacked in one. Explains the zigzag scan problem, perceived length and how it gets measured.
Easiest Field First: Form Field Order A/B Test
Forms & signupForm completion rate
Reordering every field from easy to hard, against leaving the current neutral order. Includes the counter-argument about pushing hard fields to the end.
All Fields Upfront vs Step-by-Step Reveal A/B Test
Forms & signupForm completion rate
Showing the whole form at once, or revealing fields as each one is filled. Read the expectation-setting argument against the perceived-length one.
Autofocus on the First Form Field A/B Test Example
Forms & signupForm start rate
Placing the cursor in the first field the moment the page loads, or leaving it alone. The page weighs the desktop gain against the forced mobile keyboard.
Home & Landing
30 scenariosMoving the Main CTA Above the Fold A/B Test
Home & landingPrimary action completion rate
The primary call to action after the explanation section, against the same action in the first screen. Read the early-versus-convinced tension in full.
Problem vs Solution Headline Framing A/B Test Example
Home & landingPrimary action completion rate
A landing page test idea comparing a headline that names the problem with one that states the solution. Review both arms, the setup and the KPI.
Abstract or Concrete Benefit Statement A/B Test Idea
Home & landingPrimary action completion rate
Compare a broad benefit line with a specific, measurable one. The page lays out both variants, the trade-off behind each and the KPI being tracked.
Adding a Second CTA at the End of the Page A/B Test
Home & landingPrimary action completion rate
This test idea adds a second call to action at the foot of a long page. See the single-CTA control, the counter-arguments and the metric followed.
Autoplaying Hero Video vs Static Image A/B Test Idea
Home & landingPrimary action completion rate
Swap the static hero image for a muted autoplaying video. The page shows both arms, the cost autoplay carries and the KPI the experiment tracks.
Testing a Customer Logo Bar for Trust on a Homepage
Home & landingPrimary action completion rate
A trust test idea that adds a bar of recognizable client logos. Examine the control without logos, when logos can misfire and the metric tracked.
Mobile App
12 scenariosProduct page · Mobile app
Making One Service Icon Larger: Mobile App A/B Test
Mobile appFeatured service completion rate
Enlarge one priority service icon while all the others stay equal in size. Compare both arms and see the risk of overshadowing the rest of the menu.
Hard vs Soft Signup Wall: Mobile App A/B Test Example
Mobile appRegistration rate
Forced signup at launch against guest mode first. Examine both arms, what each costs in first impression and the signup rate used as the KPI.
When to Ask for Push Permission: Mobile App A/B Test
Mobile appPermission grant rate
Push permission at app launch or after the first value moment. Compare both arms and see why a refused prompt is hard to ask for a second time.
Promo Message on the App Loading Screen A/B Test Idea
Mobile appPurchase conversion rate
Compare a plain loading screen with the same screen carrying one campaign message, keeping the actual loading time unchanged.
A/B Test Idea: Home Screen for Returning App Users
Mobile appRevenue per visitor (RPV)
Give returning users a continue where you left off home screen. Examine both arms and why revenue per visitor is the metric being tracked here.
Testing a Recently Viewed Row on an App Home Screen
Mobile appPurchase conversion rate (CR)
Add a recently viewed products row to the app home screen. Compare both arms and see why showing an already purchased item is flagged as a risk.
Pricing
12 scenariosHow Many Pricing Plans Should You Show? Test Idea
PricingRevenue per visitor (RPV)
An open test concept for pricing-plan count. Define two specific plan sets first, then compare revenue per visitor and plan-selection distribution.
Comparison Table or Plan Cards on a Pricing Page
PricingRevenue per visitor (RPV)
A test example putting a row-by-row plan comparison table against separate plan cards, with the reasoning for each format and the metric being tracked.
Price First or Benefits First on a Pricing Page
PricingRevenue per visitor (RPV)
Experiment idea that moves the price above or below the benefit section, showing what each order does to expectation setting and to perceived value.
Annual Total or Monthly Equivalent Price A/B Test
PricingRevenue per visitor (RPV)
A/B test idea that swaps the headline price between a full annual figure and its monthly equivalent, with notes on how clearly the total must stay visible.
Showing Unit Price Next to Package Totals A/B Test
PricingRevenue per visitor (RPV)
Experiment example adding a per-unit figure beside the package total, covering how it eases comparison and how it can crowd the price area or oversell.
One-Time Payment Wording A/B Test on a Pricing Page
PricingRevenue per visitor (RPV)
A test idea that adds a no-auto-renewal line beside the price, with the subscription-fatigue reasoning behind it and the comparison burden it may create.
Product Detail Page
36 scenariosProduct page
Testing a Studio Shot Against a Customer Photo
Product pagePurchase conversion rate (CR)
Experiment example swapping the main product image for a genuine, permitted customer photo, weighing realism and trust against perceived brand quality.
One Product Image vs Four Angles A/B Test
Product pagePurchase conversion rate (CR)
Compare one product image with four predefined product angles while keeping image quality consistent, using conversion and returns as outcomes.
Model Height and Size Info on Product Pages A/B Test
Product pagePurchase conversion rate (CR)
Experiment idea adding a short line about the model's height and the size worn, and how that detail touches both size choice and the return rate.
Review Summary Placement A/B Test on Product Pages
Product pagePurchase conversion rate (CR)
Move the star rating and review count from directly below the price to just below the product description and compare downstream conversion.
Hiding Out-of-Stock Items or Offering Notify Me
Product pagePurchase rate after an item is out of stock
Experiment example weighing a clean catalog against keeping the page live with a back-in-stock signup, measured by how many visitors register for alerts.
Monthly Installment as the Headline Price A/B Test
Product pageRevenue per visitor (RPV)
A test idea promoting the monthly installment figure over the full amount on a product page, with the transparency and cancellation risks it carries.
SaaS & B2B
13 scenariosTrial CTA Copy: Short or Time-Specific Wording Test
SaaS & B2BFree trial signup rate
An experiment example comparing two trial CTA labels, a short neutral one against wording that names the trial length. Both arms and the signup KPI.
Adding a Request Demo CTA Beside Start Free A/B Test
SaaS & B2BQualified opportunity rate
A SaaS experiment example: one self-serve CTA against a second demo request option for enterprise buyers. See both arms, the reasoning and the tracked KPI.
Making the Annual Plan the Default Selection A/B Test
SaaS & B2BRevenue per assigned user
A pricing experiment example comparing a monthly default against an annual default plan selection. Read the commitment trade-off, arms and KPI.
Fewer Fields on a Demo Request Form: A/B Test Example
SaaS & B2BQualified opportunity rate
An experiment example on lead form length: the current field set against a shorter one. Read the volume-versus-quality trade-off, arms and KPI.
Paywall Timing: Show Early or at the Limit A/B Test
SaaS & B2BUpgrade rate
A CRO experiment on when the upgrade prompt appears, before the user sees value or at the moment the limit is hit. Both arms and the upgrade KPI are shown.
Where the Most Popular Badge Sits on a Pricing Card
SaaS & B2BPurchase conversion rate (CR)
A CRO experiment example comparing a badge that overflows the top of the plan card against one that stays inside it. See both arms, the setup and the KPI.
Search & Filtering
13 scenariosSearch · Filters · UI elements
Applying Filters Instantly or With a Button A/B Test
FiltersSuccessful product discovery after filtering
A CRO experiment on how filters are applied: results updating immediately against an apply button that submits selections together. Both arms and the KPI.
Header Search Field vs Menu Search A/B Test
SearchPurchase conversion rate (CR)
Compare an always-visible search field in the header with search placed inside the menu, tracking search use and downstream conversion.
Previous Searches vs Empty Search Box A/B Test
SearchPurchase conversion rate (CR)
Compare showing previous searches when the search box opens with an empty search box, tracking search use, conversion and privacy concerns.
What to Put on a Zero-Results Search Page: A/B Test
SearchZero-results recovery rate
An experiment example on one of the highest-exit screens: a blank no-results page against spelling suggestions, popular categories and similar products.
Relevance vs Best-Selling Default Search Sort A/B Test
SearchSearch purchase conversion rate (CR)
Compare relevance and best-selling as the default search sort while keeping the result set and filters unchanged, using search conversion as the primary KPI.
Making the Navigation Menu Sticky: A/B Test Example
UI elementsPurchase conversion rate (CR)
An experiment example comparing a standard menu against one that stays fixed while scrolling, weighing faster navigation against lost screen space.
Thank You
4 scenariosOrder Confirmation Page Product Suggestion A/B Test
Thank youAdditional purchase rate
A thank-you page experiment example adding a related product suggestion after checkout. See both arms, the reasoning behind the timing and the KPI.
Inviting Guest Buyers to Create an Account: A/B Test
Thank youAccount creation rate
This page details an account creation invite shown on the thank-you page after guest checkout: both arms, the friction argument and the measured KPI.
Refer-a-Friend Offer on the Thank You Page A/B Test
Thank youReferral sharing action rate
A referral experiment example showing an invite-a-friend offer right after purchase. See both arms, the timing rationale, the risks and the KPI.
Making Order Confirmation a Memorable Moment A/B Test
Thank youPost-purchase brand perception
Swapping a plain order confirmation for a personalized thank-you block, written up as an experiment example with both arms and the survey-based KPI.
UI Elements
20 scenariosButton Copy: Action Verb vs Benefit Phrase A/B Test
UI elementsNext-step completion rate
A microcopy experiment example comparing an action label such as Send with a benefit label such as Get my quote. See both arms and the trade-offs.
Filled Button or Outlined Button: A/B Test Example
UI elementsPrimary action completion rate
A button style experiment example weighing a filled button against an outlined one. See both arms, the hierarchy reasoning and the completion KPI.
Secondary Action as a Link or a Button: A/B Test Idea
UI elementsTotal action completion rate
Should the secondary action be a text link or a button? This experiment example lays out both arms, the hierarchy trade-off and the completion KPI.
Consistent Button Styles Across a Page: A/B Test Idea
UI elementsTotal action completion rate
One shared button style across a page, versus section-by-section variation. See both arms of the experiment, the reasoning and the tracked KPI.
Buy Now vs See Pricing CTA A/B Test
UI elementsPurchase conversion rate (CR)
Compare Buy now with See pricing in the same CTA position and style, measuring progression and final conversion rather than clicks alone.
Adding Text Labels Next to Icons: A/B Test Example
UI elementsUse of the labeled function
Pairing icons with written labels, set up as an experiment example. See the icon-only arm, the labelled arm, the clutter note and the tracked KPI.