Ali Demirbaş - Lab

Cart & Checkout

Testing a Free Shipping Progress Bar in the Cart

Showing how much more a shopper needs to spend to qualify for free shipping may prompt additional items.

  • Cart
  • Average order value (AOV)

Control vs Variant

Absent on one side, present on the other.

Changed
Presence
Page
Cart
Difference
added

Hypothesis

Assess any change in average order value alongside order completion and revenue per visitor.

How to run this test

Primary metric

Average order value (AOV)

Compare revenue per completed order. Because AOV includes buyers only, read it alongside order completion and revenue per visitor.

Other metrics

  • Add-to-cart rateCheck whether seeing the free-shipping threshold changes add-to-cart.
  • Order completion rateTrack order completion among assigned visitors as cart value changes.
  • Revenue per visitor (RPV)Compare revenue per assigned visitor, whether or not they purchase.

What to check before and during the test

  • ChangeAdd a progress bar showing the amount remaining to reach free shipping in the variant only.
  • Keep constantKeep the shipping threshold, product prices, promotions and message logic the same in both arms.
  • Cart behaviorTrack both items added and removed to understand how the threshold message affects cart changes.
  • Orders and revenueRead AOV alongside order completion and revenue per visitor.
  • DeviceCheck that the bar renders correctly and does not obstruct the cart flow on mobile or desktop.

Setup mistakes to avoid

  1. 1Do not change the free-shipping threshold or promotion terms during the test.
  2. 2Do not place the bar over the main CTA or push it out of view.
  3. 3Update the message correctly when the threshold is reached or the cart goes above it.
  4. 4Do not also change color, message and placement in the same test.
  5. 5Do not call the result successful if AOV rises while order completion or revenue per visitor falls.