# Raising the Free Shipping Threshold A/B Test

Page: https://alidemirbas.com.tr/en/lab/ab-test-library/tests/raising-the-free-shipping-threshold-ab-test

## Hypothesis

If more shoppers add items to clear the alternative threshold than abandon their carts over it, AOV can rise while lost orders stay limited. Once shipping cost is counted, revenue per visitor (RPV) could come out higher.

## When to run this test

Orders clustering around the threshold in the order value distribution, or shoppers leaving the cart once they see a shipping fee, show that the threshold is shaping decisions. If the new threshold works, shoppers close to it add items to clear it, and those who abandon do not cancel out that gain. If exits stem from something other than the shipping fee, such as payment errors, look into that before you change the threshold. Choose the alternative from the current basket distribution and shipping costs, and check before launch that the free-shipping message states its conditions accurately.

## Primary metric

**Revenue per visitor (RPV)**: Compare net revenue per assigned visitor across the two shipping thresholds, accounting for order conversion and shipping cost.

## Other metrics

- **Average order value (AOV)**: Compare revenue per completed order; interpret it alongside conversion and RPV.
- **Order completion rate**: Compare completed orders among all visitors assigned to each threshold.
- **Cart-to-checkout rate**: Compare assigned cart visitors who start checkout.
- **Shipping cost per order**: Track shipping expense and its effect on contribution margin.

## What to check before and during the test

- **Threshold**: Compare the current free-shipping threshold with one alternative chosen from unit economics and shipping costs; set both values before launch.
- **Keep constant**: Keep prices, promotions, shipping message and its presentation unchanged.
- **Revenue**: Use RPV to assess whether any increase in AOV offsets a change in conversion.
- **Cost**: Include shipping expense and margin impact in the decision.
- **Audience**: Review new and returning visitors with the same definitions; keep each visitor in the same variant.

## What to watch when reading the result

- A higher AOV on its own is not a win. Decide on RPV and read the effect of shipping cost per order on margin with it; even with a higher RPV, do not switch to the new threshold if shipping cost is eating into margin.
- What you learn describes only the two thresholds you compared; do not carry it over to another threshold value or a different promotional period. Split new and returning visitors with the same definitions, and check whether the cart-to-checkout rate differs between the arms.
- Shoppers who add items and shoppers who abandon can offset each other, so the net difference may be small. Before launch, get the visitors needed per arm for the order completion rate from the [sample size calculator](https://alidemirbas.com.tr/en/calculators/sample-size-calculator); RPV is an average and noisier, so treat that number as a floor. If the difference is still unclear, do not conclude that the two thresholds perform the same.

## Frequently Asked Questions

### How should the alternative free-shipping threshold be chosen?

Choose it before launch using unit economics, shipping costs and the existing cart-value distribution. Keep each assigned threshold stable throughout the experiment.

### Is a higher average order value a gain when the threshold rises?

Not necessarily. A higher threshold can discourage some purchases. Use revenue per visitor as the primary outcome to assess whether larger completed orders compensate for lost conversion.

### Should shipping cost affect the decision?

Yes. Track shipping cost per order and its effect on margin. Higher revenue may still be unattractive if the shipping subsidy causes an unacceptable margin loss.