Category Ordering A/B Test on Listing Pages

Purchase conversion rate (CR)

Compare purchases among all eligible visitors assigned to each category order, not only visitors who click a category.

• Category click-through rateSee whether the categories moved higher in the list receive more clicks.
• Revenue per visitor (RPV)Compare revenue per eligible assigned visitor to capture changes beyond category clicks.
• Average order value (AOV)Review order value alongside conversion and RPV.
• Exit rateTrack whether visitors leave the listing experience more often.

• OrderCompare the current category order with the same categories ordered by category-page visits over the 90 days before launch.
• Keep constantDo not change category names, images, product ranking or card design.
• DiscoveryReview category clicks and product discovery alongside purchases.
• ConversionInclude all eligible assigned visitors in the purchase comparison, including those who do not click a category.
• DeviceReview mobile and desktop separately.

1. 1Keep each visitor assigned to the same category order throughout the test.
2. 2Keep category labels and mobile readability intact.
3. 3Make key categories such as New Arrivals and Outlet easy to find in both versions.
4. 4Change order only; do not rewrite category labels in the same test.
5. 5Use a fixed, pretest data window for the performance-based order.