Ali Demirbaş - Lab

Category & Listing

Menu Category Order A/B Test on Listing Pages

Categories near the top of a menu may draw more attention.

  • Category listing
  • Purchase conversion rate (CR)

Option A vs Option B

Position in the menu is the variable.

Changed
Menu order
Page
Category listing
Difference
changed

Hypothesis

More clicks on those categories do not necessarily mean more purchases; use conversion as the decision metric and browsing measures to explain the result.

How to run this test

Primary metric

Purchase conversion rate (CR)

Compare purchases among all eligible visitors assigned to each menu order, not only those who open the menu or select a category.

Other metrics

  • Category click-through rateCompare clicks on categories moved higher in the menu.
  • Menu interaction depthCount interactions needed to reach a category; this does not measure elapsed time.
  • Menu scroll depthUse scroll behavior to describe navigation, not as proof that content was read.
  • Exit rateTrack whether visitors leave more often after seeing the menu.

What to check before and during the test

  • OrderCompare the current menu order with the same categories ordered by category-page visits over the 90 days before launch.
  • Keep constantKeep category names, icons and menu structure unchanged.
  • NavigationMeasure category clicks and the path to the selected category.
  • ConversionCompare purchases across all eligible assigned visitors, not only category clickers.
  • DeviceReview mobile and desktop menus separately.

Setup mistakes to avoid

  1. 1Keep each visitor in the same menu-order variant throughout the test.
  2. 2Do not change category names or icons at the same time.
  3. 3Keep high-value categories findable in both versions.
  4. 4Make sure the reordered menu remains usable on mobile.
  5. 5Choose the order using both navigation and business performance, not clicks alone.