Ali Demirbaş - Lab

Category & Listing

Graying Out vs Hiding Out-of-Stock Products A/B Test

Hiding out-of-stock products keeps a category list focused on purchasable items but may make the assortment seem smaller.

  • Category listing
  • Category-page purchase rate

Option A vs Option B

Absent on one side, present on the other.

Changed
Presence
Page
Category listing
Difference
removed

Hypothesis

Showing them in gray preserves the sense of variety, yet a list full of unavailable items may frustrate shoppers.

How to run this test

Primary metric

Category-page purchase rate

Compare purchases among category visitors assigned to the two out-of-stock display approaches.

Other metrics

  • Product detail click-through rateCompare visits to in-stock product pages between arms.
  • Category-page exit rateTrack exits among visitors who see the category page.
  • Back-in-stock signup rateTrack this only if a “notify me” flow already exists; do not add a new signup flow.
  • Listing load timeCheck whether stock-status and label handling affects load time.

What to check before and during the test

  • DisplayShow the same out-of-stock products in gray in one arm and hidden in the other.
  • Keep constantKeep the order, filters and stock data for available products the same.
  • PurchasesCompare purchases among all eligible visitors assigned to the category-page experience.
  • Out-of-stock shareRecord the share of products out of stock; eligibility should be comparable between arms.
  • Existing flowIf a back-in-stock notification already exists, keep it the same in both arms.

Setup mistakes to avoid

  1. 1Do not change sorting along with gray styling.
  2. 2Do not make unavailable products appear purchasable.
  3. 3Track the effect of hiding products on category browsing.
  4. 4Do not interpret results if stock levels are unbalanced across arms.
  5. 5Do not switch on a “show in-stock only” filter without the visitor's choice.