Ali Demirbaş - Lab
TRGet in touch

Search & Filtering

Header Search Field vs Menu Search A/B Test

A visible search field makes search easier to discover.

  • Search
  • Purchase conversion rate (CR)

Option A vs Option B

Where it sits is the variable; the element itself does not change.

Changed
Placement
Page
Search
Difference
moved

Hypothesis

Moving it into the menu frees header space but adds a step. Since placement may change who searches, use total purchase conversion as the decision metric; conversion among searchers is diagnostic.

How to run this test

Primary metric

Purchase conversion rate (CR)

Compare purchases among all eligible assigned visitors, not only those who use search.

Other metrics

  • Search usage rateCompare search starts among eligible assigned visitors who can see the search control.
  • Product click-through after searchReport clicks among search users as diagnostic; the primary decision includes all assigned visitors.
  • Search success rateDefine a successful search event before launch and measure the share of submitted queries that meet it.
  • Purchase rate after searchReport purchases among search users as diagnostic; keep non-searchers in the primary denominator.

What to check before and during the test

  • Search usageCompare the always-visible header field with search opened from the menu.
  • Search conversionReport conversion among search users separately; they are not equivalent randomized groups.
  • Finding a productCompare time from search to product click using the same events.
  • Result qualityDefine search success in advance and report all assigned visitors separately from search users.
  • DeviceInclude only devices where the search placement differs and report device results separately.

Setup mistakes to avoid

  1. 1Keep other navigation destinations accessible when search moves into the menu.
  2. 2Keep placeholder text short and readable.
  3. 3Do not change the search suggestion algorithm during the test.
  4. 4Keep the mobile search icon easy to tap.
  5. 5Provide useful results when a search returns no matches.