Ali Demirbaş - Lab

Search & Filtering

Previous Searches vs Empty Search Box A/B Test

Previous queries may help returning visitors resume a search quickly.

  • Search
  • Purchase conversion rate (CR)

Option A vs Option B

Two alternatives; neither is the incumbent.

Changed
Options
Page
Search
Difference
changed

Hypothesis

They may also steer users toward outdated interests or expose history on a shared device. The comparison shows suggestions when the field opens; it does not prefill a query.

How to run this test

Primary metric

Purchase conversion rate (CR)

Compare purchases per eligible assigned visitor with search history available, including those who do not submit a new query.

Other metrics

  • Search start rateCompare search starts between the history-suggestion and empty-field arms.
  • Time to search resultMeasure time among visitors who start a search; report non-searchers separately.
  • Zero-result search rateMeasure the share of submitted queries that return no results.
  • Product page visit after searchReport product-page visits among search users as a diagnostic measure.

What to check before and during the test

  • History suggestionsShow previous queries when search opens or leave the initial suggestion area empty.
  • InputKeep the input field blank until the visitor types or explicitly selects a query.
  • Other suggestionsKeep suggestions for typed queries unchanged.
  • History controlsProvide the same separate access and delete controls in both arms.
  • PrivacyDo not show history from private sessions or entries the user deleted; apply the same storage and deletion rules in both arms.

Setup mistakes to avoid

  1. 1Keep a separate way to access history in the empty-field arm.
  2. 2Do not change placeholder copy during the test.
  3. 3Keep category and filter names unchanged.
  4. 4Do not remove all autocomplete suggestions.
  5. 5Keep the suggestion source, algorithmic or curated, unchanged.