All testsAli Demirbaş - Lab

Search & Filtering

Should Filters Stay Sticky While Scrolling? A/B Test

A sticky filter panel keeps controls available without scrolling back to the top. It also takes screen space away from products. Compare the same panel fixed versus in its normal position, not a full panel versus a small filter button.

A/B test scenario. This page is a test plan, not the result of a real experiment.

  • Filters
  • Purchase conversion rate (CR)

Control vs Variant

What the interface does on its own is the variable.

Changed
Behavior
Page
Filters
Difference
changed

Hypothesis

If the filter panel stays on screen while visitors scroll, someone deep in a long listing can change filters without going back to the top. That could help more visitors reach suitable products and raise purchase conversion rate, although the space the panel takes may leave fewer products in view.

Test plan

When to run this test

Session recordings with repeated trips back to the top of long listings, filter changes that start only after a long scroll, or heatmaps where the panel is used only on the first screen all suggest visitors are scrolling up just to reach the filters. With a fixed panel working as intended, filters get used mid-scroll and visitors reach suitable products by a shorter route. If visitors reach the filters and still dislike the results, the options are the more likely problem, so look at them first; leave the options unchanged in this test and compare only whether the same panel stays fixed.

How to measure success

Purchase conversion rate (CR)

Compare purchases among eligible visitors assigned to the filter panel when it is usable, over the same follow-up window.

Also track

  • Filter usage rateMeasure filter use among eligible assigned visitors who can access the panel.
  • Products actually seenCount distinct products that enter the viewport in the same list and time window.
  • Listing-to-product click-through rateCompare transitions from a product-list impression to a product page.
  • Zero-result rateTrack searches with no results among those where filters are applied.

How to set it up

  • Sticky behaviorKeep the full panel the same and define one fixed sticky rule.
  • Screen spaceReview remaining screen area and product visibility beside or below the panel.
  • Panel designKeep panel content and size unchanged; a floating filter button is a different treatment.
  • TriggerSet the scroll point where the panel becomes sticky before launch.
  • DeviceInclude only layouts where the panel is usable and its behavior differs.

What to watch when reading the result

  1. 1Higher filter usage rate cannot call a winner; purchase conversion rate is the measure. If products actually seen and listing-to-product click-through rate fall, the panel may be crowding out products, so do not build it so large that only a narrow strip is left for the listing.
  2. 2Make sure before launch that content and controls under the fixed panel stay reachable and that keyboard focus order still makes sense as visitors tab through it. If a layout fails either check, fix it before you count that layout's result as a gain.
  3. 3What this test tells you is limited to this panel, the scroll point you set in advance and the layouts you included. A floating filter button or a different page layout is a separate comparison, so validate it on its own before carrying the result over.
  4. 4Purchases happen less often than filter use, so a modest difference can stay unclear for a long time. Before launch, enter the current purchase conversion rate and the lift you would not want to miss into the sample size calculator. Divide the sample it gives per variant by one arm's daily eligible visitors; if the run that implies is too long, this traffic cannot detect the effect you expect.

Frequently Asked Questions

Does more filter use mean the fixed panel won?

No. Compare purchases over the same window among eligible assigned visitors on supported layouts. Visible product count and product clicks explain whether the panel reduces browsing space.

What accessibility risks does a fixed panel create?

It can cover focused content or controls and disrupt keyboard navigation. Check narrow viewports and browser zoom, including remaining product width. There is no universal half-screen limit.

Which layouts should be included?

Include only usable layouts where the panel variants actually differ. Check product visibility beside or below the panel. Keep filter options unchanged.