Ali Demirbaş - Lab

Mobile App

Making One Service Icon Larger: Mobile App A/B Test

Enlarging one service icon may draw attention to that service at the expense of others.

  • Mobile app
  • Featured service completion rate

Control vs Variant

The same element, larger or smaller.

Changed
Size
Page
Mobile app
Difference
changed

Hypothesis

Judge the result by completed actions for the highlighted service, not icon clicks alone.

How to run this test

Primary metric

Featured service completion rate

Compare completed actions for the featured service per assigned visitor.

Other metrics

  • Icon click-through rate (CTR)Check whether a larger icon receives more clicks.
  • Category entry rateMeasure visits to the service's target page.
  • Clicks on other servicesMake sure other services are not overshadowed.
  • Navigation efficiencyCheck whether visitors reach the target page in fewer steps.

What to check before and during the test

  • SizeIncrease one predefined service icon by a fixed amount.
  • AppearanceKeep color, position, label and destination unchanged.
  • Other servicesDo not change other icons or access paths.
  • PlacementA different order or screen position requires a separate test.
  • SelectionDo not change the featured service or add another service during the test.

Setup mistakes to avoid

  1. 1Feature only one service in this comparison.
  2. 2Do not let the larger icon overshadow access to other categories.
  3. 3Do not make the icon so large that it looks like a banner.
  4. 4Do not change color, placement and size together.
  5. 5Do not stop at clicks; check service completion.