Ali Demirbaş - Lab
TRGet in touch

UI Elements

Announcement Bar Timing: Immediate or Delayed A/B Test

Showing the campaign banner on page load presents it immediately.

  • UI elements
  • Campaign page visit rate

Option A vs Option B

The moment is the variable, not what appears.

Changed
Timing
Page
UI elements
Difference
changed

Hypothesis

Waiting until visitors scroll 50% of the page gives them time to engage first, but those who do not reach that point will not see it. Compare the two timings while keeping the banner, placement, frequency, and campaign action the same.

How to run this test

Primary metric

Campaign page visit rate

Compare campaign-page visits among all eligible assigned visitors, including those who never reach the delayed trigger.

Other metrics

  • Announcement bar reachCompare the share of assigned visitors who see the bar.
  • Unintended click rateTrack unintended clicks associated with the bar's appearance.
  • Overall purchase conversion rate (CR)Compare purchases among all eligible assigned visitors.
  • Page exit rateCompare exits using the same session window.

What to check before and during the test

  • TimingCompare display on page load with display after the visitor scrolls 50% of the same page.
  • TriggerUse 50% scroll as the only delayed trigger; do not add a timer or inactivity rule.
  • PlacementKeep the bar in the same stable position in both versions.
  • FrequencyKeep the frequency cap and dismissal behavior unchanged.
  • DeviceCheck mobile timing and whether the bar obstructs content.

Setup mistakes to avoid

  1. 1Reserve space so the bar does not shift the page content when it appears.
  2. 2Change timing only; keep the bar content unchanged.
  3. 3Do not show a dismissed bar repeatedly in the same session.
  4. 4Do not trigger the delayed bar while the visitor is completing another action.
  5. 5Do not call a winner from reach or clicks alone; review campaign-page visits.