Showing a Visible No Thanks Option on an Offer A/B Test

Total offer acceptance rate

Count acceptances among all eligible assigned users over a predefined period; do not count repeat acceptances twice.

• First-impression acceptance rateMeasure acceptance on the first offer display.
• Repeat visit rateCompare all assigned users over the same follow-up period; do not select only those who declined.
• Offer-related complaintsTrack complaints about the visibility of the decline option or repeated offers.
• Withdrawal rateIf withdrawal is possible for this offer, compare later withdrawals over the same period.

• Decline optionAdd a visible “Not now” option to the optional offer, which already has an exit.
• Keep constantKeep the offer, acceptance action, eligibility and existing exit behavior unchanged.
• Follow-upUse the same observation period and repeat-offer policy in both arms.
• AudienceReview new and existing users separately.
• Separate testsTest decline wording and repeat-display timing separately.

1. 1Do not make the decline option too faint or small to read.
2. 2Do not repeatedly show the same offer to visitors who decline during the same session.
3. 3Do not stop the test just because immediate acceptance falls; review total and later behavior.
4. 4Do not test making decline harder for legally required consent, such as marketing permission or cookies.
5. 5Do not change the decline option and offer content together.