Loss or Gain Framing in Trial-End Messages A/B Test

Paid upgrade rate

Compare paid upgrades among all eligible assigned trial users.

• Paid upgrade rateCompare paid upgrades among all eligible assigned trial users in each message arm.
• Cancellation rateCompare subscriptions with the same completed follow-up period after paid signup.
• Notification opt-out rateTrack users who turn off message notifications over the same follow-up period.
• Message-related support requestsCompare questions or complaints about message accuracy or tone using the same denominator.

• FramingCompare loss-framed and gain-framed versions of the same trial-end information.
• SpecificsInclude the same feature details and accurate access implications in both versions.
• TimingKeep channel, send time relative to trial end and frequency unchanged.
• PerceptionIf measuring how the message feels, use the same question, timing and sampling method in both arms.
• UsageReview activity segments defined before assignment.

1. 1Do not imply users will lose a feature they will actually keep.
2. 2Change message framing only; keep send timing the same.
3. 3Do not use loss framing to pressure an immediate decision without time to consider it.
4. 4Do not send the same message repeatedly in short intervals; test frequency separately.
5. 5Do not imply that data will be lost when it will remain available on the free plan.