SaaS & B2B
Should Lead Forms Require a Work Email? A/B Test Idea
A work-domain rule excludes some personal email addresses, but does not prove that a request is qualified or genuine. It may also block real buyers who use personal addresses. Compare qualified opportunities per visitor using the same post-submission qualification process.
A/B test scenario. This page is a test plan, not the result of a real experiment.
- SaaS & B2B
- Qualified opportunity rate
Option A vs Option B
Two alternatives; neither is the incumbent.
- Changed
- Options
- Page
- SaaS & B2B
- Difference
- changed
Hypothesis
Requiring a business email may screen out some spam and personal accounts, but it can also turn away real buyers who use a personal address; accepting any address lets those buyers in along with more unverifiable inquiries. Which option leads on the qualified opportunity rate could depend on which of these two effects is larger.
Test plan
When to run this test
Sales spending a lot of time screening inquiries and complaining about spam leads, while support hears from visitors who could not submit with a personal address, is the tension between quality and volume this test is built for. If that assumption is right, one option brings more qualified opportunities per assigned visitor, whatever happens to submission volume. Before launch, review the blocked-domain list so it does not reject legitimate business providers; an overly broad list makes the restricted option reject real buyers.
How to measure success
Qualified opportunity rate
Compare qualified opportunities per assigned form visitor over the same follow-up period.
Also track
- Valid form submission rateCompare valid submissions among eligible visitors who see the form.
- Opportunity close rateCompare opportunities won using the same qualification rule and sales follow-up period.
- Spam or invalid inquiry rateMeasure the share of submitted forms that are spam or cannot be verified.
- Sales prequalification timeCompare time spent reviewing inquiries using the same method.
How to set it up
- RequirementCompare a mandatory business email domain with allowing personal email addresses.
- QualificationKeep the sales qualification standard the same.
- Domain ruleVerify and fix the domain list before launch.
- Error messageGive a clear explanation when an address is rejected.
- Business sizeReview small businesses without assuming email type determines lead fit.
What to watch when reading the result
- 1Decide on the qualified opportunity rate. A higher valid form submission rate in the open option is not a win if the spam or invalid inquiry rate and sales prequalification time rise with it. Do not relax the rule because of submissions alone; keep following the opportunity close rate until both arms' follow-up windows have closed.
- 2If you accept personal addresses and quietly disqualify those leads later, you mislead visitors and measure the two options by different rules. Keep every other form field the same so the difference can be tied to the email rule alone. The result holds for this form and this domain list; review small-business leads separately.
- 3Qualified opportunities and closed deals only show up fully once the follow-up period ends, so do not decide early on a small gap. Enter the current qualified opportunity rate and the smallest relative lift you would not want to miss in the sample size calculator to get the visitors needed per arm. Divide that by daily eligible traffic per arm and add the follow-up period on top; if the difference is still unclear at the end, report that the two rules did not separate in this sample.
Frequently Asked Questions
Does requiring a business email guarantee lead quality?
No. Domain restrictions can exclude personal accounts but do not prove authenticity or qualification. They can also exclude real buyers. Use qualified opportunities per assigned visitor as the primary outcome.
How should the restricted-domain list be built?
Validate and fix it before launch. Avoid blocking genuine business providers. Show one clear explanation when an address is rejected.
What risks should I monitor when personal addresses are accepted?
Compare spam or unverifiable submissions and sales screening time. Do not accept personal addresses and silently discard them later. Compare close rates with consistent qualification and follow-up rules.
Should small-business leads be examined separately?
Yes. Do not assume email type determines suitability. Restrictions may exclude genuine small-business buyers. Keep other form fields fixed.
More tests in SaaS & B2B
All testsLoss or Gain Framing in Trial-End Messages A/B Test
SaaS & B2BPaid upgrade rate
An experiment example on wording the pre-expiry message, framed as losing access or as continuing to use a feature. See both arms, risk and the KPI.
Adding a Why We Ask Note Beside a Form Field A/B Test
SaaS & B2BValid completion rate for the selected field
An experiment example for fields with an unclear purpose, such as company size: no explanation against a short reason beside the field. Arms and KPI.
One-Column or Two-Column Sales Page: A/B Test Example
SaaS & B2BPurchase conversion rate (CR)
A structural experiment comparing a page with a side column of links and extra info against a single linear column. See both arms, risks and the KPI.
