All testsAli Demirbaş - Lab

Forms & Signup

Warm-Up Question Before a Long Form A/B Test

One easy, relevant question before the main form may give visitors a small first step. It also adds another point where they can leave. Compare the full journey from assignment and keep the main form unchanged; this test adds a question rather than revealing its existing fields progressively.

A/B test scenario. This page is a test plan, not the result of a real experiment.

  • Forms & signup
  • Form completion rate

Control vs Variant

Absent on one side, present on the other.

Changed
Presence
Page
Forms & signup
Difference
added

Hypothesis

If visitors first answer one easy question, that small first step may make them more willing to continue into the long main form. Measured across all assigned visitors, including those who leave before the question, the form completion rate could rise, unless the extra step creates enough drop-off of its own to cancel the gain.

Test plan

When to run this test

In form analytics, people who leave without touching the first field, or session recordings of visitors scrolling through the long form and closing the page, show visitors giving up as soon as they see it. A good warm-up question moves those who answer it on to the main form, and fewer drop out at the start. When the form is simply longer than it needs to be, test cutting fields separately first; a warm-up step does not replace that. If you will use the answer for another purpose, such as segmentation, tell users and establish the appropriate processing basis.

How to measure success

Form completion rate

Compare submissions of the main form among all eligible assigned visitors, including those who leave before the warm-up question.

Also track

  • Warm-up question response rateTrack the share of visitors who answer and continue.
  • Total completion timeMake sure the warm-up does not materially increase total completion time.
  • Lead qualityCheck that the warm-up does not reduce lead quality.
  • Abandonment rateTrack abandonment at the warm-up step.

How to set it up

  • QuestionAdd one predefined, relevant question before the unchanged main form.
  • Skip optionLet visitors continue without answering.
  • Keep constantKeep the main form fields, validation and submission behavior unchanged.
  • TransitionPredefine the transition; do not test question type and transition design together.
  • DeviceReview mobile and desktop results separately.

What to watch when reading the result

  1. 1A high warm-up question response rate is not a success on its own. Calculate the form completion rate with everyone who left before the question in the denominator, and do not treat a lift as a reason to ship if abandonment at the warm-up step, total completion time or lead quality gets worse.
  2. 2This result covers only this question, this transition and this unchanged main form; test another question type or transition separately. Check mobile and desktop on their own, since the cost of an extra screen can differ by device.
  3. 3A small or unclear gap may mean that what the extra step gains and what it loses are canceling out. Work out up front how many visitors each arm needs to detect the completion gap you expect with the sample size calculator, and do not read the result before you reach that number.

Frequently Asked Questions

Why must the denominator begin before the warm-up question?

The extra step can create abandonment. Include all visitors assigned before it, not just respondents, and measure completion of the main form from that common population.

What if someone does not want to answer the warm-up question?

Provide a way to skip it and continue. Keep the question relevant. Explain any additional use of the response and establish the appropriate processing basis.