Ali Demirbaş - Lab
TRGet in touch

Forms & Signup

Autocomplete Suggestions in Form Fields A/B Test

Suggestions for fields such as address or company may reduce typing and spelling errors.

  • Forms & signup
  • Form completion rate

Control vs Variant

Absent on one side, present on the other.

Changed
Presence
Page
Forms & signup
Difference
added

Hypothesis

Incorrect matches can create bad data, and a suggestion list may obstruct mobile entry, so assess completion and data accuracy separately.

How to run this test

Primary metric

Form completion rate

Compare successful submissions to see whether autocomplete suggestions affect completion.

Other metrics

  • Submitted-data accuracyCheck selected suggestions and typed values against the same accuracy criteria.
  • Form completion timeMeasure time from field entry to successful submission consistently in both arms.
  • Abandonment at suggested fieldsTrack visitors who leave at a field with suggestions.
  • Correction and support workloadCompare recorded corrections and support requests caused by inaccurate suggestions.

What to check before and during the test

  • SuggestionsEnable suggestions for the predefined set of fields while preserving free-text entry.
  • Keep constantKeep fields, validation, suggestion source and the variant's list length unchanged.
  • AccuracyCheck selected suggestions against the same quality criteria as manual entries.
  • InputVerify keyboard navigation and compatibility with the mobile keyboard.
  • Separate testsTest suggestion count or data source separately.

Setup mistakes to avoid

  1. 1Do not remove free-text entry and force visitors to choose from a list.
  2. 2Verify before launch that the suggestion source covers the eligible users well enough.
  3. 3Do not change autocomplete and field count together.
  4. 4Do not call a win from completion alone without checking data accuracy.
  5. 5Keep suggestions navigable by keyboard.