Ali Demirbaş - Lab

Forms & Signup

Adding Social Sign-In to a Signup Form A/B Test

Social sign-in may remove the need to create another password.

  • Forms & signup
  • Account registration completion rate

Control vs Variant

Absent on one side, present on the other.

Changed
Presence
Page
Forms & signup
Difference
added

Hypothesis

Some users may hesitate to share account data or use a personal account for work, and they may forget which sign-in method they used later. Review activation and repeat sign-in alongside registration.

How to run this test

Primary metric

Account registration completion rate

Compare completed registrations among eligible users assigned before choosing a sign-up method.

Other metrics

  • Repeat sign-in success rateCompare successful repeat sign-ins over the same follow-up period.
  • First post-registration action rateCompare completion of the predefined first product action over the same period.
  • Sign-in-related support contactsTrack requests about using a sign-in method or recovering an account.
  • Email verification completion rateTrack email verification in both arms; collecting an email address does not imply consent to marketing.

What to check before and during the test

  • OptionAdd the predefined social sign-in provider or provider set while keeping email registration available.
  • Keep constantKeep email fields, provider permissions and security steps unchanged.
  • Return accessCheck whether users can identify their method and sign in again.
  • AudienceIf already defined, review individual and business contexts separately.
  • Separate testsTest provider count and button hierarchy separately.

Setup mistakes to avoid

  1. 1Do not make social sign-in the only option or remove email registration.
  2. 2Make clear what information the provider shares.
  3. 3Do not add social sign-in and reduce form fields together.
  4. 4Do not call a win from more registrations without checking activation.
  5. 5Do not treat security checks in the identity flow as friction to be tested away.