Ali Demirbaş - Lab

Home & Landing

Testing a Language-Adapted Greeting on the Homepage

A greeting in a familiar language may help visitors recognize that the page is relevant to them.

  • Home & landing
  • Primary action completion rate

Control vs Variant

Same slot, different words.

Changed
Wording
Page
Home & landing
Difference
changed

Hypothesis

A mistaken language guess or a greeting that conflicts with the rest of the page can be confusing. The variant changes only the greeting; it does not test a fully localized page.

How to run this test

Primary metric

Primary action completion rate

Compare completion to see whether a tailored greeting changes the target action.

Other metrics

  • Bounce rateMake sure a language mismatch does not increase exits.
  • Language change rateTreat manual language changes as preference information; not every change is a failure.
  • Page load timeMake sure detection does not add delay.
  • Conversion by languageReview which languages show a gain and which do not.

What to check before and during the test

  • GreetingPersonalize only the greeting using a predefined browser-language match.
  • Existing choicePreserve the visitor's explicit language preference in both arms.
  • Page contentKeep the rest of the page fixed and record language mismatches.
  • Fallback and controlKeep a visible language selector and a default for unsupported languages.
  • InterpretationReview supported languages separately before expanding the approach.

Setup mistakes to avoid

  1. 1Do not infer language from location and imply that you know it about the visitor.
  2. 2Do not treat translating only the greeting as a lasting solution if the rest of the content is not translated.
  3. 3Do not override a language the visitor selected with automatic detection.
  4. 4Do not change language and content layout together.
  5. 5Do not generalize results from one language to all languages.