All testsAli Demirbaş - Lab

Home & Landing

Testing a Language-Adapted Greeting on the Homepage

A greeting in a familiar language may help visitors recognize that the page is relevant to them. A mistaken language guess or a greeting that conflicts with the rest of the page can be confusing. The variant changes only the greeting; it does not test a fully localized page.

A/B test scenario. This page is a test plan, not the result of a real experiment.

  • Home & landing
  • Primary action completion rate

Control vs Variant

Same slot, different words.

Changed
Wording
Page
Home & landing
Difference
changed

Hypothesis

If visitors with no explicit language preference are greeted in their browser language, they may notice sooner that the page speaks to them. Even with the rest of the page unchanged, the primary action completion rate could rise, while a wrong match could have the opposite effect.

Test plan

When to run this test

You can tell the default-language greeting feels distant to part of the audience from noticeable bounces among visitors whose browser runs in another language, frequent use of the language selector, and support tickets about language. If the adapted greeting lands, these visitors stay on the page and move on to the main action without reaching for the selector. If the real issue is that the rest of the page is not in their language, plan the translation first, because translating only the greeting is not a lasting fix.

How to measure success

Primary action completion rate

Compare completion to see whether a tailored greeting changes the target action.

Also track

  • Bounce rateMake sure a language mismatch does not increase exits.
  • Language change rateTreat manual language changes as preference information; not every change is a failure.
  • Page load timeMake sure detection does not add delay.
  • Conversion by languageReview which languages show a gain and which do not.

How to set it up

  • GreetingPersonalize only the greeting using a predefined browser-language match.
  • Existing choicePreserve the visitor's explicit language preference in both arms.
  • Page contentKeep the rest of the page fixed and record language mismatches.
  • Fallback and controlKeep a visible language selector and a default for unsupported languages.
  • InterpretationReview supported languages separately before expanding the approach.

What to watch when reading the result

  1. 1Weigh any lift in completed primary actions against the bounce rate; if wrong language guesses push more visitors out, the gain is not solid. Do not treat a higher language change rate as failure on its own, and check that detection does not slow down page load time.
  2. 2Base the match on browser language only; do not infer language from location or use a greeting that implies you know where the visitor is. Even if the variant wins, it does not show the effect of a fully localized page.
  3. 3Read conversion by language separately for each supported language, and do not carry a gain in one language over to the others. If a low-traffic language could leave the result unclear, estimate the traffic it needs with the sample size calculator; if the traffic falls short, report that language as inconclusive rather than as a win.

Frequently Asked Questions

Does this variant translate the whole page?

No. It adapts only the greeting using a predefined browser-language mapping. It does not estimate the effect of a fully localized page.

What if the visitor has explicitly selected a language?

Preserve that choice in both arms. Keep a visible language selector and a fallback for unsupported languages rather than overriding explicit preference.

Does more manual language switching mean the variant failed?

Not necessarily. It can reveal preference or incorrect detection. Use primary action completion as the primary outcome, track purchase conversion alongside it, monitor mismatches and inspect languages separately.