# A/B Test: Confirming Choices Made During Checkout

Page: https://alidemirbas.com.tr/en/lab/ab-test-library/tests/ab-test-confirming-choices-made-during-checkout

## Hypothesis

If a short written confirmation appears after a size, quantity or day selection, shoppers may feel sure the choice went through and move on without clicking again. Provided the message does not shift the layout, the order completion rate could go up.

## When to run this test

Repeated clicks on the same option in session recordings, shoppers changing a selection before finishing, or support contacts about the wrong size or quantity hint that shoppers cannot tell whether a selection was saved. If the confirmation works, repeat clicks drop and shoppers pause less after a selection before completing the order. Before launch, verify that the message appears only once the selection is actually saved; if the problem is the selection control itself, fix that first.

## Primary metric

**Order completion rate**: Compare completed orders to see whether written selection confirmation affects completion.

## Other metrics

- **Selection error rate**: Measure errors only through predefined correction events or user reports.
- **Repeat click rate**: Track visitors who click the same option again after selecting it.
- **Post-selection change rate**: Compare how often visitors change their selection before completing the flow.
- **Order return rate**: Track returns over the same follow-up period; report selection-related returns separately where identifiable.

## What to check before and during the test

- **Written confirmation**: Show a short message after the selection is saved.
- **Keep constant**: Keep the selection control, save behavior and existing color or icon states unchanged.
- **Diagnostic measures**: Track selection errors and repeat clicks to help explain any change in completion.
- **Layout**: Keep the message from shifting content or causing accidental clicks.
- **Accessibility**: Check mobile visibility and screen-reader announcement; test timing or icon changes separately.

## What to watch when reading the result

- Fewer repeat clicks or selection errors do not make a win unless the order completion rate improves too; those measures only explain a change in completion. Count selection errors only from predefined correction or user-report records.
- A selection-related effect may surface later in returns, so track the order return rate in both versions over the same follow-up window, and report selection-related returns separately if you can identify them. The finding covers the written confirmation format in this checkout; check mobile apart from desktop, and keep timing or icon comparisons for later tests.
- The effect of a confirmation may be small, so do not cut the test short. Set the number of visitors you need per version up front with the [sample size calculator](https://alidemirbas.com.tr/en/calculators/sample-size-calculator), and do not decide before you reach it. If you reach it and the gap is still unclear, do not treat that as evidence that the confirmation has no effect.

## Frequently Asked Questions

### Does fewer repeated clicking mean the test won?

Use order completion as the primary outcome. Repeated clicks and invalid selections help explain the result. Fewer interactions alone do not establish improved completion.

### How should a saved-selection confirmation be shown?

Use a short message that does not shift surrounding content or clutter the interface. Check mobile visibility and screen-reader announcements. Avoid introducing layout movement that creates accidental clicks.

### When should the confirmation appear?

Only after the selection has actually been saved. An earlier confirmation can mislead the user. Provide a textual signal rather than relying on a color change alone.