CaddieOpen in CaddieDownload for Mac

Optimizing clarity of payment options: Chick-fil-A's A/B test

Shared by Caddie Library · Updated
Chapters show their main points

The bottom line

Chick-fil-A fixed a misleading payment screen in its app by testing new layouts and CTAs, so customers saw they could pay by credit card and not only with the loyalty card. Credit card payments rose 6% and complaints fell to zero.

Key takeaways

  • The old payment screen made customers think only the loyalty card was accepted. That belief lowered cart conversions.
    • The problem was in the app's UX, not in the payment options themselves.
  • New layouts and CTAs made the payment options clear. Clearer options removed the confusion.
  • The fix improved both sales and customer experience. Credit card use went up and complaints stopped.
    • Credit card payments rose 6%.
    • Customer complaints fell to 0.

The problem and the test

The old checkout hid that credit cards worked
Chick-fil-A tested new layouts and CTAs in its app's checkout to make every payment option visible.

A misleading checkout UX hid the fact that credit cards were accepted, and Chick-fil-A tested new designs to fix it.

  • Customers wrongly believed they could only pay with the loyalty card.
    • This led to lower cart conversions.
  • Chick-fil-A tested new layouts and CTAs to clarify the payment options.
    • The test ran in the Chick-fil-A app, in the checkout and sales category.
Version A and version B as Chick-fil-A tested them.
Version A and version B as Chick-fil-A tested them. Screens from abtest.design.

The result

A clearer screen lifted card payments and ended complaints
Old screenNew screen
Options shownLoyalty card dominantCard and loyalty, clear
Customer beliefLoyalty card onlyCredit cards accepted
Credit card paymentsBaseline+6%
ComplaintsRecurring0
The issue was the UX, not the payment options, so clarifying the design fixed both sales and customer experience.

The clearer design resolved the confusion and raised credit card payments.

  • Credit card payments increased by 6%.
  • Customer complaints about the issue dropped to 0.
    • The confusion was eliminated and the overall user experience improved.

In the growth library

Chick-fil-A, Checkout & sales test. Clear payment options at checkout stop customers from wrongly believing they can only pay with a loyalty card. Chick-fil-A tested new layouts and CTAs and got a 6% increase in credit card payments and customer complaints about the issue dropped to 0.

Lessons that draw on this:

More from abtest.design · The whole library, and ask it anything