Conversion optimization basics

The discipline of CRO, research, hypotheses, testing, and what to ignore.

Conversion optimization basics, illustrative cover image

CRO is research-led, not button-color-led

Conversion rate optimization is often reduced to A/B testing button colors. Real CRO is a research discipline: understanding why visitors don’t convert, forming hypotheses about what would help, and testing the changes that have a real chance of moving the needle.

What CRO is and is not useful for

Conversion-rate optimization is a useful discipline within its appropriate scope: improving the conversion rate of pages and flows that already have meaningful traffic and where the underlying offer is strong enough to be worth optimizing. It is not a substitute for product-market fit, for clearer positioning, for better-targeted acquisition, or for fixing fundamentally broken pages. We are explicit about that scope at the start of engagements because programs that try to use CRO to fix problems that are not really conversion problems tend to produce a lot of test results without producing meaningful business change. When the conversion problem is genuinely a conversion problem, CRO is one of the highest-ROI investments a digital program can make.

How serious CRO programs are run

Most CRO programs that produce durable results share a few traits: they prioritize tests against business impact rather than novelty, they require enough sample size to detect realistic effect sizes (which means slowing down rather than speeding up), they document negative results as carefully as positive ones, and they feed learnings back into design and product decisions rather than just A/B test winners. The programs that don't compound usually skip one or more of those, running too many small tests, ignoring statistical rigor, treating the test queue as a checklist of clever ideas instead of a sequence of strategic questions.

The other thing serious programs do is recognize when CRO is the wrong investment. If the underlying conversion problem is product-market fit, pricing, audience targeting, or page speed, no amount of button-color testing will fix it. We're transparent about that diagnosis up front so the work doesn't waste time chasing symptoms.

The research that comes first

Quantitative: funnel analytics, session-replay heatmaps, exit-intent data. Qualitative: surveys, user testing, sales/support input, review-mining. Most experiments fail because the underlying hypothesis was thin \u2014 not because the test was poorly run.

Hypotheses worth testing

A useful hypothesis names: the audience, the change, the expected behavioral mechanism, and the metric. \u201cIf we surface shipping cost earlier on the cart page, mobile shoppers will be less likely to abandon at the address step, increasing checkout completion rate.\u201d

Sample size and statistical honesty

Many tests are called too early. Calculate the sample size needed for the lift you can plausibly detect, run the test for full business cycles, and avoid peeking. Tests on low traffic pages are often better designed as research, not experiments.

What CRO can\u{2019}t fix

  • A product or offer the market doesn’t want.
  • Pricing that’s wrong for the audience.
  • Trust deficits caused by brand or reputation.
  • Tracking that’s broken upstream.

A simple program shape

  1. Set a single primary metric per surface (e.g. checkout completion rate).
  2. Maintain a research backlog and a hypothesis backlog.
  3. Score hypotheses for impact, confidence, and effort.
  4. Run one or two tests per surface concurrently \u2014 not ten.
  5. Document what you learn whether the test wins or loses.

Want a CRO program that compounds?

Tell us about your site and we'll suggest where to start the research.

Start a conversation