A/B Testing QA Checklist

70 platform-agnostic checks from test design through launch monitoring — SRM, guardrails, snippet install, goals, targeting, preview, and statistical validity. Works with any A/B testing tool.

Before Launch — Test Setup

GrowthLayer and enterprise CRO post-mortems show most failed tests break down here — weak hypotheses, wrong metrics, or unrealistic sample plans. Pass every item before a single visitor enters the experiment.

Snippet & Script Installation

Verify your testing tool is installed correctly so visitors bucket reliably and conversions are captured from the first pageview.

Performance & Flickering

Flicker and slow loads don't just hurt UX — they bias test results when users leave before the variant renders.

Goal & Event Tracking

A perfectly executed variant is worthless if conversions aren't counted accurately. Validate tracking before traffic, not after.

Targeting & Traffic

Confirm the right visitors enter the test at the intended split — misconfigured targeting silently wastes weeks of traffic.

Preview & Live QA

Validate every variant against the hypothesis before launch. Brillmark's QA process treats this as the final gate — one broken variant invalidates the entire experiment.

Launch Monitoring

The first 24–48 hours catch Sample Ratio Mismatch, tracking failures, and traffic skew — issues that make results uninterpretable if ignored.

During & After the Test

Protect statistical validity when reading results and close the loop so learnings compound — even flat and losing tests have value.

Works with any A/B testing platform. Plan smarter experiments and ship with confidence.

Get FREE Access
Free forever 50,000 users
Related tools

Sample size calculator, duration calculator, and significance calculator help you plan and validate results alongside this checklist.

Data storage

Progress saves automatically in your browser. Use Export and Import in the toolbar to back up or share with your team.

Free A/B testing QA checklist

Use this interactive checklist before and after every experiment — no spreadsheet required. Covers test design, snippet install, anti-flicker, goals, targeting, preview QA, launch monitoring, and statistical validity.

What this QA checklist covers

  • Hypothesis, guardrails, sample size, and test design
  • Snippet placement, anti-flicker, and performance
  • Goal and revenue tracking validation
  • Targeting, traffic split, and SPA triggers
  • Preview QA across browsers and devices
  • Launch monitoring including Sample Ratio Mismatch (SRM)
  • Post-test analysis, segments, and implementation

How to use it

  1. Pick a category from the tabs above.
  2. Work through each item and check it off when done.
  3. Export your progress to back up or share with your team.

Frequently asked questions

Is this A/B testing QA checklist free?

Yes. All 70 checks are free with no email gate. Works with any client-side A/B testing platform.

What is Sample Ratio Mismatch (SRM)?

SRM means your actual traffic split doesn't match your configured split — often from a tracking or bucketing bug. Check within 24 hours of launch; invalid SRM means results can't be trusted.

When should I use this checklist?

Run through Test Setup and Snippet sections before launch, Preview QA the day before go-live, then Launch Monitoring daily for the first 48 hours. Use After Test when the experiment ends.