Tabellab

A/B testing and experiment courses: prove what actually works

A/B tests, holdout groups and growth experiments all depend on the same few ideas: a clear hypothesis, a big enough sample and an honest reading of the result.

A/B Testing & Experiments courses (7)

$9.90Intermediate

A/B Testing & Experimentation

Plan, size, run and analyse A/B tests in Excel: metrics and MDE, sample size and duration, z-tests, confidence intervals, revenue t-tests, Bonferroni, SRM checks and the peeking trap, then ratio metrics with the delta method, Holm and Benjamini–Hochberg, non-inferiority guardrails, segment interactions, novelty effects, capped revenue, holdouts, triggered analysis, retention windows, business cases, the winner's curse and a full readout dashboard, in 20 graded labs – every cell checked instantly.

20 lessons · 20 labs

$9.90Intermediate

Email A/B Testing: Subject Lines, Send Times, Content & Offers, Sample Sizes, Significance, Holdout Groups & Winner Roll-Out Value

Run email tests you can trust in 20 hands-on labs. You will read a subject line test with open rates, point differences and relative lift, choose the success metric, plan the split, measure the noise of a rate with a confidence interval, test open rates for significance with a z-test and size test cells before sending. Then you find the smallest lift a list can detect on clicks, evaluate send-time, multi-variant content and offer tests, measure incremental orders with holdout groups and size the holdout, value the roll-out of a winner, build a what-if grid for the test share, avoid the peeking problem, break results down by segment, analyse a test log, check whether a lift lasts, prioritise a test roadmap and finish with a yearly scorecard. 20 hands-on labs, fictional stationery shop Quillhaven Paper Co., every cell checked as you go.

20 lessons · 20 labs

$9.90Intermediate

Sample Size & Power Analysis: How Many Observations Do You Need?

Plan studies, surveys and experiments in Excel: margin of error and sample size for means and proportions, the finite population correction, Cohen's d and the MDE, two-group sample sizes with NORM.S.INV, power curves, power and MDE for a fixed n, Bonferroni, dropout and non-response, then paired designs, exact binomial power, cluster and stratified samples, correlations with Fisher's z, sensitivity grids, A/B test duration, a study-plan dashboard, Poisson event rates, covariate adjustment, cost-optimal allocation and a quarter-long A/B test plan, in 20 graded labs – every cell checked instantly.

20 lessons · 20 labs

$9.90Advanced

Incrementality Testing: Geo Holdouts, Matched Markets, Pre-Period Fit, Lift & Confidence, Incremental ROAS, Test Sizing & Attribution Calibration

Measure what advertising really causes. You will compare test and holdout markets, set platform ROAS beside incremental ROAS, choose matched control markets, check the pre-period fit, use difference-in-differences and a regression counterfactual, read weekly and cumulative lift, value it as iROAS and incremental profit against break-even, build confidence intervals, p-values and placebo tests, size test duration, budget and holdout, correct for spillover, split results by market type, read a spend response curve, calibrate attribution with test results and pool several tests, and finish with a complete test readout for Halvern Living, with 20 hands-on labs, fictional data and every cell checked as you go.

20 lessons · 20 labs

$9.90Intermediate

Growth Experiments with AARRR Pirate Metrics: North-Star Metric, Funnel Rates, Growth Accounting, Experiment Backlog & Compounding Loops

Learn growth marketing the way product-led teams run it, entirely in a spreadsheet. You start with the AARRR funnel and turn stage counts into step conversion rates, build a north-star metric from input metrics and measure its weekly and compound growth, and compare acquisition channels by cost per activated user. Then you define the aha moment for activation, read cohort retention curves, work out the referral K-factor and break revenue into paid share, ARPPU, ARPU and lifetime value, and size each funnel leak in extra paying users. Growth accounting splits monthly active users into new, resurrected and churned, with the quick ratio and user states. You score an experiment backlog with RICE, plan sample sizes and run times, read results with a z-test and a sample ratio check, track experiment cadence and compound the wins, simulate a growth loop, compare channel unit economics and build a scenario grid. A final project combines everything in one growth review. 20 hands-on labs, fictional company data, every cell checked as you go.

20 lessons · 20 labs

$9.90Intermediate

ANOVA & Experimental Design in Excel: One-Way, Two-Way & Post-Hoc Tests

Design and analyse experiments in Excel in 20 graded labs: group means, DEVSQ sums of squares, the one-way ANOVA table, effect sizes, Levene, Tukey and Bonferroni, randomised blocks and factorials, then unequal groups, Welch's ANOVA, confidence intervals, planned contrasts, Scheffé, trend analysis, simple effects, Latin squares, ANCOVA, variance components and log transforms, every cell checked instantly.

20 lessons · 20 labs

$9.90Intermediate

Bayesian Statistics in Excel: Priors, Posteriors & Bayesian A/B Tests

Bayes' theorem, step-by-step updating, grid posteriors, Beta-Binomial, prior sensitivity, P(B > A) and expected loss, then exact credible intervals, priors from expert guesses, posterior predictive checks, Bayes tables and Bayes factors, Gamma-Poisson counts, normal means, empirical Bayes shrinkage, daily monitoring, three-variant tests, mixture priors and a launch dashboard: 20 hands-on labs with an online plant shop, every cell checked instantly.

20 lessons · 20 labs

A/B tests, holdout groups and growth experiments all depend on the same few ideas: a clear hypothesis, a big enough sample and an honest reading of the result. These courses walk through those steps with real spreadsheet calculations, so you can size a test before launching it, judge significance for email, ads and landing pages, and decide whether a lift is incremental or just noise. Statistical background is explained as you go, with no software to install.

This topic hub gathers 7 A/B Testing & Experiments courses from Data & Analytics, Marketing: 6 intermediate, 1 advanced. Most courses have about 20 hands-on labs, a final exam and a certificate, and the first lesson of every course is free. Searches this hub is built for: ab test sample size calculator excel; ab test significance excel; incrementality test; holdout test marketing.

Frequently asked questions

Which A/B Testing & Experiments course should I start with?

Start with “A/B Testing & Experimentation”. It is the most central course in this topic at intermediate level. Then move on to the more specialised courses in the list above.

How much do the A/B Testing & Experiments courses cost?

Every course costs a one-time $9.90, with no subscription, and the first lesson of each course is free so you can try it before buying. Each course ends with a final exam and a certificate.

How are the A/B Testing & Experiments courses taught?

Each course is a series of hands-on labs in a built-in spreadsheet that checks your formulas as you type, with short explanations alongside. You need only a web browser; nothing to install. Examples use fictional data and are for learning, not professional advice.

Open your first lab in under a minute

Pick a course, pay once and start right away. Your progress is saved in your account.

Browse the courses