Difference-in-Differences: Pre and Test Averages, Change per Group, Lift and Incremental Orders
Lessons in this course
- Test vs Holdout Markets: Orders per 100k Residents, Group Rates, Relative Lift and Incremental OrdersFree
- Platform ROAS vs Incremental ROAS: Reported Revenue, Test-Measured Revenue and the Over-Reporting Multiple Locked
- Matched Markets: Weekly Correlation, Size Ratio, a Match Score and the Best Control Candidate Locked
- Pre-Period Fit: Scale Factor, Predicted Test Orders, Absolute Percentage Error and MAPE Locked
- Difference-in-Differences: Pre and Test Averages, Change per Group, Lift and Incremental Orders Locked
- Regression Counterfactual: Slope, R², FORECAST.LINEAR Predictions and Weekly and Total Incremental Orders Locked
- Reading the Lift: Weekly Incremental Orders, Relative Lift, the Cumulative Curve and Overall Lift Locked
- Incremental Revenue, iROAS, Cost per Incremental Order, Break-Even iROAS and Incremental Profit Locked
- Confidence Interval for the Lift: Residual Standard Error, Standard Error of the Total and a 95 % Interval Locked
- Is the Lift Real? t-Statistics, Two-Sided p-Values, Decisions at a Chosen α and Interval Lower Bounds Locked
- Placebo Tests: Fake Lifts in the Pre-Period, a 95th-Percentile Threshold, Verdict and a Flag Rule Locked
- Test Duration: Standard Error by Week, Minimum Detectable Effect, a Duration Verdict and the Weeks Needed Locked
- Sizing the Test Budget: Expected Incremental Orders, Expected Lift, Detectability, Net Test Cost and the Minimum Spend Locked
- How Big a Holdout? Test and Holdout Markets, Standard Error, MDE, the Cost of Going Dark and the Cheapest Adequate Design Locked
- Spillover & Contamination: Exposure of Control Markets, a Contamination Flag, Weighted Exposure and a Leakage-Adjusted Lift Locked
- Where Does It Work? Incremental Orders and Revenue by Market, SUMIFS by Market Type, iROAS per Type and a Chart Locked
- The Response Curve: Multi-Cell Spend Test, Incremental Orders, iROAS and Marginal iROAS Against Break-Even Locked
- Calibrating Attribution: Calibration Factors from Geo Tests, Calibrated Revenue and ROAS, and How Rankings Change Locked
- Combining Several Tests: Inverse-Variance Weights, Recency Discount, a Pooled iROAS and the Pooled Standard Error Locked
- Final Project: A Complete Geo-Test Readout with Counterfactual, Incremental Orders, iROAS, Interval, Decision and Chart Locked