Fold Scores: Mean Absolute Error per Fold, the CV Estimate and Its Spread
This lesson is part of the course
Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.
Lessons in this course
- Three Piles of Data: Train, Validation & Test Splits from a Shuffle Number Pro
- k-Fold Cross-Validation: Assigning Folds with MOD and Stratifying by Class Pro
- A Toy Model per Fold: k-Nearest-Neighbour Predictions for a Held-Out Day Pro
- Fold Scores: Mean Absolute Error per Fold, the CV Estimate and Its Spread Pro
- Grid Search: A Setting × Fold Table, the Best k and the One-Standard-Error Rule Pro
- Under- and Overfitting: Training vs Validation Error by Model Complexity Pro
- Data Leakage: Scaling Before Splitting, Duplicates Across Folds and Rolling-Origin Checks Pro
- The Final Report: Choose by CV, Retrain on All Pool Days and Score the Test Set Once Pro