BLEU by Hand: Geometric Mean, Add-One Smoothing, Brevity Penalty & Corpus Level
This lesson is part of the course
Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.
Lessons in this course
- Tokens as Rows: Unigram Counts, Matches, Precision & Recall Pro
- N-Gram Precision with Clipping: Bigrams, Trigrams & Several References Pro
- BLEU by Hand: Geometric Mean, Add-One Smoothing, Brevity Penalty & Corpus Level Pro
- ROUGE-1 & ROUGE-2: Recall, Precision & F1 against Several References Pro
- ROUGE-L: Longest Common Subsequence, Recall, Precision & the F-Measure with β Pro
- Question-Answer Scores: Exact Match, Token F1 & Partial Credit Pro
- Length & Paraphrase Effects: Short Outputs, Same Meaning in Other Words & Character N-Grams Pro
- Capstone: Do the Metrics Agree with People? Rank Correlation, Pearson & a System Comparison Pro