Corpus & Tokens: Counting Words, Vocabulary Size & Unigram Probabilities
This lesson is part of the course
Buy the course once for $9.99 to unlock every lesson and lab, the final exam and the certificate – lifetime access, no subscription.
Lessons in this course
- Corpus & Tokens: Counting Words, Vocabulary Size & Unigram Probabilities Pro
- Bigrams: Pairs of Neighbouring Words & the Next-Word Table Pro
- Probabilities: P(next | word) from Counts & the Probability of a Sentence Pro
- Smoothing: Add-One & Add-k So Unseen Words Still Get a Chance Pro
- Backoff & Interpolation: Mixing Bigram and Unigram, Choosing λ on Held-Out Text Pro
- Sentence Scores & Perplexity: Comparing Two Models on the Same Test Text Pro
- Autocomplete: Top-3 Suggestions, Breaking Ties & Falling Back for Unseen Contexts Pro
- Generation: Cumulative Probabilities, Random Numbers & a Sentence the Corpus Never Had Pro