Activation Functions: Step, Sigmoid, tanh & ReLU
This lesson is part of the subscription
The first lesson of every course is free. A subscription unlocks all lessons, labs, exams and certificates.
Or start the free course: Excel for Finance
Lessons in this course
- A Single Neuron: Weighted Sum + BiasFree
- Activation Functions: Step, Sigmoid, tanh & ReLU Pro
- Forward Pass of a 2-2-1 Network Pro
- Loss Functions: MSE vs Cross-Entropy Pro
- Backpropagation: One Training Step by Hand Pro
- Learning Rate: Five Steps, Three Speeds Pro
- Softmax & Multi-Class Probabilities Pro
- Overfitting: Train vs Test Error & Early Stopping Pro