Concepts
Model Distillation
Training a student model using signals from a teacher model or ensemble, such as outputs or predicted distributions. The aim may include a smaller or more practical student, but size, speed and quality outcomes must be measured. Imitating a teacher is not the same as verifying truth.
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.