What Is Model Distillation? How Smaller AI Models Learn
Model distillation transfers knowledge from a large Teacher AI model to a smaller Student model. This process uses soft labels to retain high capability while drastically reducing memory and computational cost for edge deployment.
Read article