AI Tutorials Making Knowledge Distillation Cheap Enough to Run at Scale Knowledge distillation, training a smaller student model to match the performance of a larger teacher, is a well-known technique in…
