Oral Presentation
Guiding Yourself with Your Own Insights: Student-Driven Knowledge Distillation
We introduce a novel approach termed Student-Driven Knowledge Distillation (SDKD), which integrates a proxy teacher intermediary between the primary teacher and student model.
