Livoa LogoLivoa
Teacher Network
Student Network










Hint
Layer








Guided
Layer

Wᵣ
Transfer
Knowledge
Distillation
Loss
Cross Entropy
Loss
Total Loss
HT(WGuided, Wr) = ½ ||uh(x; WHint) - r(vg(x; WGuided); Wr)||²

d

by t

0
0 uses