Distillation

Model distillation: Why more and more "small models" can catch up with the large model experience

Model distillation is a keyword that has been frequently mentioned in the past two years, especially on the question of "why are small models getting ...