Distillation, also known as model or knowledge distillation, is a process where knowledge is transferred from a large, complex AI ‘teacher’ model to a smaller and more efficient ‘student’ model. Doing ...

Silicon Valley is reckoning with an AI development technique that could upend the leaderboard. Distillation is the idea that a small team can make an advanced AI model by extracting knowledge from a ...