AI firms follow DeepSeek’s lead, create cheaper models with “distillation”

Technique uses a "teacher" LLM to train smaller AI systems.

https://arstechnica.com/ai/2025/03/ai-firms-follow-deepseeks-lead-create-cheaper-models-with-distillation/