Tag: model distillation
Distilling Reasoning: How Small LLMs Learn Chain-of-Thought
Discover how smaller language models learn to reason via Chain-of-Thought distillation. We compare pre-thinking vs. post-thinking methods, analyze performance gaps, and offer practical tips for implementation.
Read more