Ekcron explores how language models work, how fine-tuning and distillation shape them, and how small models can match far larger ones — through writing and experiments.https://ekcron.com/https://ekcron.com/blog/what-fine-tuning-changes/https://ekcron.com/blog/what-fine-tuning-changes/Fine-tuning doesn't teach a model new facts so much as it reshapes behaviour. Here's a practical way to think about what moves and what doesn't.Fri, 24 Jul 2026 00:00:00 GMThttps://ekcron.com/research/notes-on-model-distillation/https://ekcron.com/research/notes-on-model-distillation/A working reference on the main flavours of distillation — what each optimises, and when to reach for it.Thu, 23 Jul 2026 00:00:00 GMThttps://ekcron.com/blog/why-small-models-are-getting-good/https://ekcron.com/blog/why-small-models-are-getting-good/Compact models keep closing the gap with the giants on narrow tasks. A short look at what's driving it and where the limits still are.Wed, 22 Jul 2026 00:00:00 GMT