Small Models

Google’s New Service Destroys the Line Between Fine-Tuning and Distillation — And That’s a Good Thing

Google’s Gemini Distillation Service blurs the line between fine-tuning and distillation, turning its frontier models into teachers for specialized, cheaper models you own. This isn’t just a technical update—it’s a strategic shift that makes the old debate irrelevant. Enterprises that act now will build domain-specific AI models faster than competitors still clinging to general-purpose APIs.