Rabbit Holes a commonplace book,kept in the open
Link · kept 28 August 2026

Small language models are all we need

Source calv.info

This is an interesting post on small language models, and I completely agree. For most tasks people have, whether in an organizational setting or in a personal capacity, frontier or large models are overkill. It’s like using a chainsaw to slice a piece of bread.

Most of our everyday use cases, inside a company or personally, are basic in nature: search, summarize, transform, set simple alerts, synthesize things, ask basic questions, and so on. For all those use cases, we don’t need GPT-4 or Claude, Opus 5 or Table. Simple small models like Gemini Flash, GPT Luna, DeepSeek Flash, and now GLM 5.3 Flash are more than good enough—and they’re dirt cheap.

This also opens up a lot of use cases for building small tools and apps by leveraging the power of cheap LLM models that can—if not be a million-dollar SaaS business—at the bare minimum have a few hundred or thousand paying users. I would bet on an efflorescence of such small apps and tools.

follow by RSS
Threads from here

Nearby leaves, connected by subject and form.

browse all subjects →