SmolModels: Because not everything needs a giant LLM

So everyone’s chasing bigger models, but do we really need a 100B+ param beast for every task? We’ve been playing around with something different—SmolModels. Small, task-specific AI models that just do one thing really well. No bloat, no crazy compute bills, and you can self-host them.

We’ve been using blend of synthetic data + model generation, and honestly? They hold up shockingly well against AutoML & even some fine-tuned LLMs, esp for structured data. Just open-sourced it here: SmolModels GitHub.

Curious to hear thoughts.