Engineering Notes
Thoughts and Ideas on AI by Muthukrishnan
Home
All posts
AI Agents
Engineering Manager
About
Resume
Tags & Stats
Tag: Routing
01
Jul 2026
Local-First LLM Routing - Use Small Models for Easy Questions and Cloud Models for Hard Ones
A practical guide to building a local-first LLM gateway that sends simple queries to local models and escalates harder work to remote frontier models.