Engineering Notes
Thoughts and Ideas on AI by Muthukrishnan
Tag: Llm
Local-First LLM Routing - Use Small Models for Easy Questions and Cloud Models for Hard Ones
A practical guide to building a local-first LLM gateway that sends simple queries to local models and escalates harder work to remote frontier models.Agent Loops Explained: The Simple Pattern Behind Useful AI Agents
A practical explanation of agent loops, how they differ from single-pass LLM calls, and why the simple think-act-observe cycle powers useful AI agents.Improving Decisions Through Multi-Agent Debate and Deliberation
How AI agents can reach better decisions by arguing with each other—exploring debate protocols, deliberation architectures, and the surprising power of constructive disagreement.How AI Agents Use Tools with Function Calling
## Concept Introduction **Tool Use** is the mechanism that allows a language model to interact with and affect the out...