Engineering Notes

Engineering Notes

Thoughts and Ideas on AI by Muthukrishnan
05 Oct 2025

Advanced Problem-Solving with Tree of Thoughts

## Concept Introduction **Tree of Thoughts (ToT)** allows an agent to explore a tree of possibilities rather than foll...
05 Oct 2025

An Introduction to Reinforcement Learning for AI Agents

## Concept Introduction Reinforcement Learning (RL) is a paradigm of machine learning where an **agent** learns to mak...
05 Oct 2025

Architecting Short-Term and Long-Term Memory in AI Agents

## Concept Introduction AI agents require structured memory to operate effectively across turns and sessions. Without ...
05 Oct 2025

Beyond the Training Data with Retrieval-Augmented Generation for AI Agents

## Concept Introduction **Retrieval-Augmented Generation (RAG)** gives an AI agent an external knowledge base that it ...
05 Oct 2025

Decentralize Decisions, Centralize Context

As an engineering manager, one of the most significant shifts you can make to level up is to stop being the primary dec...
05 Oct 2025

Ensuring Agent Safety with Constitutional AI Guardrails

## Concept Introduction **Constitutional AI (CAI)** is a method for training an AI to supervise itself. Rather than re...
05 Oct 2025

How AI Agents Use Tools with Function Calling

## Concept Introduction **Tool Use** is the mechanism that allows a language model to interact with and affect the out...
05 Oct 2025

Improving Agent Reliability with Plan-and-Solve Prompting

## Concept Introduction **Plan-and-Solve (PS) Prompting** is a structured approach to AI agent reliability. Instead of...
05 Oct 2025

Self-Improvement and Autoformalization in AI Agents That Build Themselves

## Concept Introduction We have explored how agents can reason, plan, remember, act, and collaborate. The final, ultim...
05 Oct 2025

Solving Complex Problems with AI Agent Swarms

## Concept Introduction An **AI Agent Swarm** is a system composed of a large number of relatively simple, often ident...