Engineering Notes
Thoughts and Ideas on AI by Muthukrishnan
Tag: Multi-Agent
Mechanism Design Teaching Agents to Cooperate Through Incentives
How to design rules that make self-interested agents collectively produce desirable outcomes, with applications to LLM-based multi-agent systemsMixture of Agents Building Collaborative LLM Pipelines That Outperform Any Individual Model
How layered LLM collaboration in the Mixture-of-Agents architecture produces outputs that consistently outperform any single model, and how to build it.Working Memory Compression and Context Distillation in Long Horizon Agents
How long-running agents compress, distill, and selectively retain working memory to operate effectively within finite context windowsOpponent Modeling and Theory of Mind in Multi-Agent Systems
How agents reason about other agents' beliefs, goals, and strategies, from k-level thinking to neural Theory of Mind and LLM-based recursive reasoningMean Field Games and Mean Field Reinforcement Learning for Massive Agent Populations
How mean field theory lets you solve game-theoretic problems with millions of agents by replacing individual interactions with a statistical summary of the crowdCounterfactual Regret Minimization for Solving Imperfect Information Games
How CFR and its variants taught AI to master poker and navigate the fog of war in multi-agent decision makingCooperative Game Theory and Shapley Values for Fair Credit Assignment in Multi-Agent Systems
Learn how cooperative game theory and Shapley values provide a mathematically principled way to assign credit among collaborating agents, with practical Python implementations and connections to modern LLM agent teams.Multi-Agent Reinforcement Learning Teaching Agents to Cooperate Compete and Coexist
Explore multi-agent reinforcement learning: how multiple RL agents learn simultaneously, coordinate under uncertainty, and produce emergent strategies in cooperative, competitive, and mixed-motive settingsRole Specialization and Crew Based Multi Agent Architectures
How assigning specialized roles to AI agents and orchestrating them as a crew produces better outcomes than monolithic single-agent systemsBuilding a Multi-Agent Swarm with OpenAI Swarm Framework
Learn the basics of OpenAI's experimental Swarm framework for lightweight multi-agent orchestration with handoffs and routines.Building a Multi-Agent Travel Planner with Google ADK
Create a travel planning system with specialized agents for flights, hotels, and activities using Google's Agent Development Kit.Building a Multi-Agent Code Review System with AutoGen
Create a team of specialized AI agents that review code for security, style, and logic issues using Microsoft's AutoGen framework.CrewAI vs LangGraph Building the Same Multi-Agent System in Both
A side-by-side comparison of CrewAI and LangGraph by implementing the same research assistant workflow in both frameworks.Consensus Algorithms for Coordinating Agreement in Distributed Agent Systems
When multiple AI agents need to make a collective decision (agreeing on a shared belief, coordinating a distributed tra...