Engineering Notes
Thoughts and Ideas on AI by Muthukrishnan
Tag: Algorithms
Constraint Satisfaction Problems for Valid Solutions in Complex Agent Planning
Master constraint satisfaction problems (CSP) - a fundamental technique for agent planning, scheduling, and configuration tasks where finding any valid solution is the goal.Multi-Armed Bandits and the Exploration-Exploitation Dilemma in Agent Learning
Master the fundamental problem of sequential decision-making under uncertainty and learn how AI agents balance trying new actions versus exploiting known rewardsContextual Bandits for Balancing Exploration and Exploitation in Real-Time
Master contextual bandits—the algorithm behind personalized recommendations, A/B testing, and adaptive agents. Learn how to balance exploration and exploitation in real-time decision-making.Planning with Backtracking and Replanning for Resilient Adaptive Agents
Learn how backtracking and replanning enable AI agents to recover from failures and adapt to dynamic environmentsMonte Carlo Tree Search from Games to LLMs
## 1. Concept Introduction Imagine you're playing a complex board game like Go. The number of possible moves is astron...