Notes

Short pieces about the methodology and architecture decisions behind the AI systems I ship — specs, evals, multi-agent orchestration, LLM integration, and the discipline of directing coding agents.

RSS feed →

May 10, 2026
Evals or it didn't ship
Why I refuse to ship an agent without a held-out evaluation set, what makes one useful, and the failure mode I keep seeing when teams skip this.
- agents
- eval
- methodology

Evals or it didn't ship