
How to Write AI Agent Evals That Prove You Wrong
Write AI agent evals that catch what you missed: source cases from production traces, spot tests that pass for the wrong reason, and know when to overrule an LLM judge.
Posts tagged Ai-agents.

Write AI agent evals that catch what you missed: source cases from production traces, spot tests that pass for the wrong reason, and know when to overrule an LLM judge.

What changes for OAuth when you move an MCP server to v2. The MCP TypeScript v2 SDK moves the auth helpers into @modelcontextprotocol/express and surfaces auth info via ctx.http.authInfo — your Keycloak setup stays exactly the same.

You designed the tool well. Nothing verifies it still does what its description promises. An audit of eight tools found four contract bugs, including one that made a finance agent report $2,812 for a $2,752 bill, and the cheap test layer that catches them.

Build a stateless MCP v2 server in TypeScript. A hands-on guide to the MCP TypeScript v2 SDK — the new @modelcontextprotocol/server packages, createMcpHandler, Standard Schema tools, and what replaces session handling.

Cameron is a local-first personal finance agent you own and run yourself. v1 shows how an LLM loop, tools, and an approval gate compose into an agent you can trust with real money.