agent-evaluation
Deep Dives and Frameworks
Implementation playbooks, operator patterns, and durable analysis.
No deep-dive content is currently available for this path.
Signals, Maps, and Watch Lists
Production-oriented analysis, benchmarks, and market/system intelligence.
External tools
Execution tooling is separate
Swarm Signal keeps the analysis layer. Use BoredTools for reusable production templates and trackers.
Tool-Use Agents Need Failure Labels, Not Pass Rates
Tool-use agents can fail in ways a final accuracy score hides, because the same wrong answer can come from skipped tools, ignored outputs, fabricated...
Computer-Use Agents Fail Long Workflows, Not Mouse Clicks
Computer-use agents are clearing more short benchmark tasks, but the new failure line is workflow length. A June 2026 benchmark called OSWorld 2.0 tests...
Agent Observability Needs Provenance, Not More Logs
Agent observability is drifting toward a familiar trap: capture every trace, then ask an engineer to work out why the agent did the wrong thing. A June...
Agent Leaderboards Can Be Cheaper Without Being Safer
A March 2026 paper on efficient agent benchmarking found that mid-difficulty task subsets can remove large parts of an agent benchmark while preserving...
Power Grid Agents Need Constraint Tests, Not Chat Scores
A June 2026 power-systems benchmark argues that language-model agents can solve grid-engineering tasks, but the useful signal is narrower: the agent must...