Practical tools
Templates for planning work and money
BoredTools offers practical spreadsheets for budgets, freelance work and small projects.
SWE-Bench Mobile Exposes Agent Variance
SWE-Bench Mobile tests coding tools against industry mobile-development work rather than public Python bug fixes. Its uncomfortable result is that the...
ScrambleToolBench Finds Tool-Map Inertia
ScrambleToolBench is a 3 August 2026 benchmark for a practical tool-use failure: a system can learn what hidden tools do, then fail to revise that map...
EcoAgent-Bench Prices Escalation Choices
EcoAgent-Bench is a 6 August 2026 benchmark for a deployment question that ordinary task-success scores blur: when should a tool-using system spend more,...
ParEvalLayer Makes Partial Evals Decidable
ParEvalLayer is a 3 August 2026 proposal for a practical agent-evaluation problem: teams often see early task outcomes before a full benchmark run...
ToolPrivacyBench Exposes Purpose Drift
ToolPrivacyBench turns agent privacy into a tool-call audit: when a workflow succeeds, did each tool receive only the private facts it needed? The June...
IFCMemoryBench Finds the Missing Project Facts
IFCMemoryBench turns agent memory into an engineering test: can a building-information assistant remember project facts from earlier sessions and combine...
Tool Agents Need Taint Boundaries, Not Bigger Scopes
APPA landed on arXiv on 27 July 2026 with a blunt result for tool-agent security: permission prompts are too late once poisoned or confidential data has...
Chip-Design Agents Need Token ROI, Not Demo Flows
FluxBench landed on arXiv on 20 July 2026 with a useful warning for chip-design teams: two agents can start from the same foundation model and still...
Agent Bias Is Not Model Bias
Agent bias now comes from memory, tools and delegation, not just model outputs. Fairness checks need to inspect the full agent run.
Cyber Agents Need Triage Custody, Not Higher Exploit Scores
Microsoft's 27 July 2026 MAI-Cyber-1-Flash announcement is a useful signal for agentic security: the product claim is not one smarter model, but a...