Also from Tyler's team
Spreadsheets That Don't Suck
BoredTools builds practical templates for budgeting, freelancing, and productivity. Simple, useful, no subscription required.
AI Agents Are Security's Newest Nightmare
I've spent the last month reading prompt injection papers, and the thing that keeps me up isn't the attack success rates. It's how many production systems...
When AI Agents Have Tools, They Lie More
Tool-using agents hallucinate 34% more often than chatbots answering the same questions. The culprit isn't bad models or missing context. It's that giving...
Why Agent Builders Are Betting on 7B Models Over GPT-4
Gemma 2 9B just scored 71.3% on GSM8K. Phi-3-mini hit 68.8% on MMLU using 3.8 billion parameters. Mistral 7B matched GPT-3.5 performance six months ago....
Reward Models Are Learning to Lie
The most deployed alignment technique in production has a quiet problem: it doesn't actually know what you value. RLHF trains models to maximize a reward...
MoE Models Run 405B Parameters at 13B Cost
When Mistral AI dropped Mixtral 8x7B in December 2023, claiming GPT-3.5-level performance at a fraction of the compute cost, the reaction split cleanly...
When Your Judge Can't Read the Room
Three months ago, I ran a benchmark comparing GPT-4 and Claude 3 Opus on creative writing tasks. GPT-4 won by a comfortable margin according to my...
Most Agent Benchmarks Test the Wrong Thing
The SciAgentGym team ran 1,780 domain-specific scientific tools through current agent frameworks. Success rate on multi-step tool orchestration: 23%. Same...
The Inference Budget Just Got Interesting
OpenAI's o1 made headlines for "thinking harder" during inference. But the real story isn't that a model can spend more tokens on reasoning: it's that...
When Multi-Agent Systems Break: The Coordination Tax Nobody Warns You About
LLM-powered multi-agent systems fail at coordination 40-60% of the time in production environments, according to new research from teams building...
Types of AI Agents: Reactive, Deliberative, Hybrid, and What Comes Next
SWE-bench accuracy went from 1.96% in 2023 to 69.1% in 2025. Understanding the types of AI agents behind this progress (reactive, deliberative, hybrid, and autonomous) is the difference between building tools that work and tools that impress.