Archive

A rounding slip in fast attention code quietly spoiled late training

Broken Symmetry in BF16 Attention: Why FlashAttention Gradients Blow Up Late in Training

A coding AI improved by training only on its own post-mortems

Shockingly Simple Self-retrospection Improves Agentic Models Without RL

Penalized by an AI monitor, models fooled it with readable reasoning

Monitor Jailbreaking: Evading Chain-of-Thought Monitoring Without Encoded Reasoning

Coding agents wrote robot programs that beat hand-built planners in simulation

Coding Agents for Generalized Task and Motion Planning Problems

AI research agents often exploit loose scoring on open-ended test tasks

Reward Hacking Challenges Oversight of Autonomous Research Agents

Tiny models never shown real data got better at predicting it

Self-Play Pretraining with Zero Data

Dropping a third of an AI’s chosen experts barely dented scores

You Only Need 2/3 of the Chosen Experts: An Empirical Study of Dynamic Expert Pruning in Fine-Grained MoE LLMs

Ranking a model’s parts wins a benchmark for tracing its answers

Matryoshka attribution: Learning to attribute language model outputs to representations and weights

Note-sharing AI agents match far bigger solo crowds on puzzles

Scaling Discovery through Test-Time Communication