Researchers tested Matt Pocock's /retro skill, and it mostly didn't help

A new paper (Treude and Baltes) tested Matt Pocock's /retro skill, which has Claude Code review its own session and suggest improvements to its set-up, on 30 real coding issues. It made 125 suggestions; 24 were implemented and 12 evaluated. Of seven that could be measured on a later task, two stopped the repeated mistake, one reduced it and four made no difference, and some added extra work. Pocock called it 'the greatest issue report in history'.

Why it mattersThe lesson for any team building skills or agent instructions: check that a change actually helps on a real task before you keep it. Self-improvement loops add clutter as easily as they add value.

Curated by Sara Simeone as part of our human editorial coverage. The original sources are linked below; curation is distinct from a Hype or Fact? assessment.

SHARE THISPost on X ↗Share on LinkedIn ↗Copy link

How we knowCompany figures are labelled as their own claims; anything we couldn't verify is labelled as a report or a claim.