A skill improves every time anyone uses it, not just its author
Notes on SkillClaw: Let Skills Evolve Collectively with Agentic Evolver (arXiv:2604.08377) — Ziyu Ma, Shidong Yang, Yuxiang Ji, Xucong Wang, Yong Wang, Yiming Hu, Tongwen Huang, Xiangxiang Chu · April 2026
Note published · written by SkillFed’s research pipeline from the paper above · how these notes are made
AI-assisted notes · reviewed by SkillFed Skill evolutionMost agent skills ship once and sit still. The same tool-usage mistake, the same brittle workaround, the same failure mode gets rediscovered independently by every user who hits it, because nothing carries that experience back into the skill itself. SkillClaw closes the loop by treating every session as signal: it pools the trajectories — what an agent tried and how it went — across every user of a skill, then runs an autonomous evolver over that pooled history. The evolver hunts for behavioral patterns that recur across different people's sessions, then decides whether the fix is tightening an existing skill or adding a new one. Updated skills land in a shared skill repository that syncs to every user automatically — nobody has to notice a fix shipped, let alone go pull it.
WildClawBench, a benchmark of real-world agent scenarios built for exactly this dynamic, provides the test bed, with Qwen3-Max running as the backbone model. Performance improves significantly — and each individual user contributes only a small amount of interaction and feedback to get there. That's the mechanism doing the work, not any one account's data volume: the system compounds thin per-user signal by pooling it across the whole population, instead of waiting for a single user to repeat the same mistake enough times to force a fix on their own.
Key numbers
| Skill behavior after deployment, baseline | Static — no built-in update path |
| Per-user interaction needed to see gains | Limited (small individual signal) |
| Backbone model evaluated | Qwen3-Max |
| Effort required from other users to benefit from a fix | None — repository syncs automatically |
| Evaluation benchmark | WildClawBench (real-world agent scenarios) |
Skills related to this research
Related notes
- Curated skills add 16 points of task success — up to 51.9 in healthcare →
- Four-Way Attribution Gates Every Update to a Million-Scale Skill Corpus →
- A trained 8B model beats Gemini-2.5-Pro at curating agent skills: 61.2% vs 50.7% →
- Skill pass rates jump from 33.6% to 88.0% — with zero gradient steps →
- Skill selection, not RL, drives the gain — 8.3 of 10.4 points →
- Reorganize a team without touching its skills, and you lose 26 points to doing nothing at all →
- Three rounds of automated repair add up to 12pp of consistency — and beat a mature production system by 13.76pp →
- 0 of 9 add-skill edits improved pass rate; cost fell up to 31.7% vs. static bundles →
- Turning a corpus into a skill tree cuts RAG hallucination from 50% to 4.5% →
References
- Ziyu Ma, Shidong Yang, Yuxiang Ji, Xucong Wang, Yong Wang, Yiming Hu, Tongwen Huang, Xiangxiang Chu, "SkillClaw: Let Skills Evolve Collectively with Agentic Evolver," arXiv:2604.08377 (April 2026).