One agent, one skill library: 54% cheaper than multi-agent — until it tops ~90 skills
Notes on When Single-Agent with Skills Replace Multi-Agent Systems and When They Fail (arXiv:2601.04748) — Xiaoxiao Li · January 2026
Note published · written by SkillFed’s research pipeline from the paper above · how these notes are made
AI-assisted notes · reviewed by SkillFed Skill retrievalMulti-agent systems split a task across several specialized agents that talk to each other, and that coordination is expensive — every hand-off costs tokens and latency. Compile the same pipeline into a single agent backed by a library of skills, with each former agent's behavior turned into one skill the agent selects from, and the inter-agent messages disappear. That's the substitution tested here, across GSM8K, HotpotQA, and HumanEval, then pushed two ways: the skill library grows from a handful of entries to dozens, and separately gets seeded with near-duplicate competitor skills to see what actually breaks selection.
Compilation works about as well as advertised: token use drops 53.7% on average, latency drops 49.5%, and accuracy lands within -2.0% to +4.0% of the original multi-agent system (average +0.7%). Skill selection, though, doesn't scale as cleanly. Accuracy holds above roughly 90% while the library stays small, then falls off sharply past a fitted capacity point — about 92 skills for GPT-4o-mini, 84 for GPT-4o — a phase transition rather than a gradual slide, echoing capacity limits reported in human decision-making research. Count isn't the driver; semantic confusability is. With zero near-duplicate skills, accuracy holds at 100% even at 20 skills; add one confusable competitor per skill and it drops 7-30%; add two and it drops 17-63%. A two-stage hierarchical routing scheme — group skills, then pick within the group — claws back most of that: +37 to +40 points for GPT-4o-mini at large library sizes, +9 to +10 points for GPT-4o.
Key numbers
| Token usage vs. multi-agent baseline | -53.7% avg |
| Latency vs. multi-agent baseline | -49.5% avg |
| Capacity threshold (κ) | ~84-92 skills |
| Accuracy drop, 1 confusable skill per entry | -7 to -30% |
| Hierarchical routing recovery (small model) | +37 to +40 pts |
Skills related to this research
Related notes
- 26.1% of Marketplace Agent Skills Carry a Vulnerability →
- 478 GUI skills push GPT-5's desktop success rate up 15.6 points →
- Evolve the context-engineering skill itself, not just the context — up to 54% better than fixed pipelines like ACE and GEPA →
- 92.5% Skill Reuse From 816 Tokens →
- A learned memory-skill bank beats fixed insert/update/delete baselines by 5-7 points, on 6x fewer LLM calls →
- Offline Skill-Patching Beats DPT-WToM 15.6x on 27% Fewer Tokens →
References
- Xiaoxiao Li, "When Single-Agent with Skills Replace Multi-Agent Systems and When They Fail," arXiv:2601.04748 (January 2026)
- Hick, W. E., "On the Rate of Gain of Information" (1952) — Hick's Law, cited as the choice-reaction-time basis for the capacity limit
- Sweller, J., Cognitive Load Theory (1988), cited as the basis for bounded selection capacity
- Shepard, R. N., "Toward a Universal Law of Generalization for Psychological Science" (1987), cited as the basis for similarity-driven interference