A skill library trained on 5x5 robot grids beats genetic search at 10x10 — on all 7 EvoGym tasks
Notes on When Search Becomes Memory: Turning Robot Design Trials into Transferable Skills (arXiv:2605.25832) — Yunfei Wang, Xiaohao Xu, Yang Li, Xiaonan Huang · May 2026
Note published · written by SkillFed’s research pipeline from the paper above · how these notes are made
AI-assisted notes · reviewed by SkillFed Skill evolutionAuto-Robotist is a self-evolving LLM agent for evolutionary robot design that turns each generation's simulator results into a structured, natural-language skill library instead of discarding them once the next population is bred. Each entry pairs a structural archetype — a recurring body-plan pattern — with evidence-grounded positive and negative rules, anchored to the actual evaluated designs that produced them, so the memory stays inspectable rather than folding into model weights or a population's genome. During search, the agent retrieves relevant skills to steer LLM edits of elite robot bodies, while keeping a standard genetic algorithm mutation path open for exploration. After each evaluation round, the agent maintains that library itself — adding skills earned from the newest evidence, catching and correcting ones that no longer hold, merging entries that have drifted into duplicates.
Across seven EvoGym tasks spanning locomotion, terrain traversal, and object interaction, the skill-conditioned approach improves cold-start search on small 5x5 design grids. Skills learned at that scale go on to transfer: at a much larger 10x10 design space, reference-conditioned search beats a plain genetic algorithm on every one of the seven tasks. The result reframes what an expensive simulated evaluation is for — not a one-off score used to cull a population, but evidence banked into an auditable, reusable design memory that keeps paying off at a scale the agent never searched directly.
Key numbers
| EvoGym tasks tested | 7 |
| Cold-start search grid | 5x5 design space |
| Transfer target grid | 10x10 design space |
| Beats GA on transfer | 7 of 7 tasks |
| Library update operations | 3 (Add / Diagnose / Merge) |
Skills related to this research
Related research
Related notes
- MUSE-Autoskill's Self-Written Skills Beat Human-Authored Ones, 85.24% vs. 81.17% →
- A learned memory-skill bank beats fixed insert/update/delete baselines by 5-7 points, on 6x fewer LLM calls →
- Skill abstraction beats raw-trajectory memory by up to 25 points →
- Failure-only skill revision helps 1 model in 10, hurts the other 8 →
- Skill pass rates jump from 33.6% to 88.0% — with zero gradient steps →
- Text-based skill edits beat trained baselines by 6.7 points →
- Typed contracts + call templates: 82 vs. 47 ALFWorld wins, −23% tokens per game →
References
- Wang, Xu, Li & Huang. "When Search Becomes Memory: Turning Robot Design Trials into Transferable Skills." arXiv:2605.25832 (2026).
- Bhatia, Jackson, Tian, Xu & Matusik. "Evolution Gym: A Large-Scale Benchmark for Evolving Soft Robots." NeurIPS (2021).