skillfed

3-6x Fewer Injected Tokens, Still +5.9 Points Over ACE

Notes on MIND-Skill: Quality-Guaranteed Skill Generation via Multi-Agent Induction and Deduction (arXiv:2605.08670) — Yixuan Li, Mingshui Cai, Ziyang Xiao, Wanyuan Wang, Yanchen Deng, Bo An · May 2026

Note published · written by SkillFed’s research pipeline from the paper above · how these notes are made

AI-assisted notes · reviewed by SkillFed Skill evolution

MIND-Skill turns skill-writing into a closed loop with two roles instead of one static write-up. An induction agent abstracts a successful task trajectory into a skill document; a separate deduction agent then tries to redo the task using nothing but that document, and the gap between the original run and the blind reconstruction becomes the training signal. Three losses score that gap. A reconstruction loss checks whether the reconstruction follows the same procedural steps; an outcome loss checks whether it actually succeeds against the live environment; a rubric loss scores the write-up itself on five axes — ground-truth independence, actionability, transferability, completeness, conciseness. All three are optimized together with TextGrad, natural-language gradient descent over the skill text, with the outcome loss as the primary objective and the other two breaking ties. The setup is tested on AppWorld (90 training tasks held out against 168 normal and 417 harder "challenge" test tasks) and BFCL-v3 (50 training / 150 held-out multi-turn tool-call instances). Baselines span ReAct, in-context learning, a single-pass "skill-extract" ablation of their own induction agent, and two concurrent methods — ACE and trajectory distillation-based Trace2Skill.

Running everything through Qwen3.5-122B to both write and execute skills, the full loop scores 71.4%/55.4% (task/scenario goal completion) on AppWorld-Normal and 51.8%/39.6% on Challenge, and 77.3% on BFCL-v3 — ahead of ACE (65.5/55.4, 51.1/34.5, 74.0) and Trace2Skill (67.3/55.4, 46.8/33.1, 72.7) on every metric but one tie. The three losses aren't redundant: pulling the rubric loss costs the most on the easier Normal split (71.4% down to 64.3%), while pulling the reconstruction loss costs the most on Challenge (51.8% down to 45.8%) — one keeps documents from turning into unusable prose, the other keeps them from going technically vague. The resulting skills also stay small: MIND-Skill injects 3–6x fewer tokens per retrieved skill than ACE's single evolving playbook or Trace2Skill's skill directory, for equal or better completion. And skills authored by a weaker model close most of the gap to skills authored by a stronger one once both go through the same optimization loop — the loop compensates for part of the author model's own capability shortfall.

Key numbers

AppWorld-Normal task completion (TGC)71.4% vs. 65.5% (ACE) / 67.3% (Trace2Skill)
AppWorld-Challenge scenario completion (SGC)39.6% vs. 34.5% (ACE) / 33.1% (Trace2Skill)
BFCL-v3 accuracy77.3% vs. 74.0% (ACE) / 72.7% (Trace2Skill)
Injected tokens per skill vs. baselines3–6x fewer
Rubric-loss ablation drop (Normal TGC)71.4% → 64.3% (−7.1 pts)

Skills related to this research

swift-expert swift-expert equips you with expert-level guidance for crafting robust iOS and macOS applications using Swift 5.9 and beyond. Leverage modern concurrency features and type-safety principles to accelerate your full-stack development workflow. This skill bridges the gap between foundational Swift knowledge and production-ready app architecture.★ 10,759 3dgs-code-reviewer This skill analyzes CUDA implementations of 3D Gaussian Splatting techniques, identifying correctness issues and performance bottlenecks in GPU kernels. It draws on comprehensive knowledge of 3DGS methods to provide targeted feedback on memory access patterns, synchronization, and computational efficiency. Perfect for researchers and engineers optimizing rendering pipelines.★ 129 3dgs-experiment-planner This skill streamlines experimental design for 3D Gaussian Splatting research by organizing a comprehensive catalog of 789+ techniques across 25 distinct categories. Researchers can explore proven methodologies, benchmark approaches, and validate experimental frameworks before submission. The interactive explorer helps identify relevant prior work and establish solid foundations for novel contributions.★ 129 3dgs-paper-reader This skill streamlines research workflows by parsing 3D Gaussian Splatting and NeRF papers to automatically extract key technical metadata. It transforms unstructured academic PDFs into organized, queryable data—eliminating manual note-taking across fragmented sources. Ideal for researchers cataloging methods, tracking innovations, or building comprehensive literature databases.★ 129

Related notes

References

  1. Li, Y., Cai, M., Xiao, Z., Wang, W., Deng, Y., & An, B. (2026). MIND-Skill: Quality-Guaranteed Skill Generation via Multi-Agent Induction and Deduction. arXiv:2605.08670.
  2. Yuksekgonul, M. et al. (2024). TextGrad: Automatic "Differentiation" via Text. arXiv:2406.07496.