215 Skills, 165 Contributors, No Fidelity Test
Notes on COLLEAGUE.SKILL: Automated AI Skill Generation via Expert Knowledge Distillation (arXiv:2605.31264) — Tianyi Zhou, Dongrui Liu, Lei Yuan, Jing Shao, Xia Hu · May 2026
Note published · written by SkillFed’s research pipeline from the paper above · how these notes are made
AI-assisted notes · reviewed by SkillFed Skill evolutionCOLLEAGUE.SKILL turns raw traces of a person — chat logs, work documents, email, screenshots, public research material, subtitles, plus a lightweight description — into a skill package through person-grounded trace-to-skill distillation: not a simulation of the person, but a bounded, editable artifact extracted from them. Each package splits into two coordinated tracks: a capability track for practices, mental models, and decision heuristics, and a behavior track for communication style, interaction rules, and correction history. The output is five content files — a combined SKILL.md plus independently invokable work.md/persona.md and work_skill.md/persona_skill.md — wrapped in manifest.json and meta.json for install and lifecycle state, on schema version 3. It installs across four agent hosts (Claude Code, OpenClaw, Codex, Hermes) and ships three domain presets: colleague for private workplace material, celebrity/public-figure for public evidence under source boundaries, and relationship for personal traces under consent and local-control rules.
Corrections run through natural language and land as either a Markdown patch or a normalized scene/error/correction record — the system's correction lifecycle — with every revision versioned and rollback-able. By May 28, 2026 the open-source deployment had pulled in roughly 18,500 GitHub stars; the public gallery listed 215 skills and 55 meta-skills from 165 contributors, with cumulative star counts across skill cards topping 100,000. Those are adoption numbers, not accuracy numbers. The paper validates the artifact — inspectable, correctable, installable — not whether a distilled skill actually preserves the source person's judgment; that question gets deferred to future evaluation work.
Key numbers
| GitHub stars (repository) | ~18,500 |
| Skills listed in public gallery | 215 |
| Gallery contributors | 165 |
| Meta-skills listed | 55 |
| Cumulative gallery-card stars | >100,000 |
Skills related to this research
Related notes
- A skill library built by GLM-4.6 boosts GPT-4.1's task success by 10 points →
- 200k+ skills wired into one graph, +40% reward across three backbones →
- Same skill, +22 points for Claude Sonnet, +5.5 for Nemotron Nano →
- 1,858 reusable skills mined from 22,511 real chats — zero weight updates →
- A weak model with a distilled skill beats its unaided teacher — at 1,000x lower inference cost →
- Certainty tags turn 0–9% accuracy into 88–100% →
- Cutting 83% of skill calls raises task success 10.9 points →
- Diagnose, don't rewrite: three revision rounds take a skill from 36% to 62% success →
- Turning a visual skill into text throws away up to 59% of its recoverable accuracy →
References
- Zhou, Liu, Yuan, Shao, Hu. "COLLEAGUE.SKILL: Automated AI Skill Generation via Expert Knowledge Distillation." arXiv:2605.31264 (2026).
- Yao, Zhao, Yu, Du, Shafran, Narasimhan, Cao. "ReAct: Synergizing Reasoning and Acting in Language Models." arXiv:2210.03629 (2023).
- Schick, Dwivedi-Yu, Dessì, Raileanu, Lomeli, Zettlemoyer, Cancedda, Scialom. "Toolformer: Language Models Can Teach Themselves to Use Tools." arXiv:2302.04761 (2023).
- Shinn, Cassano, Berman, Gopinath, Narasimhan, Yao. "Reflexion: Language Agents with Verbal Reinforcement Learning." arXiv:2303.11366 (2023).
- Wu, Bansal, Zhang, Wu, Zhang, Zhu, Li, Jiang, Zhang, Wang. "AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation." arXiv:2308.08155 (2023).