skill-evolution
Skill Evolution monitors how your skills perform across sessions by analyzing user edits and success metrics, then suggests targeted improvements with confidence scores. Apply changes safely with automatic version snapshots and rollback capability, or use the holdout-promotion gate to validate candidates against a sealed eval set before graduating them.
Skill Evolution tracks usage patterns and success rates to suggest improvements with safe version rollback.
AI-generated summary based on this skill's SKILL.md
Install
yonatangross/orchestkit/skill-evolution · repository language: TypeScript
git clone https://github.com/yonatangross/orchestkit
cp -r orchestkit/src/skills/skill-evolution ~/.claude/skills/skill-evolutionnpx skillfed install yonatangross/orchestkit/skill-evolutionFrequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
How does Skill Evolution track skill performance and usage patterns?
Skill Evolution monitors your skills across sessions by analyzing user edits, success rates, and usage metrics. It captures performance data to identify patterns in how your skills are being used and where they succeed or struggle, giving you visibility into real-world skill behavior.
What versioning and rollback management does Skill Evolution provide?
Skill Evolution automatically creates version snapshots of your skills, letting you safely rollback problematic changes. The version history management feature preserves past iterations so you can revert to earlier versions if a skill update causes issues.
Can Skill Evolution auto-improve skills based on user edits?
Yes. Skill Evolution analyzes edit patterns and confidence scores to generate auto-suggested skill optimizations. You can review these recommendations and apply changes directly, or let the system learn from user edits to propose targeted improvements.
How does Skill Evolution's champion-challenger evaluation work?
Skill Evolution runs champion-challenger testing to validate skill candidates against a sealed baseline eval set. Skills are promoted only if they beat the baseline, ensuring quality gates protect your production skills from degradation.
What improvement recommendations does Skill Evolution provide?
Skill Evolution analyzes edit patterns, confidence scores, and success metrics to surface skill improvement recommendations. It combines usage analytics with performance data to suggest where and how to optimize your skills for better outcomes.
How does Skill Evolution ensure safe skill updates?
Skill Evolution uses confidence scoring, automatic version snapshots, and a holdout-promotion gate to validate candidates before graduation. These safety mechanisms let you apply changes confidently while maintaining rollback capability if needed.
SKILL.md
rendered from the published skill — quoted content, verbatim
Skill Evolution Manager
Enables skills to automatically improve based on usage patterns, user edits, and success rates. Provides version control with safe rollback capability.
Overview
- Reviewing how skills are performing across sessions
- Identifying patterns in user edits to skill outputs
- Applying learned improvements to skill templates
- Rolling back problematic skill changes
- Tracking skill version history and success
(truncated - see the full file via the links below)
Read as markdown · JSON record · Browse the source repository
File tree — 11 files
src/skills/skill-evolution/SKILL.md
src/skills/skill-evolution/references/evolution-analysis.md
src/skills/skill-evolution/references/evolution-commands.md
src/skills/skill-evolution/references/holdout-promotion-gate.md
src/skills/skill-evolution/references/storage-patterns.md
src/skills/skill-evolution/references/version-management.md
src/skills/skill-evolution/rules/_sections.md
src/skills/skill-evolution/rules/auto-evolution-triggers.md
src/skills/skill-evolution/rules/confidence-scoring.md
src/skills/skill-evolution/rules/pattern-detection-heuristics.md
src/skills/skill-evolution/test-cases.json