84% of Malicious Agent-Skill Exploits Hide in the Docs, Not the Code
Notes on "Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wild (arXiv:2602.06547) — Yi Liu, Zhihao Chen, Yanjun Zhang, Gelei Deng, Yue-Ying Li, Jianting Ning, L. Zhang · February 2026
Note published · written by SkillFed’s research pipeline from the paper above · how these notes are made
AI-assisted notes · reviewed by SkillFed Skill securityResearchers ran 98,380 agent skills pulled from two community registries, skills.rest and skillsmp.com, through a four-stage detection funnel: static pattern matching against 14 rules tied to a six-phase kill chain, dynamic behavioral verification inside sandboxed containers, then manual dual-rater review (Cohen's κ=0.89) and vulnerability labeling. Static matching alone flagged 4,287 candidates. The full pipeline confirmed 157 as malicious — 632 distinct vulnerabilities spread across 13 attack techniques — with the dynamic-verification stage alone hitting 99.6% precision, a 90x jump over pattern matching by itself.
These aren't sloppy scripts. The average confirmed-malicious skill carries 4.03 vulnerabilities, 71.8% of them critical or high severity — and 84.2% sit inside the natural-language SKILL.md instructions rather than in executable code. Two dominant strategies emerge, and they rarely mix: remote-script-execution credential theft and documentation-embedded instruction override co-occur in just 5.1% of cases (OR=0.11, p<0.001), meaning attackers specialize rather than combine techniques. One templated brand-impersonation operation accounts for 54.1% of every confirmed malicious skill in the dataset; the most advanced-tier skills universally lean on shadow features — capabilities invisible in any public documentation. Once the authors disclosed all 157 cases, both registries pulled them: 100%.
Key numbers
| Confirmed malicious skills | 157 of 98,380 scanned (0.16%) |
| Vulnerabilities found | 632 total, avg. 4.03 per malicious skill |
| Exploit weight in documentation, not code | 84.2% embedded in SKILL.md text |
| Share from one threat actor | 54.1% traced to a single brand-impersonation operation |
| Skills removed after disclosure | 157/157 (100%) |
Skills related to this research
Related notes
- 26.1% of Marketplace Agent Skills Carry a Vulnerability →
- Frontier Agents Cave to Poisoned Skill Files Up to 80% of the Time →
- A skill's own examples smuggle malicious code past agent defenses up to 33.5% of the time →
- Checking the repo, not just the SKILL.md, cuts flagged 'malicious' skills from 46.8% to 0.52% →
- 1,184 skills fell in one campaign — because Agent Skills has no line between data and instructions →
- Best Skill Scanner Catches 17% of Cross-Modal Attacks — a Distilled 7B Model Hits 88% →
- 40,285 Skills Later, Supply Still Doesn't Match Demand →
- Skill abstraction beats raw-trajectory memory by up to 25 points →
- 2 of 2 LLMs Fell for a Single Invisible HTML Comment →
References
- Liu, Chen, Zhang, Deng, Li, Ning & Zhang, "Do Not Mention This to the User": Detecting and Understanding Malicious Agent Skills in the Wild, arXiv:2602.06547 (2026)
- Perez & Ribeiro, Ignore Previous Prompt: Attack Techniques for Language Models (2022)
- Greshake et al., Not What You've Signed Up For: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection (2023)