$npx skillfedfor your agent

15 cloned listings hijack skill retrieval 93% of the time

Notes on Agent Skill Security: Threat Models, Attacks, Defenses, and Evaluation (arXiv:2607.13987) — Sanket Badhe, Priyanka Tiwari · July 2026

Note published · written by SkillFed’s research pipeline from the paper above · how these notes are made

AI-assisted notes · reviewed by SkillFed Skill security

SkillSec-Eval breaks the agent skill lifecycle into six stages — authoring, storage, retrieval, planner selection, execution, evolution — and gives each one its own threat taxonomy. Badhe and Tiwari run the framework against 327 real skills pulled from the SkillMCP repository across 15 clusters spanning DevOps, cloud operations, and data engineering, then throw five attack families at it: tampered signatures and provenance at storage, gamed semantic retrieval via keyword stuffing and cloned listings, fake planner-facing recommendations, chained tool calls at execution, and permission creep hidden inside version updates.

Nobody's surprised execution needs guarding, but it's still the easiest stage to break: an undefended sandbox lets 100% of execution-time attacks reach a privileged sink, and even dynamic taint tracking plus policy enforcement only knocks that down to 23% — ask an LLM to paraphrase sensitive output and it silently strips the taint tag along with it. Storage checks fare no better: rules-only signature and provenance verification wave through 52.9% of malicious skills at admission, and bolting on an LLM check for whether declared permissions match the actual workflow cuts that to 7.9%, but at the cost of rejecting 20% of clean submissions too. The softest target of all is retrieval itself — publish 15 near-duplicate copies of a malicious skill, a Sybil attack, and it lands in an agent's shortlist 93.2% of the time with no defense running. Planners fall for fake endorsement-style metadata 45.6% of the time, before an attacker has touched a line of actual code.

Key numbers

Real skills in the benchmark repository327
Sybil-clone attack success against undefended retrieval93.2%
Malicious skills passing rules-only admission checks52.9%
Same admission rate under the hybrid LLM+rules gate7.9%
Attack success rate against an undefended execution sandbox100%

Skills related to this research

wiki-retrieve wiki-retrieve upgrades vault search from page-level to chunk-level granularity, combining contextual prefixes, BM25 sparse retrieval, and dense reranking to reduce retrieval failures. Setup is opt-in with built-in privacy gates: run fully on-machine with synthetic prefixes, or opt into Anthropic API or claude CLI tiers for better context generation.★ 10,007 seo-dataforseo seo-dataforseo integrates DataForSEO's live search data into Claude Code, enabling real-time SERP tracking and keyword ranking analysis. Run parallel SEO audits across technical metrics, content quality signals, schema validation, and local search performance—all from Claude's command palette.★ 12,542 Seo Dataforseo This skill connects your workflow to DataForSEO's comprehensive ranking tracking platform, letting you monitor how your target keywords perform across search engines in real time. Get detailed visibility into your SEO metrics and competitive positioning without leaving your agent environment.★ 506 agentsop-multi-tenant-rag This skill encodes security-first isolation patterns for RAG systems serving multiple tenants, customers, or permission scopes. It teaches agents to enforce tenant filtering at the vector store query boundary—the only place where isolation truly matters—and pairs vendor-specific primitives (Pinecone namespaces, Weaviate multiTenancy, Qdrant payload filters, pgvector RLS) with framework adapters like LlamaIndex and LangChain. Activate when designing, reviewing, or debugging any retrieval pipeline where the corpus spans more than one tenant.★ 219

Related notes

References

  1. Badhe, S. & Tiwari, P. (2026). Agent Skill Security: Threat Models, Attacks, Defenses, and Evaluation. arXiv:2607.13987.