ml-llm-wiki
Search a self-contained markdown wiki covering transformer architectures, attention cost and efficiency, and long-context scaling. The skill provides read-only access to pre-compiled articles; use the companion llm-wiki skill to add or update content.
ml-llm-wiki lets you query a machine learning knowledge base on transformers and attention mechanisms.
AI-generated summary based on this skill's SKILL.md
Decision gist · record as of 2026-07-27
ml-llm-wiki lets you query a machine learning knowledge base on transformers and attention mechanisms. Search a self-contained markdown wiki covering transformer architectures, attention cost and efficiency, and long-context scaling. The skill provides read-only access to pre-compiled articles; use the companion llm-wiki skill to add or update content.
Use it when
- ml-llm-wiki covers attention cost analysis and efficiency trade-offs.
- ml-llm-wiki contains articles on practical approaches to long-context scaling in language models.
Verify before relying
Read SKILL.md below before installing (14 files). Open directory: indexed for reading, not audited.
Install
sammcj/agentic-coding/examples · repository language: HTML
Open directory. Skills are indexed for reading, not audited. Review a skill's body before installing it.
Frequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
How does attention work in transformers?
ml-llm-wiki provides compiled knowledge on transformer attention mechanisms. The skill offers read-only access to pre-compiled articles explaining how attention computes query-key-value interactions to weight information flow. Search the wiki for detailed breakdowns of the attention head computation, multi-head parallelization, and how attention enables transformers to model long-range dependencies in sequences.
What is the quadratic cost of attention and is it inevitable?
ml-llm-wiki covers attention cost analysis and efficiency trade-offs. The wiki explains why standard attention exhibits quadratic scaling with sequence length, but also documents that this quadratic limit is not inevitable—alternative implementations and sparse attention patterns can reduce complexity. Search for articles on attention complexity and optimization to explore practical approaches to lowering memory and compute requirements.
What long context scaling techniques does ml-llm-wiki document?
ml-llm-wiki contains articles on practical approaches to long-context scaling in language models. The wiki covers efficient attention implementations, sparse attention variants, and architectural modifications that enable transformers to handle longer sequences without proportional cost increases. Browse the knowledge base for citations and detailed comparisons of different scaling strategies.
Why is attention memory expensive and how can it be optimized?
ml-llm-wiki explains transformer memory requirements and attention efficiency trade-offs. The skill's articles detail how standard attention stores full query-key-value matrices, leading to high memory overhead. The wiki documents optimization techniques including sparse patterns, low-rank approximations, and kernel-based methods that reduce memory footprint while maintaining model quality.
How do I query the ML wiki for transformer architecture knowledge?
ml-llm-wiki provides read-only access to a self-contained markdown wiki on transformer architectures and attention. Search the knowledge base using keywords like 'attention mechanism,' 'scaling,' 'efficiency,' or 'long-context' to find relevant pre-compiled articles. To add or update content, use the companion llm-wiki skill for editing the underlying knowledge base.
What resources does ml-llm-wiki provide on attention quadratic scaling?
ml-llm-wiki's knowledge base includes articles analyzing attention complexity and the quadratic scaling myth. The wiki documents why standard attention has O(n²) complexity but also explores evidence and techniques showing this limit can be overcome. Search for 'attention complexity' or 'efficient attention implementations' to find citations and detailed technical discussions.
SKILL.md
Rendered from the published skill. Quoted content, verbatim.
Machine Learning Wiki
A self-contained markdown knowledge base on transformer architectures, attention cost and efficiency, and long-context scaling. This skill is for querying it: the knowledge is already compiled into articles under wiki/, so read those rather than re-deriving from scratch.
Keep this current: as the wiki grows, update the name and description above so they describe what it actually covers and trigger on the right questions.
(Sample note: this example wiki lives in examples/ within the llm-wiki repo. To load it as a skill, place the directory in your skills path named ml-llm-wiki, so the directory matches the name above.)
Maintenance and deeper analysis - ingesting sources, superseding stale knowledge, linting, auditing, critiquing reasoning - is not done
(truncated - see the full file via the links below)
File tree — 14 files
Skills/llm-wiki/examples/CLAUDE.md
Skills/llm-wiki/examples/README.md
Skills/llm-wiki/examples/SKILL.md
Skills/llm-wiki/examples/local/prep/2026-06-04-attention-talk-prep.md
Skills/llm-wiki/examples/raw/machine-learning/2017-06-12-attention-is-all-you-need.md
Skills/llm-wiki/examples/raw/machine-learning/2022-05-27-flashattention.md
Skills/llm-wiki/examples/wiki/README.md
Skills/llm-wiki/examples/wiki/gaps.md
Skills/llm-wiki/examples/wiki/index.md
Skills/llm-wiki/examples/wiki/log.md
Skills/llm-wiki/examples/wiki/machine-learning/attention-cost.md
Skills/llm-wiki/examples/wiki/machine-learning/attention-efficiency.md
Skills/llm-wiki/examples/wiki/machine-learning/transformer-architectures.md
Skills/llm-wiki/examples/wiki/machine-learning/why-transformers-scale.md
Let your AI agent find skills like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 56,283 agent skills by what they can do, searchable in plain language.
wish › “Query compiled machine learning knowledge on transformers and attention”
Give your agent the search over MCP, or paste the wish link into any chat. No install? Search from any chat →
Related skills
LLM Wiki lets you build and maintain a self-contained personal knowledge base as plain markdown, organized into immutable source material and compiled articles you own. Sources land in a `raw/` directory, you compile them into `wiki/` articles, and the system keeps everything local—readable on GitHub and openable as an Obsidian vault. Query your knowledge, ingest new sources, lint for health, audit claims against their sources, or critique reasoning, all without external servers or embeddings.
llm-wiki creates and updates a structured markdown documentation system for any codebase, storing it in a `.llm-wiki/` directory at your project root. It handles reconnaissance, skeleton generation, article writing, cross-linking, and linting—letting humans direct while the LLM manages the bookkeeping. The wiki compounds over time as your codebase evolves, capturing architecture, modules, concepts, APIs, and guides in an interlinked format.
Llm Wiki helps you create and sustain a markdown-based knowledge repository where an LLM handles ongoing maintenance and synthesis. Ingest raw sources—articles, papers, transcripts, screenshots—into immutable storage, then let the agent populate wiki pages, cross-links, and navigation files. Periodic lint passes keep the vault healthy and coherent.
LLM Wiki is a self-maintaining personal knowledge base that ingests articles, notes, PDFs, and Reddit threads into a structured wiki with automatic cross-references and contradiction detection. It supports discovery, querying, linting, and synthesis workflows to keep your knowledge organized and current.
wiki-query is a read-only protocol for fast, index-first lookups across llm-wiki knowledge bases. It prioritizes exact file citations and respects evidence boundaries, refusing to fill gaps from model memory. Use it for inventory checks and factual questions where provenance matters.
Wiki Manager organizes AI-generated knowledge bases as interconnected markdown articles compiled from ingested sources. It handles hub resolution, topic sub-wikis, incremental compilation, and semantic queries without external tools—all through Claude Code.
More skills wiki (MIT) · karpathy-llm-wiki (MIT)