{"enrichment":{"faq":[{"a":"Neural Network Design teaches you to construct convolutional architectures by stacking convolutional layers, pooling operations, and fully connected heads. You'll learn to choose filter sizes, depths, and stride patterns based on your image resolution and classification task. The skill covers how to balance model capacity with computational constraints and when to apply regularization like dropout and batch normalization to prevent overfitting on vision datasets.","q":"How do I design a CNN architecture for image classification?"},{"a":"Neural Network Design covers architecture selection across three major paradigms. CNNs excel at spatial feature extraction for images through weight sharing and local connectivity. RNNs and LSTMs process sequential data by maintaining hidden state across time steps. Transformers use self-attention mechanisms to capture long-range dependencies without recurrence, making them ideal for NLP and sequence modeling. The skill helps you match each architecture type to your problem's structure.","q":"What are the key differences between CNN, RNN, and transformer architectures?"},{"a":"Neural Network Design covers layer composition best practices including the ordering of convolutions, normalization, and activation functions. You'll learn batch normalization for stabilizing training across layers, layer normalization for transformer blocks, and how these techniques interact with regularization methods like dropout. The skill explains why normalization reduces internal covariate shift and enables training of deeper architectures more effectively.","q":"How should I compose layers and apply normalization in deep networks?"},{"a":"Neural Network Design teaches transformer architecture construction, including multi-head self-attention blocks, positional encoding, and feed-forward sublayers. You'll understand how attention mechanisms allow models to weigh relationships between all tokens in a sequence, and how to stack these blocks for deeper models. The skill covers implementation patterns in PyTorch and TensorFlow to bring transformer designs to production.","q":"How do I build a transformer model with self-attention for NLP?"},{"a":"Neural Network Design explains how skip connections (residual paths) enable training of very deep networks by allowing gradients to flow directly through layers. You'll learn ResNet-style architectures where identity mappings bypass one or more layers, reducing vanishing gradient problems. The skill covers when to apply skip connections, how they interact with normalization, and their impact on optimization dynamics in networks with 50+ layers.","q":"What role do skip connections play in deep neural networks?"},{"a":"Neural Network Design addresses depth versus width tradeoffs: deeper networks can learn hierarchical features but are harder to train, while wider networks increase capacity per layer with lower optimization difficulty. The skill teaches you to consider your dataset size, computational budget, and task complexity when making this choice, and how techniques like skip connections and normalization shift these tradeoffs in favor of deeper architectures.","q":"How do I choose between depth and width when designing a neural network?"}],"shadow_tags":["model-architecture","deep-learning-design","layer-composition","attention-mechanisms","network-optimization","computer-vision-models","sequence-processing","framework-agnostic","architecture-patterns","training-stability"],"summary_rewrite":"Master the fundamentals of constructing neural networks across multiple paradigms\u2014from convolutional layers for image processing to recurrent units for sequences and transformer blocks for attention-based learning. This skill covers architecture selection, layer composition, normalization strategies, and regularization approaches to help you tailor models to your problem domain."},"files":[{"bytes":11476,"path":"skills/neural-network-design/SKILL.md","sha256":"30dd8fa4833255be7896dc1faf6d6ba6d974874985d842ce10af0ee9bfdc8ace","url":"https://skillfed.io/files/aj-geddes/useful-ai-prompts/neural-network-design/ebbf2961/SKILL.md"}],"id":"aj-geddes/useful-ai-prompts/neural-network-design","links":{"html":"https://skillfed.io/aj-geddes/useful-ai-prompts/neural-network-design","md":"https://skillfed.io/aj-geddes/useful-ai-prompts/neural-network-design.md","repo":"https://github.com/aj-geddes/useful-ai-prompts"},"meta":{"agents_supported":[],"first_seen":"2026-07-28","forks":45,"language":"Shell","last_updated":"2026-03-04","license":"MIT","name":"Neural Network Design","publisher":"aj-geddes","stars":299},"relations":{"similar":[{"id":"aj-geddes/useful-ai-prompts/computer-vision"},{"id":"pluginagentmarketplace/custom-plugin-data-engineer/deep-learning"},{"id":"affaan-m/ECC/pytorch-patterns"},{"id":"personamanagmentlayer/pcl/ml-expert"},{"id":"tondevrel/scientific-agent-skills/pytorch-geometric"},{"id":"synthetic-sciences/openscience/moe-training"},{"id":"Orchestra-Research/AI-Research-SKILLs/moe-training"},{"id":"OpenLAIR/dr-claw/moe-training"},{"id":"aj-geddes/useful-ai-prompts/ml-model-training"},{"id":"synthetic-sciences/openscience/long-context"}]},"slug":{"owner":"aj-geddes","repo":"useful-ai-prompts","skill":"neural-network-design"},"version":"ebbf2961"}