GPU Memory Hierarchy & Optimization
Master GPU memory hierarchy from registers to global memory, understand coalescing patterns, bank conflicts, and optimization strategies for maximum performance
Related
20 min read · intermediate
ML Concepts - Page 5
Clear explanations of core machine learning concepts, from foundational ideas to advanced techniques. Understand attention mechanisms, transformers, skip connections, and more.
194
Total Concepts
341
Topics
Page 5
of 33
Concepts - Page 5
Browse by categoryPython Memory Management
A practical mental model for CPython memory management: names and references, object headers, PyMalloc arenas, reference counting, reuse paths, and memory profiling.
Related
14 min read · intermediate
Linux Kernel Architecture: How Your OS Actually Works
Linux kernel architecture explained. Learn syscalls, protection rings, user vs kernel space, and what happens when you run a command.
Related
12 min read
Positional Embeddings in Vision Transformers
Explore how positional embeddings enable Vision Transformers (ViT) to process sequential data by encoding relative positions.
Related
6 min read · intermediate
NAS-FPN: Learning to Design Feature Pyramid Networks
Understanding how neural architecture search discovers optimal feature pyramid architectures that outperform hand-designed alternatives
Related
15 min read · advanced
Batch Norm vs Layer Norm: When to Use Which
BatchNorm normalizes over the batch and spatial axes; LayerNorm normalizes over the channel and spatial axes for each sample. The choice changes whether your model trains stably with batch=1, depends on batch composition at inference, and behaves consistently across train and eval.
Related
8 min read · intermediate
Showing 25-30 of 194 concepts