CPU Pipeline Architecture
Deep dive into CPU pipeline architecture covering 5-stage RISC pipelines, data hazards, control hazards, superscalar execution, and out-of-order processing.
Related
8 min read
ML Concepts - Page 15
Clear explanations of core machine learning concepts, from foundational ideas to advanced techniques. Understand attention mechanisms, transformers, skip connections, and more.
194
Total Concepts
341
Topics
Page 15
of 33
Concepts - Page 15
Browse by categoryMulti-Query Attention (MQA)
Learn Multi-Query Attention (MQA), the optimization that shares keys and values across attention heads for massive memory savings.
Related
6 min read · intermediate
He/Kaiming Initialization
Learn He (Kaiming) initialization for ReLU networks: why ReLU needs special weight initialization, variance flow, and dead neurons explained.
Related
7 min read
Binary Embeddings for Fast Search
Learn how binary embeddings use 1-bit quantization for ultra-compact vector representations, enabling billion-scale similarity search with 32x memory reduction.
Related
8 min read · intermediate
MPI Fundamentals: Message Passing for Distributed Computing
Complete MPI guide — point-to-point and collective communication with real C and mpi4py code, deadlock simulation, performance benchmarking, communicator splitting, and debugging on HPC clusters.
Related
22 min read · intermediate
Python Green Threads vs OS Threads
Complete guide to Python concurrency — OS threads, green threads (asyncio), the GIL, event loop internals, Python 3.13 free-threading, and production patterns.
Related
20 min read · intermediate
Showing 85-90 of 194 concepts